2024-09-14T10:44:11.993 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:44:12.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:44:12.101 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140 branch: main description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904140' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLs2Ri/OsFMAUDqtx5HxUxeTbcSATbP3onKqKoz7/HcZuIymDG0DvygA8GKlK6OXa8gBm6GHC/2UbDJ1fm1bYig= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtmaOZBlZhAfeDMyEYuuP/gr9nvLwkV4Fj5r9LzeVEgQRTyve+23PDZ6CiuNYE4M4Au47GBSMeiu8uqUkY+jvU= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:44:12.101 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:44:12.102 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:44:12.102 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:44:12.104 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:44:12.127 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:44:12.127 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:44:12.127 INFO:teuthology.packaging:ref: None 2024-09-14T10:44:12.127 INFO:teuthology.packaging:tag: None 2024-09-14T10:44:12.127 INFO:teuthology.packaging:branch: main 2024-09-14T10:44:12.128 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:44:12.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:44:12.383 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:44:12.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:44:12.395 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:44:12.395 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:44:12.402 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:44:12.415 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:44:12.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:44:12.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:38:59.066387', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLs2Ri/OsFMAUDqtx5HxUxeTbcSATbP3onKqKoz7/HcZuIymDG0DvygA8GKlK6OXa8gBm6GHC/2UbDJ1fm1bYig='} 2024-09-14T10:44:12.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:38:59.064649', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtmaOZBlZhAfeDMyEYuuP/gr9nvLwkV4Fj5r9LzeVEgQRTyve+23PDZ6CiuNYE4M4Au47GBSMeiu8uqUkY+jvU='} 2024-09-14T10:44:12.471 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:44:12.476 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-14T10:44:12.477 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-14T10:44:12.477 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:44:12.532 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f550286bbe0>, signals=[15]) 2024-09-14T10:44:12.532 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:44:12.539 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:44:12.540 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T10:44:12.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:44:12.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T10:44:12.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:44:12.688 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:44:12.695 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-09-14T10:44:12.713 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-09-14T10:44:12.713 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-09-14T10:44:12.770 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-09-14T10:44:12.770 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-09-14T10:44:12.770 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-09-14T10:44:12.770 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:44:12.770 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:44:12.771 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:44:12.772 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-09-14T10:44:12.812 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-09-14T10:44:12.830 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-09-14T10:44:12.831 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:44:12.889 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:44:12.890 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:44:12.890 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-09-14T10:44:12.911 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:44:12.921 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:44:12.927 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:44:12.927 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:44:12.929 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:44:12.946 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:44:12.953 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:44:12.953 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:44:12.986 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:44:13.100 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:44:13.152 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:44:13.177 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:44:13.177 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:44:13.178 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:44:13.178 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:44:13.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:44:13.195 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T10:44:13.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:44:13.196 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-14T10:44:13.253 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:44:13.253 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.14.0-503.el9.x86_64 2024-09-14T10:44:13.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum install -y kernel 2024-09-14T10:44:13.254 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:44:13.255 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-503.el9.x86_64 2024-09-14T10:44:13.255 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-09-14T10:44:15.515 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-14T10:44:17.255 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.2 MB 00:02 2024-09-14T10:44:17.341 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-14T10:44:19.031 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-14T10:44:22.008 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.5 MB 00:00 2024-09-14T10:44:23.315 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T10:44:23.400 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-14T10:44:24.363 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-14T10:44:24.858 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-14T10:44:26.087 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-14T10:44:29.835 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T10:44:31.434 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-14T10:44:31.884 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:44:31.884 INFO:teuthology.orchestra.run.smithi164.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:44:31.978 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:44:31.985 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-14T10:44:31.986 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:44:31.987 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 79 M 2024-09-14T10:44:31.987 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 126 M 2024-09-14T10:44:31.987 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:44:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 76 kB/s | 23 kB 00:00 2024-09-14T10:44:33.441 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:44:33.441 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:44:33.541 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:44:33.550 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:44:33.551 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-14T10:44:33.551 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:44:33.551 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 79 M 2024-09-14T10:44:33.551 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 126 M 2024-09-14T10:44:33.551 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:44:33.652 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 314 kB/s | 23 kB 00:00 2024-09-14T10:44:37.044 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 10 MB/s | 35 MB 00:03 2024-09-14T10:44:37.661 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-14T10:44:38.253 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.2 MB/s | 29 MB 00:04 2024-09-14T10:44:38.253 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:44:38.253 INFO:teuthology.orchestra.run.smithi116.stdout:Total 17 MB/s | 79 MB 00:04 2024-09-14T10:44:38.931 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:44:39.262 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:44:39.263 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:44:40.086 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-14T10:44:40.211 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:44:40.212 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:44:42.650 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:44:43.335 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:44:43.428 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:44:46.214 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:44:46.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:44:48.343 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 986 kB/s | 16 MB 00:16 2024-09-14T10:44:51.212 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:44:51.323 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:44:56.185 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:16.557 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 795 kB/s | 35 MB 00:44 2024-09-14T10:45:16.557 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:45:16.557 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.8 MB/s | 79 MB 00:44 2024-09-14T10:45:17.236 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:45:17.598 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:45:17.599 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:45:18.543 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:45:18.543 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:45:21.005 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:45:21.725 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:21.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:24.622 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:24.752 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:29.581 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:29.643 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:34.493 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:34.505 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:34.544 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:34.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:35.686 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:45:35.687 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:45:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:45:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:45:35.687 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:45:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:45:35.688 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:45:35.688 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:45:36.043 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:45:36.129 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:45:36.129 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:45:36.129 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:45:36.129 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:45:36.129 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:45:36.130 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:45:36.130 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:45:36.130 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:45:36.189 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:45:36.189 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:45:36.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 82.el9 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8274670 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-09-14T10:45:36.221 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:45:36.222 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:45:36.223 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-09-14T10:45:36.223 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:45:36.223 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:45:36.223 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:45:36.224 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:45:36.224 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:45:36.862 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-09-14T10:45:38.234 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:45:38.265 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-09-14T10:45:38.267 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T10:45:38.282 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.37UqliG63R 2024-09-14T10:45:38.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.37UqliG63R 2024-09-14T10:45:38.356 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.37UqliG63R 2024-09-14T10:45:38.496 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.37UqliG63R is 6KB 2024-09-14T10:45:38.546 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.37UqliG63R 2024-09-14T10:45:38.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:45:38.625 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:45:38.625 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:45:38.625 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:45:38.625 INFO:teuthology.orchestra.run.smithi116.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:45:38.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:45:38.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-09-14T10:46:08.769 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:46:08.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T10:46:08.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:46:12.299 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:12.339 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:12.646 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:12.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:46:12.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:12.646 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:46:13.526 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:46:13.895 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:13.984 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:13.984 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:13.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:46:13.984 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:46:13.984 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:46:13.984 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-14T10:46:13.985 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:46:13.985 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:14.043 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:14.044 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:14.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-09-14T10:46:14.077 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-09-14T10:46:14.077 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-09-14T10:46:14.077 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-09-14T10:46:14.077 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 82.el9 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8274670 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-09-14T10:46:14.078 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:46:14.079 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:46:14.080 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:46:14.080 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:46:14.080 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:46:14.689 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-09-14T10:46:16.024 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:46:16.058 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-09-14T10:46:16.061 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-09-14T10:46:16.076 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.jtIDDmuTJT 2024-09-14T10:46:16.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jtIDDmuTJT 2024-09-14T10:46:16.143 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.jtIDDmuTJT 2024-09-14T10:46:16.315 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.jtIDDmuTJT is 6KB 2024-09-14T10:46:16.364 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.jtIDDmuTJT 2024-09-14T10:46:16.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:46:16.443 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:46:16.443 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:46:16.444 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:46:16.444 INFO:teuthology.orchestra.run.smithi164.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:46:16.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:46:16.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-09-14T10:46:46.625 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-14T10:46:46.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:46:46.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:08.793 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:47:17.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T10:47:17.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:18.601 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T10:47:18.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T10:47:18.985 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:47:18.986 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-09-14T10:47:19.000 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:47:19.001 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:47:19.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:47:19.001 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:47:20.002 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:47:20.003 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:47:20.078 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-09-14T10:47:20.100 DEBUG:teuthology.parallel:result is None 2024-09-14T10:47:21.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-14T10:47:30.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:47:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:48.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-09-14T10:48:00.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:48:00.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:02.480 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-14T10:48:02.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:48:02.882 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:48:02.883 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-09-14T10:48:02.900 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:48:02.900 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:48:02.900 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:48:02.900 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:48:03.901 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-14T10:48:03.902 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:48:04.013 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-09-14T10:48:04.044 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:04.044 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:48:04.052 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:48:04.052 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:04.055 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:04.073 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:48:04.079 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:48:04.089 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:48:04.089 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:04.115 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:04.178 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:48:04.185 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:48:04.186 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:04.189 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:04.222 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:04.225 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:04.232 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:04.236 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:04.238 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:48:04.245 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:48:04.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:04.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:04.307 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:48:04.317 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:48:04.317 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:04.349 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:04.365 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:04.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:04.496 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:04.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:04.620 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:48:04.620 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:04.689 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:04.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:04.774 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:04.857 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:04.896 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:48:04.896 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:04.961 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-09-14T10:48:04.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-09-14T10:48:05.042 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:05.060 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:05.432 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:48:05.439 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:48:05.440 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:48:05.500 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:48:05.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-09-14T10:48:05.592 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-09-14T10:48:05.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-09-14T10:48:05.668 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-09-14T10:48:05.670 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:48:05.670 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-09-14T10:48:05.692 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-09-14T10:48:05.693 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-09-14T10:48:05.725 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-09-14T10:48:05.726 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2024-09-14T10:48:05.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:05.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:05.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:05.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:05.792 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:48:05.793 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:05.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:05.867 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:48:05.877 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:48:05.888 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:48:05.889 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:51:50.758 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-09-14T10:51:50.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T10:51:50.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:51:50.841 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-09-14T10:51:50.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-09-14T10:51:50.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:51:50.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:51:50.993 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-09-14T10:51:51.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-09-14T10:51:51.076 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:51:51.087 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:51:51.088 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:51:51.088 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:51:51.091 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:51:51.091 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:51:51.119 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:51:51.134 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:51:51.144 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:51:51.158 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:51:51.159 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-09-14T10:51:51.170 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-09-14T10:51:51.182 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-09-14T10:51:51.184 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:51:51.194 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-09-14T10:51:51.198 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:51:51.208 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:51:51.222 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:51:51.253 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:51:51.256 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:51:51.256 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T10:51:51.256 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.256 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.257 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.257 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.275 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.279 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:51:51.280 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:51:51.289 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:51:51.289 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:51:51.289 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:51:51.289 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:51:51.294 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:51:51.295 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:51:51.295 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:51:51.296 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:51:51.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:51:51.298 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:51:51.438 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:51:51.438 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:51:51.443 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:51:51.443 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:51:51.547 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:51:51.547 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:51:51.547 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:51:51.552 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:51:51.553 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:51:51.553 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:51:51.574 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-14T10:51:51.574 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:51:51.578 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-14T10:51:51.579 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:51:51.640 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:51:51.645 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:51:51.715 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:51:51.721 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:51:51.779 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-09-14T10:51:51.780 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-09-14T10:51:51.786 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-09-14T10:51:51.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-09-14T10:51:52.007 INFO:teuthology.orchestra.run.smithi116.stdout:45 files removed 2024-09-14T10:51:52.019 INFO:teuthology.orchestra.run.smithi164.stdout:45 files removed 2024-09-14T10:51:52.034 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw 2024-09-14T10:51:52.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw 2024-09-14T10:51:52.590 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-14T10:51:52.600 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-14T10:51:52.874 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-14T10:51:52.893 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-14T10:51:53.150 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T10:51:53.168 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-14T10:51:54.542 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.2 MB 00:01 2024-09-14T10:51:55.127 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-14T10:51:56.277 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-14T10:52:00.619 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-14T10:52:02.012 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-14T10:52:02.958 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-14T10:52:04.144 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-14T10:52:08.338 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-14T10:52:09.362 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-14T10:52:10.771 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 19 kB 00:00 2024-09-14T10:52:10.839 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:52:10.856 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:10.856 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:52:10.857 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:10.857 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:52:10.857 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:52:10.857 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-09-14T10:52:10.857 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:52:10.858 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:52:10.859 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:52:10.860 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:52:10.861 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2024-09-14T10:52:10.862 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout:Install 31 Packages 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-09-14T10:52:10.863 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:10.864 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 62 M 2024-09-14T10:52:10.864 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:52:11.681 INFO:teuthology.orchestra.run.smithi116.stdout:(1/33): ceph-base-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-14T10:52:11.731 INFO:teuthology.orchestra.run.smithi116.stdout:(2/33): ceph-selinux-19.3.0-4907.ga2782315.el9. 506 kB/s | 25 kB 00:00 2024-09-14T10:52:11.832 INFO:teuthology.orchestra.run.smithi116.stdout:(3/33): libcephfs2-19.3.0-4907.ga2782315.el9.x8 7.4 MB/s | 756 kB 00:00 2024-09-14T10:52:11.916 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-14T10:52:11.932 INFO:teuthology.orchestra.run.smithi116.stdout:(4/33): libradosstriper1-19.3.0-4907.ga2782315. 5.0 MB/s | 508 kB 00:00 2024-09-14T10:52:12.049 INFO:teuthology.orchestra.run.smithi116.stdout:(5/33): ceph-radosgw-19.3.0-4907.ga2782315.el9. 12 MB/s | 11 MB 00:00 2024-09-14T10:52:12.082 INFO:teuthology.orchestra.run.smithi116.stdout:(6/33): python3-ceph-argparse-19.3.0-4907.ga278 1.3 MB/s | 45 kB 00:00 2024-09-14T10:52:12.208 INFO:teuthology.orchestra.run.smithi116.stdout:(7/33): librgw2-19.3.0-4907.ga2782315.el9.x86_6 20 MB/s | 5.5 MB 00:00 2024-09-14T10:52:12.233 INFO:teuthology.orchestra.run.smithi116.stdout:(8/33): python3-ceph-common-19.3.0-4907.ga27823 955 kB/s | 143 kB 00:00 2024-09-14T10:52:12.258 INFO:teuthology.orchestra.run.smithi116.stdout:(9/33): python3-cephfs-19.3.0-4907.ga2782315.el 3.2 MB/s | 161 kB 00:00 2024-09-14T10:52:12.458 INFO:teuthology.orchestra.run.smithi116.stdout:(10/33): ceph-common-19.3.0-4907.ga2782315.el9. 17 MB/s | 22 MB 00:01 2024-09-14T10:52:12.492 INFO:teuthology.orchestra.run.smithi116.stdout:(11/33): python3-rados-19.3.0-4907.ga2782315.el 1.2 MB/s | 320 kB 00:00 2024-09-14T10:52:12.518 INFO:teuthology.orchestra.run.smithi116.stdout:(12/33): python3-rbd-19.3.0-4907.ga2782315.el9. 1.1 MB/s | 305 kB 00:00 2024-09-14T10:52:12.543 INFO:teuthology.orchestra.run.smithi116.stdout:(13/33): python3-rgw-19.3.0-4907.ga2782315.el9. 1.2 MB/s | 99 kB 00:00 2024-09-14T10:52:12.643 INFO:teuthology.orchestra.run.smithi116.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 710 kB/s | 107 kB 00:00 2024-09-14T10:52:12.668 INFO:teuthology.orchestra.run.smithi116.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-14T10:52:12.693 INFO:teuthology.orchestra.run.smithi116.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-14T10:52:12.719 INFO:teuthology.orchestra.run.smithi116.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-14T10:52:12.761 INFO:teuthology.orchestra.run.smithi116.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-14T10:52:12.794 INFO:teuthology.orchestra.run.smithi116.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-14T10:52:12.819 INFO:teuthology.orchestra.run.smithi116.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-14T10:52:12.845 INFO:teuthology.orchestra.run.smithi116.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 716 kB/s | 36 kB 00:00 2024-09-14T10:52:12.870 INFO:teuthology.orchestra.run.smithi116.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-14T10:52:12.895 INFO:teuthology.orchestra.run.smithi116.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-14T10:52:12.954 INFO:teuthology.orchestra.run.smithi116.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-14T10:52:12.979 INFO:teuthology.orchestra.run.smithi116.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-14T10:52:13.004 INFO:teuthology.orchestra.run.smithi116.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-14T10:52:13.021 INFO:teuthology.orchestra.run.smithi116.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-14T10:52:13.055 INFO:teuthology.orchestra.run.smithi116.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-14T10:52:13.096 INFO:teuthology.orchestra.run.smithi116.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-14T10:52:13.163 INFO:teuthology.orchestra.run.smithi116.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-14T10:52:13.264 INFO:teuthology.orchestra.run.smithi116.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T10:52:13.322 INFO:teuthology.orchestra.run.smithi116.stdout:(32/33): librados2-19.3.0-4907.ga2782315.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-14T10:52:13.406 INFO:teuthology.orchestra.run.smithi116.stdout:(33/33): librbd1-19.3.0-4907.ga2782315.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-14T10:52:13.411 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:13.411 INFO:teuthology.orchestra.run.smithi116.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-14T10:52:13.520 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:52:13.556 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:52:13.556 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:52:14.222 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:52:14.223 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:52:15.738 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:52:15.823 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T10:52:15.861 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T10:52:15.886 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T10:52:15.909 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T10:52:15.937 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T10:52:16.128 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T10:52:16.181 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T10:52:16.573 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T10:52:16.646 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:16.738 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:16.828 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 8/35 2024-09-14T10:52:16.856 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 9/35 2024-09-14T10:52:16.919 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 9/35 2024-09-14T10:52:16.955 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T10:52:17.000 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9. 11/35 2024-09-14T10:52:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 12/35 2024-09-14T10:52:17.091 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 13/35 2024-09-14T10:52:17.164 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 13/35 2024-09-14T10:52:17.198 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T10:52:17.317 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T10:52:17.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T10:52:17.399 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T10:52:17.422 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-14T10:52:17.431 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T10:52:17.461 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T10:52:17.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T10:52:17.530 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T10:52:17.855 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T10:52:17.915 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 23/35 2024-09-14T10:52:18.007 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 23/35 2024-09-14T10:52:18.036 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 24/35 2024-09-14T10:52:18.072 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T10:52:18.560 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T10:52:18.592 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 27/35 2024-09-14T10:52:18.664 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 27/35 2024-09-14T10:52:18.741 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 28/35 2024-09-14T10:52:18.770 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x8 29/35 2024-09-14T10:52:19.790 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:52:19.812 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:52:19.813 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:52:19.814 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout:Install 31 Packages 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 2 Packages 2024-09-14T10:52:19.815 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:19.816 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 62 M 2024-09-14T10:52:19.816 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:52:20.441 INFO:teuthology.orchestra.run.smithi164.stdout:(1/33): ceph-base-19.3.0-4907.ga2782315.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-14T10:52:20.507 INFO:teuthology.orchestra.run.smithi164.stdout:(2/33): ceph-selinux-19.3.0-4907.ga2782315.el9. 379 kB/s | 25 kB 00:00 2024-09-14T10:52:20.666 INFO:teuthology.orchestra.run.smithi164.stdout:(3/33): ceph-radosgw-19.3.0-4907.ga2782315.el9. 14 MB/s | 11 MB 00:00 2024-09-14T10:52:20.700 INFO:teuthology.orchestra.run.smithi164.stdout:(4/33): libcephfs2-19.3.0-4907.ga2782315.el9.x8 3.8 MB/s | 756 kB 00:00 2024-09-14T10:52:20.725 INFO:teuthology.orchestra.run.smithi164.stdout:(5/33): libradosstriper1-19.3.0-4907.ga2782315. 8.6 MB/s | 508 kB 00:00 2024-09-14T10:52:20.783 INFO:teuthology.orchestra.run.smithi164.stdout:(6/33): python3-ceph-argparse-19.3.0-4907.ga278 772 kB/s | 45 kB 00:00 2024-09-14T10:52:20.884 INFO:teuthology.orchestra.run.smithi164.stdout:(7/33): python3-ceph-common-19.3.0-4907.ga27823 1.4 MB/s | 143 kB 00:00 2024-09-14T10:52:20.967 INFO:teuthology.orchestra.run.smithi164.stdout:(8/33): librgw2-19.3.0-4907.ga2782315.el9.x86_6 21 MB/s | 5.5 MB 00:00 2024-09-14T10:52:20.992 INFO:teuthology.orchestra.run.smithi164.stdout:(9/33): python3-cephfs-19.3.0-4907.ga2782315.el 1.5 MB/s | 161 kB 00:00 2024-09-14T10:52:21.018 INFO:teuthology.orchestra.run.smithi164.stdout:(10/33): python3-rados-19.3.0-4907.ga2782315.el 6.2 MB/s | 320 kB 00:00 2024-09-14T10:52:21.043 INFO:teuthology.orchestra.run.smithi164.stdout:(11/33): python3-rbd-19.3.0-4907.ga2782315.el9. 5.9 MB/s | 305 kB 00:00 2024-09-14T10:52:21.068 INFO:teuthology.orchestra.run.smithi164.stdout:(12/33): python3-rgw-19.3.0-4907.ga2782315.el9. 1.9 MB/s | 99 kB 00:00 2024-09-14T10:52:21.122 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:21.157 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:21.285 INFO:teuthology.orchestra.run.smithi164.stdout:(13/33): ceph-common-19.3.0-4907.ga2782315.el9. 16 MB/s | 22 MB 00:01 2024-09-14T10:52:21.369 INFO:teuthology.orchestra.run.smithi164.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-14T10:52:21.394 INFO:teuthology.orchestra.run.smithi164.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-14T10:52:21.420 INFO:teuthology.orchestra.run.smithi164.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-14T10:52:21.445 INFO:teuthology.orchestra.run.smithi164.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-14T10:52:21.487 INFO:teuthology.orchestra.run.smithi164.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-14T10:52:21.537 INFO:teuthology.orchestra.run.smithi164.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-14T10:52:21.562 INFO:teuthology.orchestra.run.smithi164.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-14T10:52:21.587 INFO:teuthology.orchestra.run.smithi164.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-14T10:52:21.621 INFO:teuthology.orchestra.run.smithi164.stdout:(22/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-14T10:52:21.646 INFO:teuthology.orchestra.run.smithi164.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-14T10:52:21.705 INFO:teuthology.orchestra.run.smithi164.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-14T10:52:21.731 INFO:teuthology.orchestra.run.smithi164.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-14T10:52:21.738 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:21.756 INFO:teuthology.orchestra.run.smithi164.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 275 kB/s | 26 kB 00:00 2024-09-14T10:52:21.777 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 31/35 2024-09-14T10:52:21.781 INFO:teuthology.orchestra.run.smithi164.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-14T10:52:21.815 INFO:teuthology.orchestra.run.smithi164.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-14T10:52:21.857 INFO:teuthology.orchestra.run.smithi164.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-14T10:52:21.873 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 31/35 2024-09-14T10:52:21.873 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:52:21.873 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:52:21.873 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:21.912 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:21.915 INFO:teuthology.orchestra.run.smithi164.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T10:52:21.999 INFO:teuthology.orchestra.run.smithi164.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-14T10:52:22.133 INFO:teuthology.orchestra.run.smithi164.stdout:(32/33): librados2-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-14T10:52:22.183 INFO:teuthology.orchestra.run.smithi164.stdout:(33/33): librbd1-19.3.0-4907.ga2782315.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-14T10:52:22.188 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:22.188 INFO:teuthology.orchestra.run.smithi164.stdout:Total 26 MB/s | 62 MB 00:02 2024-09-14T10:52:22.302 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:52:22.340 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:52:22.340 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:52:23.095 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:52:23.095 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:52:24.606 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:52:24.677 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-14T10:52:24.713 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-14T10:52:24.746 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-14T10:52:24.769 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T10:52:24.793 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-14T10:52:24.988 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T10:52:25.041 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-14T10:52:25.379 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-14T10:52:25.490 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:25.582 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:25.671 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 8/35 2024-09-14T10:52:25.700 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 9/35 2024-09-14T10:52:25.754 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 9/35 2024-09-14T10:52:25.792 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-14T10:52:25.836 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9. 11/35 2024-09-14T10:52:25.915 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 12/35 2024-09-14T10:52:25.944 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 13/35 2024-09-14T10:52:26.000 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 13/35 2024-09-14T10:52:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-14T10:52:26.154 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-14T10:52:26.185 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-14T10:52:26.233 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-14T10:52:26.267 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-14T10:52:26.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-14T10:52:26.330 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T10:52:26.376 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-14T10:52:26.711 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-14T10:52:26.760 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 23/35 2024-09-14T10:52:26.859 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 23/35 2024-09-14T10:52:26.889 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 24/35 2024-09-14T10:52:26.925 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-14T10:52:27.414 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-14T10:52:27.437 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 27/35 2024-09-14T10:52:27.492 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 27/35 2024-09-14T10:52:27.570 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 28/35 2024-09-14T10:52:27.606 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x8 29/35 2024-09-14T10:52:29.919 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:29.953 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:30.551 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 30/35 2024-09-14T10:52:30.590 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 31/35 2024-09-14T10:52:30.689 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 31/35 2024-09-14T10:52:30.690 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:52:30.690 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:52:30.690 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:30.733 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:32.271 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:32.271 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-09-14T10:52:32.272 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:33.287 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 33/35 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 33/35 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:52:33.313 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:33.315 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T10:52:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T10:52:33.398 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:34.608 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 1/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 3/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 4/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 5/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 6/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:34.609 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9. 8/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x8 9/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 10/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 11/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 12/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 13/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T10:52:34.611 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T10:52:34.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 34/35 2024-09-14T10:52:35.612 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:35.612 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:35.612 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.613 INFO:teuthology.orchestra.run.smithi116.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.614 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:35.615 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:52:36.016 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test 2024-09-14T10:52:36.587 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:52:36.720 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:52:36.721 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 51 M 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 217 M 2024-09-14T10:52:36.722 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:52:36.927 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-14T10:52:36.978 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-14T10:52:37.003 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): libcephsqlite-19.3.0-4907.ga2782315.el9. 625 kB/s | 161 kB 00:00 2024-09-14T10:52:38.920 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): ceph-test-19.3.0-4907.ga2782315.el9.x86_ 23 MB/s | 50 MB 00:02 2024-09-14T10:52:38.922 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:38.922 INFO:teuthology.orchestra.run.smithi116.stdout:Total 23 MB/s | 51 MB 00:02 2024-09-14T10:52:38.949 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:52:38.970 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:52:38.970 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:52:39.351 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:52:39.351 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:52:39.963 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T10:52:40.002 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T10:52:40.029 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 3/4 2024-09-14T10:52:40.781 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-09-14T10:52:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-09-14T10:52:40.781 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-09-14T10:52:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-09-14T10:52:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-09-14T10:52:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-09-14T10:52:40.782 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-09-14T10:52:40.782 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:41.820 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 33/35 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 33/35 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:52:41.846 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:41.848 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T10:52:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-14T10:52:41.922 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:43.182 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:43.182 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 1/35 2024-09-14T10:52:43.182 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2/35 2024-09-14T10:52:43.182 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 3/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 4/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 5/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_6 6/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 7/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9. 8/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x8 9/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 10/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 11/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 12/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 13/35 2024-09-14T10:52:43.183 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-14T10:52:43.184 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 32/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-14T10:52:43.185 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 34/35 2024-09-14T10:52:44.303 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-14T10:52:44.303 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:44.303 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.304 INFO:teuthology.orchestra.run.smithi164.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.305 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:44.306 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:52:44.667 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-test 2024-09-14T10:52:44.784 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 3/4 2024-09-14T10:52:44.869 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 4/4 2024-09-14T10:52:45.239 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:28 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:52:45.373 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:52:45.374 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:45.374 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:52:45.374 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:45.374 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout:Install 4 Packages 2024-09-14T10:52:45.375 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:45.376 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 51 M 2024-09-14T10:52:45.376 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 217 M 2024-09-14T10:52:45.376 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:52:45.611 INFO:teuthology.orchestra.run.smithi164.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-14T10:52:45.636 INFO:teuthology.orchestra.run.smithi164.stdout:(2/4): libcephsqlite-19.3.0-4907.ga2782315.el9. 766 kB/s | 161 kB 00:00 2024-09-14T10:52:45.678 INFO:teuthology.orchestra.run.smithi164.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 956 kB/s | 64 kB 00:00 2024-09-14T10:52:47.153 INFO:teuthology.orchestra.run.smithi164.stdout:(4/4): ceph-test-19.3.0-4907.ga2782315.el9.x86_ 29 MB/s | 50 MB 00:01 2024-09-14T10:52:47.155 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:47.156 INFO:teuthology.orchestra.run.smithi164.stdout:Total 29 MB/s | 51 MB 00:01 2024-09-14T10:52:47.184 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:52:47.204 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:52:47.204 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:52:47.266 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 4/4 2024-09-14T10:52:47.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 1/4 2024-09-14T10:52:47.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2/4 2024-09-14T10:52:47.266 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T10:52:47.587 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:52:47.587 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:47.595 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:52:47.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph 2024-09-14T10:52:48.140 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:52:48.223 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-14T10:52:48.278 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-14T10:52:48.305 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 3/4 2024-09-14T10:52:48.496 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:40 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:52:48.656 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:52:48.658 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:48.658 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:52:48.658 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:48.658 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:52:48.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:52:48.659 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:52:48.660 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:48.661 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout:Install 37 Packages 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 31 M 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 109 M 2024-09-14T10:52:48.662 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:52:49.087 INFO:teuthology.orchestra.run.smithi116.stdout:(1/37): ceph-19.3.0-4907.ga2782315.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-09-14T10:52:49.753 INFO:teuthology.orchestra.run.smithi116.stdout:(2/37): ceph-mgr-19.3.0-4907.ga2782315.el9.x86_ 1.7 MB/s | 1.5 MB 00:00 2024-09-14T10:52:50.012 INFO:teuthology.orchestra.run.smithi116.stdout:(3/37): ceph-mds-19.3.0-4907.ga2782315.el9.x86_ 2.1 MB/s | 2.4 MB 00:01 2024-09-14T10:52:50.187 INFO:teuthology.orchestra.run.smithi116.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4907.ga278 1.6 MB/s | 291 kB 00:00 2024-09-14T10:52:50.829 INFO:teuthology.orchestra.run.smithi116.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 394 kB/s | 253 kB 00:00 2024-09-14T10:52:51.313 INFO:teuthology.orchestra.run.smithi116.stdout:(6/37): ceph-mon-19.3.0-4907.ga2782315.el9.x86_ 2.2 MB/s | 4.8 MB 00:02 2024-09-14T10:52:51.355 INFO:teuthology.orchestra.run.smithi116.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 2.3 MB/s | 1.2 MB 00:00 2024-09-14T10:52:51.463 INFO:teuthology.orchestra.run.smithi116.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-09-14T10:52:51.580 INFO:teuthology.orchestra.run.smithi116.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.0 MB/s | 125 kB 00:00 2024-09-14T10:52:51.706 INFO:teuthology.orchestra.run.smithi116.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-09-14T10:52:51.772 INFO:teuthology.orchestra.run.smithi116.stdout:(11/37): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-14T10:52:51.873 INFO:teuthology.orchestra.run.smithi116.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-14T10:52:51.923 INFO:teuthology.orchestra.run.smithi116.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 695 kB/s | 35 kB 00:00 2024-09-14T10:52:51.948 INFO:teuthology.orchestra.run.smithi116.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 980 kB/s | 172 kB 00:00 2024-09-14T10:52:51.982 INFO:teuthology.orchestra.run.smithi116.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-14T10:52:52.007 INFO:teuthology.orchestra.run.smithi116.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-14T10:52:52.033 INFO:teuthology.orchestra.run.smithi116.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-14T10:52:52.075 INFO:teuthology.orchestra.run.smithi116.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-14T10:52:52.100 INFO:teuthology.orchestra.run.smithi116.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-14T10:52:52.125 INFO:teuthology.orchestra.run.smithi116.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 189 kB/s | 22 kB 00:00 2024-09-14T10:52:52.159 INFO:teuthology.orchestra.run.smithi116.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-14T10:52:52.184 INFO:teuthology.orchestra.run.smithi116.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 457 kB/s | 11 kB 00:00 2024-09-14T10:52:52.201 INFO:teuthology.orchestra.run.smithi116.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-14T10:52:52.218 INFO:teuthology.orchestra.run.smithi116.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-14T10:52:52.235 INFO:teuthology.orchestra.run.smithi116.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2024-09-14T10:52:52.252 INFO:teuthology.orchestra.run.smithi116.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 1.2 MB/s | 20 kB 00:00 2024-09-14T10:52:52.277 INFO:teuthology.orchestra.run.smithi116.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-09-14T10:52:52.294 INFO:teuthology.orchestra.run.smithi116.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-14T10:52:52.319 INFO:teuthology.orchestra.run.smithi116.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-14T10:52:52.345 INFO:teuthology.orchestra.run.smithi116.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 656 kB/s | 16 kB 00:00 2024-09-14T10:52:52.370 INFO:teuthology.orchestra.run.smithi116.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-14T10:52:52.395 INFO:teuthology.orchestra.run.smithi116.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-14T10:52:52.421 INFO:teuthology.orchestra.run.smithi116.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-14T10:52:52.446 INFO:teuthology.orchestra.run.smithi116.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-14T10:52:52.471 INFO:teuthology.orchestra.run.smithi116.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-14T10:52:52.496 INFO:teuthology.orchestra.run.smithi116.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-14T10:52:52.838 INFO:teuthology.orchestra.run.smithi116.stdout:(37/37): ceph-osd-19.3.0-4907.ga2782315.el9.x86 5.6 MB/s | 17 MB 00:03 2024-09-14T10:52:52.842 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:52.842 INFO:teuthology.orchestra.run.smithi116.stdout:Total 7.4 MB/s | 31 MB 00:04 2024-09-14T10:52:52.990 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:52:53.030 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:52:53.030 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:52:53.118 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 3/4 2024-09-14T10:52:53.203 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 4/4 2024-09-14T10:52:53.526 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:52:53.527 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:52:54.895 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:52:54.961 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T10:52:54.994 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T10:52:55.022 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T10:52:55.092 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T10:52:55.146 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T10:52:55.179 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T10:52:55.270 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T10:52:55.357 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T10:52:55.398 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T10:52:55.433 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T10:52:55.462 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T10:52:55.497 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T10:52:55.530 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T10:52:55.579 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T10:52:55.614 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T10:52:55.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T10:52:55.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T10:52:55.698 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 4/4 2024-09-14T10:52:55.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 1/4 2024-09-14T10:52:55.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2/4 2024-09-14T10:52:55.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-14T10:52:55.729 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T10:52:55.802 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T10:52:55.939 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T10:52:56.000 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-14T10:52:56.000 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:56.000 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:52:56.000 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:56.001 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:52:56.001 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:52:56.001 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:52:56.001 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:56.001 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:52:56.020 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T10:52:56.081 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T10:52:56.120 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T10:52:56.221 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T10:52:56.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph 2024-09-14T10:52:56.415 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T10:52:56.608 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T10:52:56.666 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T10:52:56.735 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T10:52:56.823 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T10:52:56.863 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T10:52:56.917 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:39 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:52:56.992 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T10:52:57.061 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:52:57.063 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:52:57.064 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:52:57.065 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:52:57.066 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout:Install 37 Packages 2024-09-14T10:52:57.067 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:52:57.068 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 31 M 2024-09-14T10:52:57.068 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 109 M 2024-09-14T10:52:57.068 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:52:57.169 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9. 32/37 2024-09-14T10:52:57.201 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 33/37 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 33/37 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:52:57.227 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:57.475 INFO:teuthology.orchestra.run.smithi164.stdout:(1/37): ceph-19.3.0-4907.ga2782315.el9.x86_64.r 44 kB/s | 6.6 kB 00:00 2024-09-14T10:52:57.642 INFO:teuthology.orchestra.run.smithi164.stdout:(2/37): ceph-mgr-19.3.0-4907.ga2782315.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-14T10:52:57.692 INFO:teuthology.orchestra.run.smithi164.stdout:(3/37): ceph-mds-19.3.0-4907.ga2782315.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-14T10:52:57.784 INFO:teuthology.orchestra.run.smithi164.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4907.ga278 3.1 MB/s | 291 kB 00:00 2024-09-14T10:52:58.068 INFO:teuthology.orchestra.run.smithi164.stdout:(5/37): ceph-mon-19.3.0-4907.ga2782315.el9.x86_ 8.1 MB/s | 4.8 MB 00:00 2024-09-14T10:52:58.252 INFO:teuthology.orchestra.run.smithi164.stdout:(6/37): ceph-osd-19.3.0-4907.ga2782315.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-14T10:52:58.710 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 34/37 2024-09-14T10:52:58.727 INFO:teuthology.orchestra.run.smithi164.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 269 kB/s | 253 kB 00:00 2024-09-14T10:52:58.737 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 34/37 2024-09-14T10:52:58.737 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:58.737 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:52:58.737 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:52:58.737 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:52:58.738 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:58.919 INFO:teuthology.orchestra.run.smithi164.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-14T10:52:59.119 INFO:teuthology.orchestra.run.smithi164.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.2 MB/s | 1.2 MB 00:01 2024-09-14T10:52:59.194 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 35/37 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 35/37 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:52:59.218 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:59.453 INFO:teuthology.orchestra.run.smithi164.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 186 kB/s | 135 kB 00:00 2024-09-14T10:52:59.461 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 36/37 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 36/37 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:52:59.485 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:52:59.549 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 37/37 2024-09-14T10:52:59.570 INFO:teuthology.orchestra.run.smithi164.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-14T10:52:59.604 INFO:teuthology.orchestra.run.smithi164.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 183 kB/s | 125 kB 00:00 2024-09-14T10:52:59.629 INFO:teuthology.orchestra.run.smithi164.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-14T10:52:59.670 INFO:teuthology.orchestra.run.smithi164.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-14T10:52:59.696 INFO:teuthology.orchestra.run.smithi164.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-09-14T10:52:59.721 INFO:teuthology.orchestra.run.smithi164.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T10:52:59.746 INFO:teuthology.orchestra.run.smithi164.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-14T10:52:59.788 INFO:teuthology.orchestra.run.smithi164.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-14T10:52:59.814 INFO:teuthology.orchestra.run.smithi164.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-14T10:52:59.839 INFO:teuthology.orchestra.run.smithi164.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 189 kB/s | 22 kB 00:00 2024-09-14T10:52:59.873 INFO:teuthology.orchestra.run.smithi164.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-14T10:52:59.898 INFO:teuthology.orchestra.run.smithi164.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-14T10:52:59.931 INFO:teuthology.orchestra.run.smithi164.stdout:(23/37): python3-urllib3-1.26.5-6.el9.noarch.rp 264 kB/s | 215 kB 00:00 2024-09-14T10:52:59.957 INFO:teuthology.orchestra.run.smithi164.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 303 kB/s | 18 kB 00:00 2024-09-14T10:52:59.982 INFO:teuthology.orchestra.run.smithi164.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2024-09-14T10:52:59.999 INFO:teuthology.orchestra.run.smithi164.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 1.3 MB/s | 20 kB 00:00 2024-09-14T10:53:00.024 INFO:teuthology.orchestra.run.smithi164.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-09-14T10:53:00.041 INFO:teuthology.orchestra.run.smithi164.stdout:(28/37): python3-jaraco-collections-3.0.0-8.el9 211 kB/s | 23 kB 00:00 2024-09-14T10:53:00.066 INFO:teuthology.orchestra.run.smithi164.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 691 kB/s | 46 kB 00:00 2024-09-14T10:53:00.092 INFO:teuthology.orchestra.run.smithi164.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-14T10:53:00.117 INFO:teuthology.orchestra.run.smithi164.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-14T10:53:00.142 INFO:teuthology.orchestra.run.smithi164.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-14T10:53:00.167 INFO:teuthology.orchestra.run.smithi164.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-14T10:53:00.193 INFO:teuthology.orchestra.run.smithi164.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-14T10:53:00.218 INFO:teuthology.orchestra.run.smithi164.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-14T10:53:00.243 INFO:teuthology.orchestra.run.smithi164.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-14T10:53:00.268 INFO:teuthology.orchestra.run.smithi164.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-14T10:53:00.274 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:00.274 INFO:teuthology.orchestra.run.smithi164.stdout:Total 9.6 MB/s | 31 MB 00:03 2024-09-14T10:53:00.428 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:00.467 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:00.468 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:00.966 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:00.967 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:01.257 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 37/37 2024-09-14T10:53:01.257 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/37 2024-09-14T10:53:01.257 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2/37 2024-09-14T10:53:01.257 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 3/37 2024-09-14T10:53:01.257 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 4/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 5/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9. 6/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T10:53:01.258 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T10:53:01.259 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T10:53:01.260 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T10:53:01.261 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T10:53:02.379 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:53:02.391 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:53:02.392 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:53:02.393 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:02.394 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:02.455 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-14T10:53:02.488 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-14T10:53:02.516 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-14T10:53:02.589 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-14T10:53:02.623 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-14T10:53:02.656 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-14T10:53:02.751 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-14T10:53:02.753 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base 2024-09-14T10:53:02.826 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-14T10:53:02.875 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-14T10:53:02.910 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-14T10:53:02.940 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-14T10:53:02.975 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-14T10:53:03.011 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-14T10:53:03.051 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-14T10:53:03.086 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-14T10:53:03.121 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-14T10:53:03.169 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-14T10:53:03.201 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-14T10:53:03.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-14T10:53:03.318 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:55 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:03.407 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:03.414 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-14T10:53:03.449 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:03.450 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:03.450 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:03.501 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-14T10:53:03.516 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install cephadm 2024-09-14T10:53:03.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-14T10:53:03.593 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-14T10:53:03.642 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-14T10:53:03.705 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-14T10:53:03.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-14T10:53:03.946 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-14T10:53:04.025 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-14T10:53:04.072 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:04.114 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-14T10:53:04.164 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-14T10:53:04.204 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:04.206 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:04.206 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:04.206 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:04.206 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:04.206 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:53:04.207 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:04.207 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:04.207 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:04.207 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:04.207 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:04.208 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 784 k 2024-09-14T10:53:04.208 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 791 k 2024-09-14T10:53:04.208 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:04.294 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-14T10:53:04.470 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9. 32/37 2024-09-14T10:53:04.498 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 33/37 2024-09-14T10:53:04.524 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 33/37 2024-09-14T10:53:04.524 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:04.524 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:53:04.524 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:53:04.525 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:53:04.525 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:04.553 INFO:teuthology.orchestra.run.smithi116.stdout:cephadm-19.3.0-4907.ga2782315.el9.noarch.rpm 2.2 MB/s | 784 kB 00:00 2024-09-14T10:53:04.554 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:04.554 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.2 MB/s | 784 kB 00:00 2024-09-14T10:53:04.555 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:04.560 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:04.560 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:04.566 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:04.566 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:04.635 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:05.049 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:05.157 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:05.508 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:05.746 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:05.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:05.747 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:05.747 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:05.747 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:05.747 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:05.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T10:53:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 34/37 2024-09-14T10:53:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 34/37 2024-09-14T10:53:06.010 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:06.010 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:53:06.010 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:53:06.010 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:53:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:06.458 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 35/37 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 35/37 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:53:06.482 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:06.531 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:58 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:06.665 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:06.666 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:06.666 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T10:53:06.666 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:06.666 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:06.666 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 145 k 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 432 k 2024-09-14T10:53:06.667 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:06.708 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 36/37 2024-09-14T10:53:06.732 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 36/37 2024-09-14T10:53:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:53:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:53:06.732 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:53:06.733 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:06.797 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 37/37 2024-09-14T10:53:06.910 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-19.3.0-4907.ga27823 598 kB/s | 145 kB 00:00 2024-09-14T10:53:06.910 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:06.910 INFO:teuthology.orchestra.run.smithi116.stdout:Total 593 kB/s | 145 kB 00:00 2024-09-14T10:53:06.911 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:06.919 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:06.919 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:06.975 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:06.976 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:07.119 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:07.203 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:07.228 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:07.228 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:07.228 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:53:07.229 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:08.177 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:08.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr 2024-09-14T10:53:08.595 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 37/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 3/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 4/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 5/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9. 6/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-14T10:53:08.596 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-14T10:53:08.597 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-14T10:53:08.598 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-14T10:53:08.598 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-14T10:53:08.598 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-14T10:53:08.599 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-14T10:53:08.991 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:00 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:09.083 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:09.125 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:09.126 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:09.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:53:09.530 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:53:09.531 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:53:09.532 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:09.533 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:09.777 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:01 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:09.855 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-base 2024-09-14T10:53:09.914 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-09-14T10:53:09.916 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:09.917 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 19 M 2024-09-14T10:53:09.917 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 159 M 2024-09-14T10:53:09.917 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:10.420 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:53 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:10.512 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:10.554 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:10.555 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:53:10.555 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:10.580 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4907.ga2 234 kB/s | 34 kB 00:00 2024-09-14T10:53:10.605 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4907.ga27 96 kB/s | 16 kB 00:00 2024-09-14T10:53:10.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install cephadm 2024-09-14T10:53:10.722 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-14T10:53:10.772 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-14T10:53:10.831 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-14T10:53:10.856 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-14T10:53:10.915 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-14T10:53:10.940 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-14T10:53:10.965 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-14T10:53:10.991 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-14T10:53:11.024 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.8 MB/s | 863 kB 00:00 2024-09-14T10:53:11.193 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:54 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:11.327 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:11.328 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:11.328 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:11.328 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:11.328 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 784 k 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 791 k 2024-09-14T10:53:11.329 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:11.366 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4907.ga27823 15 MB/s | 14 MB 00:00 2024-09-14T10:53:11.369 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:11.369 INFO:teuthology.orchestra.run.smithi116.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-14T10:53:11.418 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:11.437 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:11.437 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:11.585 INFO:teuthology.orchestra.run.smithi164.stdout:cephadm-19.3.0-4907.ga2782315.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-14T10:53:11.586 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:11.586 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-14T10:53:11.586 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:11.591 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:11.591 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:11.597 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:11.598 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:11.669 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:11.706 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:11.706 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:12.105 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:12.198 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:12.297 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:12.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T10:53:12.427 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T10:53:12.473 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T10:53:12.512 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T10:53:12.556 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:12.618 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T10:53:12.747 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:12.796 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:12.840 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T10:53:12.883 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T10:53:12.912 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T10:53:12.944 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9 10/12 2024-09-14T10:53:13.018 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-immutable-object-cache 2024-09-14T10:53:13.594 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:56 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:13.730 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:53:13.731 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:13.732 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 145 k 2024-09-14T10:53:13.732 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 432 k 2024-09-14T10:53:13.732 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:13.933 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-immutable-object-cache-19.3.0-4907.ga27823 719 kB/s | 145 kB 00:00 2024-09-14T10:53:13.933 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:13.934 INFO:teuthology.orchestra.run.smithi164.stdout:Total 714 kB/s | 145 kB 00:00 2024-09-14T10:53:13.934 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:13.941 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:13.941 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:14.000 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:14.000 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:14.147 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:14.209 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:14.234 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:14.234 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:14.234 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:53:14.234 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782315. 1/1 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:15.216 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:15.426 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr 2024-09-14T10:53:16.003 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:16.095 INFO:teuthology.orchestra.run.smithi164.stdout:Package ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:16.117 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el 11/12 2024-09-14T10:53:16.137 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:16.138 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:53:16.138 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:16.182 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 12/12 2024-09-14T10:53:16.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-dashboard 2024-09-14T10:53:16.774 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:00:59 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:16.907 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:53:16.909 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-09-14T10:53:16.910 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:16.911 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 19 M 2024-09-14T10:53:16.911 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 159 M 2024-09-14T10:53:16.911 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:17.595 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4907.ga2 97 kB/s | 34 kB 00:00 2024-09-14T10:53:17.620 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4907.ga27 43 kB/s | 16 kB 00:00 2024-09-14T10:53:18.045 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 633 kB/s | 269 kB 00:00 2024-09-14T10:53:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 12/12 2024-09-14T10:53:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el 1/12 2024-09-14T10:53:18.103 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 2/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9 3/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T10:53:18.104 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T10:53:18.221 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.8 MB/s | 863 kB 00:00 2024-09-14T10:53:18.271 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-14T10:53:18.296 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-14T10:53:18.355 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-14T10:53:18.405 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 19 MB/s | 2.0 MB 00:00 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:18.427 INFO:teuthology.orchestra.run.smithi116.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:18.428 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:18.430 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-14T10:53:18.456 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.4 MB/s | 144 kB 00:00 2024-09-14T10:53:18.481 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-14T10:53:18.677 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T10:53:19.238 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:11 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:19.373 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:19.374 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T10:53:19.374 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:53:19.375 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-09-14T10:53:19.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:19.377 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 38 M 2024-09-14T10:53:19.377 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 212 M 2024-09-14T10:53:19.377 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:19.689 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-14T10:53:19.739 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 667 kB/s | 33 kB 00:00 2024-09-14T10:53:19.806 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-14T10:53:19.856 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-14T10:53:19.907 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-14T10:53:20.806 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4907.ga27823 4.0 MB/s | 14 MB 00:03 2024-09-14T10:53:20.807 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.8 MB/s | 3.0 MB 00:01 2024-09-14T10:53:20.811 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:20.811 INFO:teuthology.orchestra.run.smithi164.stdout:Total 4.9 MB/s | 19 MB 00:03 2024-09-14T10:53:20.864 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:20.883 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:20.884 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:20.915 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-14T10:53:21.161 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:21.161 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:21.282 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 3.6 MB/s | 4.9 MB 00:01 2024-09-14T10:53:21.399 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-14T10:53:21.775 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:21.848 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-14T10:53:21.884 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-14T10:53:21.932 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-14T10:53:21.960 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-14T10:53:22.050 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): ceph-mgr-diskprediction-local-19.3.0-4 2.9 MB/s | 7.4 MB 00:02 2024-09-14T10:53:22.069 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-14T10:53:22.204 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-14T10:53:22.283 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.7 MB/s | 5.1 MB 00:01 2024-09-14T10:53:22.288 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-14T10:53:22.340 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-14T10:53:22.369 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-14T10:53:22.401 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9 10/12 2024-09-14T10:53:24.842 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.7 MB/s | 16 MB 00:03 2024-09-14T10:53:24.842 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:24.843 INFO:teuthology.orchestra.run.smithi116.stdout:Total 7.0 MB/s | 38 MB 00:05 2024-09-14T10:53:25.190 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:25.216 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:25.216 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:25.576 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el 11/12 2024-09-14T10:53:25.646 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:25.646 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:25.647 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 12/12 2024-09-14T10:53:26.399 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:26.486 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T10:53:26.531 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T10:53:26.633 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T10:53:26.666 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T10:53:26.849 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T10:53:26.890 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T10:53:26.965 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 12/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el 1/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noa 2/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9 3/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-14T10:53:27.561 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-14T10:53:27.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-14T10:53:27.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-14T10:53:27.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-14T10:53:27.562 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-14T10:53:27.617 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T10:53:27.743 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T10:53:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-14T10:53:27.880 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:27.880 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:53:27.881 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:53:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:53:27.882 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:27.882 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:28.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-14T10:53:28.701 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:11 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:28.836 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:53:28.837 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:53:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:======================================================================================= 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:Install 12 Packages 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 38 M 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 212 M 2024-09-14T10:53:28.839 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:28.973 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T10:53:29.164 INFO:teuthology.orchestra.run.smithi164.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-14T10:53:29.222 INFO:teuthology.orchestra.run.smithi164.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-14T10:53:29.239 INFO:teuthology.orchestra.run.smithi164.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-14T10:53:29.273 INFO:teuthology.orchestra.run.smithi164.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 546 kB/s | 18 kB 00:00 2024-09-14T10:53:29.307 INFO:teuthology.orchestra.run.smithi164.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 1.1 MB/s | 38 kB 00:00 2024-09-14T10:53:29.507 INFO:teuthology.orchestra.run.smithi164.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-49 15 MB/s | 7.4 MB 00:00 2024-09-14T10:53:29.624 INFO:teuthology.orchestra.run.smithi164.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-09-14T10:53:30.013 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T10:53:30.032 INFO:teuthology.orchestra.run.smithi164.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.7 MB/s | 3.0 MB 00:00 2024-09-14T10:53:30.039 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 12/12 2024-09-14T10:53:30.116 INFO:teuthology.orchestra.run.smithi164.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-14T10:53:30.591 INFO:teuthology.orchestra.run.smithi164.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.8 MB/s | 4.9 MB 00:01 2024-09-14T10:53:30.942 INFO:teuthology.orchestra.run.smithi164.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-14T10:53:32.579 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 12/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 1/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T10:53:32.580 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T10:53:32.581 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T10:53:32.581 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:53:33.032 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:33.033 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:33.415 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-rook 2024-09-14T10:53:33.995 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:25 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:34.129 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:34.130 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:34.130 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:34.130 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:34.130 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:34.130 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:53:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:Install 13 Packages 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.2 M 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 26 M 2024-09-14T10:53:34.132 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:34.225 INFO:teuthology.orchestra.run.smithi164.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:04 2024-09-14T10:53:34.226 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:34.226 INFO:teuthology.orchestra.run.smithi164.stdout:Total 7.1 MB/s | 38 MB 00:05 2024-09-14T10:53:34.521 INFO:teuthology.orchestra.run.smithi116.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 225 kB/s | 19 kB 00:00 2024-09-14T10:53:34.547 INFO:teuthology.orchestra.run.smithi116.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 232 kB/s | 26 kB 00:00 2024-09-14T10:53:34.585 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:34.605 INFO:teuthology.orchestra.run.smithi116.stdout:(3/13): ceph-mgr-rook-19.3.0-4907.ga2782315.el9 292 kB/s | 49 kB 00:00 2024-09-14T10:53:34.611 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:34.611 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:34.630 INFO:teuthology.orchestra.run.smithi116.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-14T10:53:34.656 INFO:teuthology.orchestra.run.smithi116.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-14T10:53:34.681 INFO:teuthology.orchestra.run.smithi116.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-14T10:53:34.723 INFO:teuthology.orchestra.run.smithi116.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-14T10:53:34.749 INFO:teuthology.orchestra.run.smithi116.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 210 kB/s | 14 kB 00:00 2024-09-14T10:53:34.773 INFO:teuthology.orchestra.run.smithi116.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-14T10:53:34.807 INFO:teuthology.orchestra.run.smithi116.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-14T10:53:34.833 INFO:teuthology.orchestra.run.smithi116.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.7 MB/s | 90 kB 00:00 2024-09-14T10:53:34.858 INFO:teuthology.orchestra.run.smithi116.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-14T10:53:34.891 INFO:teuthology.orchestra.run.smithi116.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-14T10:53:34.894 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:34.894 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-14T10:53:34.958 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:34.973 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:34.973 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:35.035 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:35.035 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:35.061 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:35.062 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:35.578 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:35.757 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T10:53:35.810 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:35.817 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T10:53:35.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T10:53:35.886 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-14T10:53:35.927 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T10:53:35.931 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-14T10:53:35.968 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T10:53:36.030 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-14T10:53:36.066 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-14T10:53:36.069 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T10:53:36.258 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-14T10:53:36.290 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-14T10:53:36.304 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T10:53:36.353 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T10:53:36.366 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-14T10:53:37.036 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-14T10:53:37.062 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T10:53:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T10:53:37.150 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T10:53:37.157 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-14T10:53:37.198 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T10:53:37.212 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 13/13 2024-09-14T10:53:37.838 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 13/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 1/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T10:53:37.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T10:53:37.840 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T10:53:38.198 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T10:53:38.198 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:38.198 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:38.198 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:38.199 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:38.428 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T10:53:38.450 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T10:53:39.017 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:31 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:39.151 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:39.151 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:53:39.152 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:39.153 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 7.0 M 2024-09-14T10:53:39.154 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 33 M 2024-09-14T10:53:39.154 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:39.476 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-14T10:53:39.510 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 12/12 2024-09-14T10:53:39.743 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-14T10:53:39.802 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-14T10:53:39.827 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-14T10:53:39.852 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-14T10:53:39.878 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4907.ga2782315.e 593 kB/s | 154 kB 00:00 2024-09-14T10:53:40.019 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-14T10:53:40.021 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:40.021 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.1 MB/s | 7.0 MB 00:00 2024-09-14T10:53:40.092 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:40.103 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:40.103 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:40.203 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:40.203 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:40.517 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:40.692 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T10:53:40.746 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T10:53:41.269 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T10:53:41.357 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T10:53:41.434 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T10:53:41.459 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 6/6 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 12/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782 1/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-14T10:53:42.169 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-14T10:53:42.170 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-14T10:53:42.170 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-14T10:53:42.271 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 6/6 2024-09-14T10:53:42.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/6 2024-09-14T10:53:42.271 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T10:53:42.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T10:53:42.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T10:53:42.272 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:53:42.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:42.541 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-14T10:53:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:42.551 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:42.551 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:42.552 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:42.792 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse 2024-09-14T10:53:42.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-rook 2024-09-14T10:53:43.353 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:35 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:43.484 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:53:43.485 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 980 k 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.9 M 2024-09-14T10:53:43.486 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:43.552 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:26 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:43.687 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:43.688 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:43.688 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:43.688 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:43.688 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:53:43.689 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:Install 13 Packages 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 2.2 M 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 26 M 2024-09-14T10:53:43.690 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:44.028 INFO:teuthology.orchestra.run.smithi164.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 240 kB/s | 19 kB 00:00 2024-09-14T10:53:44.029 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): ceph-fuse-19.3.0-4907.ga2782315.el9.x86_ 3.1 MB/s | 900 kB 00:00 2024-09-14T10:53:44.053 INFO:teuthology.orchestra.run.smithi164.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 244 kB/s | 26 kB 00:00 2024-09-14T10:53:44.112 INFO:teuthology.orchestra.run.smithi164.stdout:(3/13): ceph-mgr-rook-19.3.0-4907.ga2782315.el9 301 kB/s | 49 kB 00:00 2024-09-14T10:53:44.162 INFO:teuthology.orchestra.run.smithi164.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-14T10:53:44.187 INFO:teuthology.orchestra.run.smithi164.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-14T10:53:44.221 INFO:teuthology.orchestra.run.smithi164.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-14T10:53:44.254 INFO:teuthology.orchestra.run.smithi164.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-14T10:53:44.280 INFO:teuthology.orchestra.run.smithi164.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 247 kB/s | 14 kB 00:00 2024-09-14T10:53:44.305 INFO:teuthology.orchestra.run.smithi164.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-14T10:53:44.330 INFO:teuthology.orchestra.run.smithi164.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-14T10:53:44.364 INFO:teuthology.orchestra.run.smithi164.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-14T10:53:44.380 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-14T10:53:44.380 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:44.381 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.1 MB/s | 980 kB 00:00 2024-09-14T10:53:44.393 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:44.406 INFO:teuthology.orchestra.run.smithi164.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-14T10:53:44.415 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:44.415 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:44.431 INFO:teuthology.orchestra.run.smithi164.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 892 kB/s | 90 kB 00:00 2024-09-14T10:53:44.434 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:44.434 INFO:teuthology.orchestra.run.smithi164.stdout:Total 3.0 MB/s | 2.2 MB 00:00 2024-09-14T10:53:44.495 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:44.495 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:44.499 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:44.514 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:44.514 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:44.603 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:44.604 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:44.700 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:44.849 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T10:53:44.920 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2/2 2024-09-14T10:53:45.119 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:45.280 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-14T10:53:45.341 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-14T10:53:45.421 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-14T10:53:45.467 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-14T10:53:45.509 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-14T10:53:45.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-14T10:53:45.631 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2/2 2024-09-14T10:53:45.631 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/2 2024-09-14T10:53:45.729 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-14T10:53:45.785 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:45.896 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:46.157 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-volume 2024-09-14T10:53:46.504 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-14T10:53:46.549 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-14T10:53:46.583 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-14T10:53:46.631 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-14T10:53:46.661 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 13/13 2024-09-14T10:53:46.735 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:38 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:46.874 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 285 k 2024-09-14T10:53:46.875 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.3 M 2024-09-14T10:53:46.876 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:47.084 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-volume-19.3.0-4907.ga2782315.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-14T10:53:47.085 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:47.085 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-14T10:53:47.085 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:47.093 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:47.093 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:47.122 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:47.122 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:47.347 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:47.411 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:47.427 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:47.427 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:47.427 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:53:47.427 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:47.489 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 13/13 2024-09-14T10:53:47.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 1/13 2024-09-14T10:53:47.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-14T10:53:47.489 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-14T10:53:47.490 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-14T10:53:47.822 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-14T10:53:47.822 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:47.822 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:47.822 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:47.822 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:53:47.823 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:53:47.824 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:47.825 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:48.092 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-mgr-cephadm 2024-09-14T10:53:48.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:48.469 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:48.469 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:48.470 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:48.470 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:48.470 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:48.668 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:31 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:48.756 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel 2024-09-14T10:53:48.804 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:53:48.805 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout:Install 6 Packages 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 7.0 M 2024-09-14T10:53:48.806 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 33 M 2024-09-14T10:53:48.807 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:49.242 INFO:teuthology.orchestra.run.smithi164.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-14T10:53:49.335 INFO:teuthology.orchestra.run.smithi164.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-14T10:53:49.336 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:49.360 INFO:teuthology.orchestra.run.smithi164.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4907.ga2782315.e 554 kB/s | 154 kB 00:00 2024-09-14T10:53:49.402 INFO:teuthology.orchestra.run.smithi164.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 889 kB/s | 58 kB 00:00 2024-09-14T10:53:49.427 INFO:teuthology.orchestra.run.smithi164.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-14T10:53:49.452 INFO:teuthology.orchestra.run.smithi164.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.6 MB/s | 548 kB 00:00 2024-09-14T10:53:49.455 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:49.455 INFO:teuthology.orchestra.run.smithi164.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-14T10:53:49.475 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:49.475 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 127 k 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 456 k 2024-09-14T10:53:49.476 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:49.525 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:49.536 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:49.536 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:49.638 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:49.640 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:49.697 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-19.3.0-4907.ga2782315.el9.x86_64 574 kB/s | 127 kB 00:00 2024-09-14T10:53:49.698 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:49.698 INFO:teuthology.orchestra.run.smithi116.stdout:Total 569 kB/s | 127 kB 00:00 2024-09-14T10:53:49.699 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:49.704 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:49.704 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:49.770 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:49.770 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:49.926 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:49.950 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:50.030 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:50.111 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-14T10:53:50.163 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-14T10:53:50.490 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:50.680 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-14T10:53:50.762 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:50.762 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:50.762 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:50.762 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:50.763 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:50.763 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:50.774 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-14T10:53:50.843 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-14T10:53:50.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 6/6 2024-09-14T10:53:51.006 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2 2024-09-14T10:53:51.578 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 6/6 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 1/6 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-14T10:53:51.654 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-14T10:53:51.671 INFO:teuthology.orchestra.run.smithi116.stdout:Package libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:51.715 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:51.717 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:51.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs-devel 2024-09-14T10:53:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-14T10:53:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:51.935 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:51.935 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:51.936 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:52.228 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-fuse 2024-09-14T10:53:52.389 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:52.523 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:52.524 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:52.525 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:52.525 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:52.525 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 32 k 2024-09-14T10:53:52.525 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 142 k 2024-09-14T10:53:52.525 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:52.676 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs-devel-19.3.0-4907.ga2782315.el9.x86_6 210 kB/s | 32 kB 00:00 2024-09-14T10:53:52.677 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:52.677 INFO:teuthology.orchestra.run.smithi116.stdout:Total 207 kB/s | 32 kB 00:00 2024-09-14T10:53:52.677 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:52.681 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:52.681 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:52.700 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:52.700 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:52.790 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:52.797 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:35 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:52.891 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:52.930 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:52.931 INFO:teuthology.orchestra.run.smithi164.stdout:Install 2 Packages 2024-09-14T10:53:52.932 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:52.932 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 980 k 2024-09-14T10:53:52.932 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 2.9 M 2024-09-14T10:53:52.932 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:53.270 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:53.338 INFO:teuthology.orchestra.run.smithi164.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 630 kB/s | 80 kB 00:00 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:53.511 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:53.530 INFO:teuthology.orchestra.run.smithi164.stdout:(2/2): ceph-fuse-19.3.0-4907.ga2782315.el9.x86_ 2.8 MB/s | 900 kB 00:00 2024-09-14T10:53:53.530 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:53.531 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.6 MB/s | 980 kB 00:00 2024-09-14T10:53:53.542 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:53.565 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:53.565 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:53.645 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:53.646 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:53.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2 2024-09-14T10:53:53.834 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:53.973 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-14T10:53:54.045 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2/2 2024-09-14T10:53:54.249 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:54.338 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:54.382 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:54.383 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:54.383 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:54.457 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1 2024-09-14T10:53:54.759 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2/2 2024-09-14T10:53:54.760 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/2 2024-09-14T10:53:55.022 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:55.032 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:55.112 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:55.156 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:55.157 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:55.157 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:55.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados 2024-09-14T10:53:55.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-volume 2024-09-14T10:53:55.788 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:55.881 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:55.897 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:38 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:55.924 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:55.925 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:55.925 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:55.994 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw 2024-09-14T10:53:56.039 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:56.039 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:53:56.040 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:56.041 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 285 k 2024-09-14T10:53:56.041 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 1.3 M 2024-09-14T10:53:56.041 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:56.269 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-volume-19.3.0-4907.ga2782315.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-14T10:53:56.269 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:56.270 INFO:teuthology.orchestra.run.smithi164.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-14T10:53:56.270 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:56.278 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:56.278 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:56.309 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:56.309 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:56.532 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:56.560 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:56.621 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:56.638 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:56.639 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:56.639 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:53:56.639 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:56.652 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:56.695 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:56.696 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:56.696 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:56.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs 2024-09-14T10:53:57.328 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:57.418 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:57.461 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:57.462 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:57.462 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:57.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd 2024-09-14T10:53:57.686 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 1/1 2024-09-14T10:53:57.686 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:57.686 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:57.686 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:53:57.687 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:57.687 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:53:57.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados-devel 2024-09-14T10:53:58.095 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:58.186 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:53:58.229 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:58.229 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-09-14T10:53:58.229 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:53:58.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse 2024-09-14T10:53:58.557 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:41 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:53:58.695 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:53:58.695 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:58.695 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-14T10:53:58.695 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:58.695 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:53:58.696 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:58.697 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 127 k 2024-09-14T10:53:58.697 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 456 k 2024-09-14T10:53:58.697 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:53:58.851 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:53:58.909 INFO:teuthology.orchestra.run.smithi164.stdout:librados-devel-19.3.0-4907.ga2782315.el9.x86_64 597 kB/s | 127 kB 00:00 2024-09-14T10:53:58.909 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:58.910 INFO:teuthology.orchestra.run.smithi164.stdout:Total 592 kB/s | 127 kB 00:00 2024-09-14T10:53:58.910 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:53:58.915 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:53:58.916 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:53:58.981 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:53:58.981 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:53:58.985 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:58.986 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 85 k 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 231 k 2024-09-14T10:53:58.987 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:53:59.132 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:53:59.171 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-19.3.0-4907.ga2782315.el9.x86_64.rpm 464 kB/s | 85 kB 00:00 2024-09-14T10:53:59.171 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:59.171 INFO:teuthology.orchestra.run.smithi116.stdout:Total 461 kB/s | 85 kB 00:00 2024-09-14T10:53:59.172 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:53:59.178 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:53:59.178 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:53:59.243 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:53:59.243 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:53:59.248 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:59.401 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:53:59.510 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:59.691 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:59.885 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:59.965 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:53:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:59.966 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:53:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:53:59.966 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:53:59.966 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:00.144 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:00.145 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:00.145 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:54:00.145 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:00.145 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:00.145 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:54:00.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs2 2024-09-14T10:54:00.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror 2024-09-14T10:54:00.805 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:43 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:00.899 INFO:teuthology.orchestra.run.smithi164.stdout:Package libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:00.944 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:00.945 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:00.945 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:01.020 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install libcephfs-devel 2024-09-14T10:54:01.031 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:54:01.172 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 3.2 M 2024-09-14T10:54:01.173 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 14 M 2024-09-14T10:54:01.174 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:54:01.594 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:44 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:01.625 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-19.3.0-4907.ga2782315.el9.x86_64.rpm 7.1 MB/s | 3.2 MB 00:00 2024-09-14T10:54:01.625 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:01.626 INFO:teuthology.orchestra.run.smithi116.stdout:Total 7.0 MB/s | 3.2 MB 00:00 2024-09-14T10:54:01.626 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:54:01.635 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:54:01.635 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:54:01.717 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:54:01.717 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:54:01.728 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:01.729 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 32 k 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 142 k 2024-09-14T10:54:01.730 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:54:01.879 INFO:teuthology.orchestra.run.smithi164.stdout:libcephfs-devel-19.3.0-4907.ga2782315.el9.x86_6 213 kB/s | 32 kB 00:00 2024-09-14T10:54:01.880 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:01.881 INFO:teuthology.orchestra.run.smithi164.stdout:Total 211 kB/s | 32 kB 00:00 2024-09-14T10:54:01.881 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:54:01.883 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:54:01.884 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:54:01.946 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:54:01.947 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:54:02.038 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:54:02.150 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:02.158 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:54:02.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:02.236 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:02.237 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:02.237 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:54:02.237 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:02.237 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:02.237 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:02.511 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:02.750 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:02.750 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:02.750 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:54:02.750 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:02.751 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:02.751 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:02.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librados2 2024-09-14T10:54:03.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:03.310 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:54:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:03.310 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:03.310 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:54:03.521 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:46 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:03.548 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2024-09-14T10:54:03.613 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:03.658 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:03.659 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:03.659 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:03.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install librbd1 2024-09-14T10:54:04.126 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:56 ago on Sat 14 Sep 2024 10:52:08 AM UTC. 2024-09-14T10:54:04.259 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-09-14T10:54:04.260 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-09-14T10:54:04.261 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-09-14T10:54:04.261 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:04.261 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 171 k 2024-09-14T10:54:04.261 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 490 k 2024-09-14T10:54:04.261 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-09-14T10:54:04.285 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:47 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:04.377 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:04.421 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:04.422 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:04.422 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:04.491 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rados 2024-09-14T10:54:04.736 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-19.3.0-4907.ga2782315.el9.x86_64.rpm 359 kB/s | 171 kB 00:00 2024-09-14T10:54:04.737 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:04.737 INFO:teuthology.orchestra.run.smithi116.stdout:Total 358 kB/s | 171 kB 00:00 2024-09-14T10:54:04.737 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-09-14T10:54:04.746 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-09-14T10:54:04.746 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-09-14T10:54:04.810 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-09-14T10:54:04.810 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-09-14T10:54:04.967 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-09-14T10:54:05.058 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:05.075 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:05.149 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:05.193 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:05.194 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:05.194 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:05.258 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rgw 2024-09-14T10:54:05.513 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:05.775 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-09-14T10:54:05.824 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:48 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:05.915 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:05.959 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:05.960 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:05.960 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:05.973 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:06.024 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-cephfs 2024-09-14T10:54:06.593 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:49 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:06.683 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:06.726 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:06.727 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:06.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install python3-rbd 2024-09-14T10:54:07.362 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:50 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:07.454 INFO:teuthology.orchestra.run.smithi164.stdout:Package python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 is already installed. 2024-09-14T10:54:07.496 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:07.497 INFO:teuthology.orchestra.run.smithi164.stdout:Nothing to do. 2024-09-14T10:54:07.497 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:07.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-fuse 2024-09-14T10:54:08.141 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:51 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:08.276 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:08.276 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 85 k 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 231 k 2024-09-14T10:54:08.277 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:54:08.483 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-fuse-19.3.0-4907.ga2782315.el9.x86_64.rpm 415 kB/s | 85 kB 00:00 2024-09-14T10:54:08.483 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:08.484 INFO:teuthology.orchestra.run.smithi164.stdout:Total 412 kB/s | 85 kB 00:00 2024-09-14T10:54:08.484 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:54:08.491 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:54:08.491 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:54:08.555 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:54:08.555 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:54:08.709 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:54:08.805 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:09.200 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:09.449 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:09.450 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:09.450 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:54:09.450 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:09.450 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:09.450 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:09.734 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-mirror 2024-09-14T10:54:10.327 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:53 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:10.466 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:10.466 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:10.466 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repo Size 2024-09-14T10:54:10.466 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 3.2 M 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 14 M 2024-09-14T10:54:10.467 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:54:10.812 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-mirror-19.3.0-4907.ga2782315.el9.x86_64.rpm 9.3 MB/s | 3.2 MB 00:00 2024-09-14T10:54:10.812 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:10.813 INFO:teuthology.orchestra.run.smithi164.stdout:Total 9.2 MB/s | 3.2 MB 00:00 2024-09-14T10:54:10.813 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:54:10.822 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:54:10.822 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:54:10.904 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:54:10.904 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:54:11.346 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:54:11.429 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:11.454 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:11.454 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:11.455 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:54:11.455 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:11.455 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:11.455 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:12.546 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:12.547 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:12.547 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:54:12.547 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:12.547 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:12.547 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:12.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install rbd-nbd 2024-09-14T10:54:13.361 INFO:teuthology.orchestra.run.smithi164.stdout:Last metadata expiration check: 0:01:56 ago on Sat 14 Sep 2024 10:52:17 AM UTC. 2024-09-14T10:54:13.496 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout: Package Architecture Version Repository Size 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:13.497 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout:Install 1 Package 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 171 k 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout:Installed size: 490 k 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-09-14T10:54:13.708 INFO:teuthology.orchestra.run.smithi164.stdout:rbd-nbd-19.3.0-4907.ga2782315.el9.x86_64.rpm 815 kB/s | 171 kB 00:00 2024-09-14T10:54:13.709 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:54:13.709 INFO:teuthology.orchestra.run.smithi164.stdout:Total 809 kB/s | 171 kB 00:00 2024-09-14T10:54:13.709 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-09-14T10:54:13.716 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-09-14T10:54:13.716 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-09-14T10:54:13.780 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-09-14T10:54:13.780 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-09-14T10:54:13.943 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-09-14T10:54:14.047 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:14.526 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:14.773 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 1/1 2024-09-14T10:54:14.774 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:14.774 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-09-14T10:54:14.774 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:14.774 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:14.774 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-09-14T10:54:15.079 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:15.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:54:15.234 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:54:15.260 INFO:teuthology.orchestra.run.smithi116.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:54:15.260 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:54:15.261 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:54:15.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:54:15.407 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:54:15.429 INFO:teuthology.orchestra.run.smithi164.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:54:15.429 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:54:15.429 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:54:15.431 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:54:15.432 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:15.432 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:54:15.463 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:15.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:54:15.494 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:54:15.495 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:15.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:54:15.532 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:54:15.600 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:15.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:54:15.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:54:15.690 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:54:15.690 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:15.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:54:15.717 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:54:15.784 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:15.785 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:54:15.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:54:15.874 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:54:15.874 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:15.875 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:54:15.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:54:15.969 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:15.969 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:54:15.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:54:16.058 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:54:16.144 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:54:16.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-09-14T10:54:16.147 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-09-14T10:54:16.173 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:54:16.173 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:54:16.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:54:16.240 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:54:16.240 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:54:16.281 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:54:16.313 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:54:16.313 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:54:16.314 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140', 'branch': 'main', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904140', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLs2Ri/OsFMAUDqtx5HxUxeTbcSATbP3onKqKoz7/HcZuIymDG0DvygA8GKlK6OXa8gBm6GHC/2UbDJ1fm1bYig=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFtmaOZBlZhAfeDMyEYuuP/gr9nvLwkV4Fj5r9LzeVEgQRTyve+23PDZ6CiuNYE4M4Au47GBSMeiu8uqUkY+jvU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:54:16.315 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:54:16.348 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:54:16.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:54:16.404 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:54:16.429 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:16.429 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:54:16.484 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:54:16.484 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 10:54:02.501994297 +0000 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 10:51:28.953685222 +0000 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 10:51:28.953685222 +0000 2024-09-14T10:54:16.540 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 10:51:28.953685222 +0000 2024-09-14T10:54:16.541 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:54:16.603 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T10:54:16.604 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T10:54:16.604 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000192822 s, 2.7 MB/s 2024-09-14T10:54:16.605 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:54:16.661 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 10:54:02.501994297 +0000 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 10:51:29.277679966 +0000 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 10:51:29.277679966 +0000 2024-09-14T10:54:16.717 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 10:51:29.277679966 +0000 2024-09-14T10:54:16.718 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:54:16.779 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T10:54:16.779 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T10:54:16.780 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000190363 s, 2.7 MB/s 2024-09-14T10:54:16.781 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:54:16.837 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 10:54:02.501994297 +0000 2024-09-14T10:54:16.892 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 10:51:29.599674744 +0000 2024-09-14T10:54:16.893 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 10:51:29.599674744 +0000 2024-09-14T10:54:16.893 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 10:51:29.599674744 +0000 2024-09-14T10:54:16.893 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:54:16.955 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T10:54:16.956 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T10:54:16.956 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000204916 s, 2.5 MB/s 2024-09-14T10:54:16.958 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:54:17.015 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-09-14 10:54:02.501994297 +0000 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-09-14 10:51:29.911669684 +0000 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-09-14 10:51:29.911669684 +0000 2024-09-14T10:54:17.070 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-09-14 10:51:29.911669684 +0000 2024-09-14T10:54:17.071 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:54:17.133 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-09-14T10:54:17.133 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-09-14T10:54:17.133 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000188308 s, 2.7 MB/s 2024-09-14T10:54:17.134 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:54:17.193 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-14T10:54:17.193 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:17.193 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:54:17.211 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:54:17.211 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 10:54:11.697365668 +0000 2024-09-14T10:54:17.268 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 10:51:31.395755743 +0000 2024-09-14T10:54:17.269 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 10:51:31.395755743 +0000 2024-09-14T10:54:17.269 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 10:51:31.395755743 +0000 2024-09-14T10:54:17.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:54:17.333 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T10:54:17.333 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T10:54:17.333 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000273947 s, 1.9 MB/s 2024-09-14T10:54:17.334 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:54:17.392 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 10:54:11.697365668 +0000 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 10:51:31.716750348 +0000 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 10:51:31.716750348 +0000 2024-09-14T10:54:17.449 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 10:51:31.716750348 +0000 2024-09-14T10:54:17.450 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:54:17.513 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T10:54:17.513 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T10:54:17.513 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000195493 s, 2.6 MB/s 2024-09-14T10:54:17.514 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:54:17.571 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 10:54:11.697365668 +0000 2024-09-14T10:54:17.627 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 10:51:32.048744767 +0000 2024-09-14T10:54:17.628 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 10:51:32.048744767 +0000 2024-09-14T10:54:17.628 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 10:51:32.048744767 +0000 2024-09-14T10:54:17.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:54:17.691 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T10:54:17.692 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T10:54:17.692 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000209891 s, 2.4 MB/s 2024-09-14T10:54:17.693 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:54:17.749 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:17.805 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-09-14 10:54:11.698365651 +0000 2024-09-14T10:54:17.808 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-09-14 10:51:32.369739372 +0000 2024-09-14T10:54:17.808 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-09-14 10:51:32.369739372 +0000 2024-09-14T10:54:17.808 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-09-14 10:51:32.369739372 +0000 2024-09-14T10:54:17.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:54:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-09-14T10:54:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-09-14T10:54:17.867 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000183238 s, 2.8 MB/s 2024-09-14T10:54:17.869 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:54:17.924 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:54:17.925 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-14T10:54:17.925 INFO:tasks.ceph:Generating config... 2024-09-14T10:54:17.926 INFO:tasks.ceph:[client] debug ms = 1 2024-09-14T10:54:17.926 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-14T10:54:17.926 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:54:17.926 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:54:17.926 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:54:17.926 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:54:17.926 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:54:17.926 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:54:17.926 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:54:17.926 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:54:17.927 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:54:17.927 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:54:17.927 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:54:17.927 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:54:17.928 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:54:17.928 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:54:17.928 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:54:17.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:54:17.987 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:54:17.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:54:18.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:18.100 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116')] 2024-09-14T10:54:18.101 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-14T10:54:18.102 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:18.102 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:54:18.156 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:18.236 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:18.236 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:18.236 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid 7b7ae84a-db16-40d6-b8d8-00c489fcd057 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = quincy 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:fsid 7b7ae84a-db16-40d6-b8d8-00c489fcd057 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2024-09-14T10:54:18.239795+0000 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-09-14T10:54:18.239795+0000 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 17 (quincy) 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-09-14T10:54:18.237 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-14T10:54:18.238 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:54:18.294 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7b7ae84a-db16-40d6-b8d8-00c489fcd057... 2024-09-14T10:54:18.294 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:54:18.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-09-14T10:54:18.376 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-09-14T10:54:18.377 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:54:18.378 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = 172.21.15.116 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 7b7ae84a-db16-40d6-b8d8-00c489fcd057 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.379 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.380 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-09-14T10:54:18.381 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug objclass = 20 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1/20 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1/20 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 4/10 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-09-14T10:54:18.382 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-09-14T10:54:18.383 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:54:18.384 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-09-14T10:54:18.385 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: rgw gc obj min wait = 15 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: debug rgw = 20 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: setgroup = ceph 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout: setuser = ceph 2024-09-14T10:54:18.386 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-09-14T10:54:18.387 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-09-14T10:54:18.388 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.389 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = 172.21.15.116 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 7b7ae84a-db16-40d6-b8d8-00c489fcd057 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:54:18.390 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug trim objects = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.391 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: debug objclass = 20 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2024-09-14T10:54:18.392 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-09-14T10:54:18.393 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-09-14T10:54:18.394 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.395 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: rgw gc obj min wait = 15 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: debug rgw = 20 2024-09-14T10:54:18.396 INFO:teuthology.orchestra.run.smithi164.stdout: setgroup = ceph 2024-09-14T10:54:18.397 INFO:teuthology.orchestra.run.smithi164.stdout: setuser = ceph 2024-09-14T10:54:18.397 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-09-14T10:54:18.398 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:54:18.398 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:54:18.492 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:54:18.492 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:18.492 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:54:18.507 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:18.507 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:54:18.562 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T10:54:18.563 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:18.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:54:18.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:18.637 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:18.637 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:18.693 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T10:54:18.693 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:18.693 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:54:18.693 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:18.728 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:18.729 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:18.784 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:54:18.784 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:54:18.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:54:18.888 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:54:18.890 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:54:18.890 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:54:18.890 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:54:18.931 INFO:teuthology.orchestra.run.smithi164.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:54:18.944 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:54:18.944 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-14T10:54:18.944 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:18.969 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-14T10:54:18.970 INFO:tasks.ceph:role: osd.0 2024-09-14T10:54:18.970 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T10:54:18.970 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:54:19.042 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:19.043 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:19.517 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-09-14T10:54:19.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-09-14T10:54:19.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:19.620 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:19.654 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:19.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:19.754+0000 7fe95ca0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:54:19.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:19.758+0000 7fe95ca0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:54:19.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:19.758+0000 7fe95ca0d640 -1 bdev(0x565378e11800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:54:19.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:19.758+0000 7fe95ca0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:54:22.947 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:22.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:23.007 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:54:23.007 INFO:tasks.ceph:role: osd.1 2024-09-14T10:54:23.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T10:54:23.008 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:23.084 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:23.576 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T10:54:23.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T10:54:23.579 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:23.703 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:23.741 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:23.808 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:54:23.809 INFO:tasks.ceph:role: osd.2 2024-09-14T10:54:23.809 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T10:54:23.809 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:54:23.882 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:23.883 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:24.340 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T10:54:24.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T10:54:24.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:24.427 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:24.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:24.561 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-14T10:54:24.561 INFO:tasks.ceph:role: osd.3 2024-09-14T10:54:24.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T10:54:24.561 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:24.633 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:25.120 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2024-09-14T10:54:25.122 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-09-14T10:54:25.122 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:25.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:25.273 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:25.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:25.371+0000 7f2aaffb2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:54:25.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:25.374+0000 7f2aaffb2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:54:25.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:25.375+0000 7f2aaffb2640 -1 bdev(0x556094759800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:54:25.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:25.375+0000 7f2aaffb2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:54:28.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:28.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:28.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:28.403+0000 7fbb10c2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:54:28.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:28.403+0000 7fbb10c2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:54:28.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:28.403+0000 7fbb10c2e640 -1 bdev(0x561bdb05b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:54:28.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:28.403+0000 7fbb10c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:54:31.312 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:31.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:31.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:31.434+0000 7f137a215640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:54:31.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:31.434+0000 7f137a215640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:54:31.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:31.434+0000 7f137a215640 -1 bdev(0x55ba201a9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:54:31.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:31.434+0000 7f137a215640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:54:34.588 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:34.617 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:54:34.617 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:34.617 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:54:34.648 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:34.648 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:54:34.685 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:34.685 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:54:34.750 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:34.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:54:34.816 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:34.816 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:54:34.882 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:34.882 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:54:34.938 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:54:34.938 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBba+VmBskCLRAAadxAIqjM7BdYA56rxmowfQ== 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBaa+Vm1s4aNRAAY6Q5ejL3c6C6ZxRO/VS2GA== 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBha+VmvpYtFhAAHp4cnx+0QkaluH3DMiLyaw== 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBka+VmSIkZGBAAbhVC5Bwnzgekqlnt0wxKIA== 2024-09-14T10:54:34.966 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-09-14T10:54:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBna+VmhOjtGRAAZSJgtWTBF3q7j4ifZGsMNg== 2024-09-14T10:54:34.967 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-09-14T10:54:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBaa+Vmz3q5NxAAXgDcOySRR+hRZYTX+cKKkw== 2024-09-14T10:54:34.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:54:35.066 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:54:35.119 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:54:35.171 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:54:35.221 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:54:35.272 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:54:35.325 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:54:35.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:54:35.350 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:54:35.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:54:35.470 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:35.527 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:54:35.527 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:54:35.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:54:35.569 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:54:35.569 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:54:35.569 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:54:35.570 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:54:35.572 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:54:35.572 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:54:35.572 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:54:35.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:54:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.672+0000 7f8ee2879640 1 Processor -- start 2024-09-14T10:54:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.672+0000 7f8ee2879640 1 -- start start 2024-09-14T10:54:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8ee2879640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8edc130360 0x7f8edc132750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8ee2879640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8edc072610 con 0x7f8edc099400 2024-09-14T10:54:35.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8ee2879640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f8edc09bca0 con 0x7f8edc130360 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edb7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8edc130360 0x7f8edc132750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edbfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8edc099400 0x7f8edc0997e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35802/0 (socket says 172.21.15.116:35802) 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edbfff640 1 -- 172.21.15.116:0/1239083890 learned_addr learned my addr 172.21.15.116:0/1239083890 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edb7fe640 1 --2- 172.21.15.116:0/1239083890 >> v2:172.21.15.116:3300/0 conn(0x7f8edc130360 0x7f8edc132750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51032/0 (socket says 172.21.15.116:51032) 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edb7fe640 1 -- 172.21.15.116:0/1239083890 >> v1:172.21.15.116:6789/0 conn(0x7f8edc099400 legacy=0x7f8edc0997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:35.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.673+0000 7f8edb7fe640 1 -- 172.21.15.116:0/1239083890 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc099ef0 con 0x7f8edc130360 2024-09-14T10:54:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8edb7fe640 1 --2- 172.21.15.116:0/1239083890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc130360 0x7f8edc132750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009720 tx=0x7f8ed002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88281623deece7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:35.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8edaffd640 1 -- 172.21.15.116:0/1239083890 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed0037070 con 0x7f8edc130360 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8edaffd640 1 -- 172.21.15.116:0/1239083890 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed0032440 con 0x7f8edc130360 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8edaffd640 1 -- 172.21.15.116:0/1239083890 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ed0032740 con 0x7f8edc130360 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8ee2879640 1 -- 172.21.15.116:0/1239083890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc130360 msgr2=0x7f8edc132750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.675+0000 7f8ee2879640 1 --2- 172.21.15.116:0/1239083890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc130360 0x7f8edc132750 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009720 tx=0x7f8ed002a230 comp rx=0 tx=0).stop 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 -- 172.21.15.116:0/1239083890 shutdown_connections 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 --2- 172.21.15.116:0/1239083890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc130360 0x7f8edc132750 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 -- 172.21.15.116:0/1239083890 >> 172.21.15.116:0/1239083890 conn(0x7f8edc09ca40 msgr2=0x7f8edc09ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 -- 172.21.15.116:0/1239083890 shutdown_connections 2024-09-14T10:54:35.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 -- 172.21.15.116:0/1239083890 wait complete. 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.676+0000 7f8ee2879640 1 Processor -- start 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8ee2879640 1 -- start start 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8ee2879640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8ee2879640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc132c90 con 0x7f8edc099400 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:35.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8edbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51036/0 (socket says 172.21.15.116:51036) 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8edbfff640 1 -- 172.21.15.116:0/2998946270 learned_addr learned my addr 172.21.15.116:0/2998946270 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8edbfff640 1 -- 172.21.15.116:0/2998946270 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc126ea0 con 0x7f8edc099400 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8edbfff640 1 --2- 172.21.15.116:0/2998946270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc001eb0 tx=0x7f8ecc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.677+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ecc017070 con 0x7f8edc099400 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005c10 con 0x7f8edc099400 2024-09-14T10:54:35.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc127bd0 con 0x7f8edc099400 2024-09-14T10:54:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ecc0070d0 con 0x7f8edc099400 2024-09-14T10:54:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc12ccc0 con 0x7f8edc099400 2024-09-14T10:54:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ecc01a070 con 0x7f8edc099400 2024-09-14T10:54:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ecc012400 con 0x7f8edc099400 2024-09-14T10:54:35.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.678+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc0997e0 con 0x7f8edc099400 2024-09-14T10:54:35.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.681+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8ecc021020 con 0x7f8edc099400 2024-09-14T10:54:35.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.742+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8edc050ee0 con 0x7f8edc099400 2024-09-14T10:54:35.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.743+0000 7f8ed8ff9640 1 -- 172.21.15.116:0/2998946270 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8edc072610 con 0x7f8edc099400 2024-09-14T10:54:35.741 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 msgr2=0x7f8edc098460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 --2- 172.21.15.116:0/2998946270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc001eb0 tx=0x7f8ecc00c810 comp rx=0 tx=0).stop 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 shutdown_connections 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 --2- 172.21.15.116:0/2998946270 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8edc099400 0x7f8edc098460 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 >> 172.21.15.116:0/2998946270 conn(0x7f8edc09ca40 msgr2=0x7f8edc12e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 shutdown_connections 2024-09-14T10:54:35.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:35.744+0000 7f8ee2879640 1 -- 172.21.15.116:0/2998946270 wait complete. 2024-09-14T10:54:35.752 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:54:35.752 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:54:35.752 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-09-14T10:54:35.752 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:54:35.777 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:35.777 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:54:35.802 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:35.802 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:54:35.867 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-09-14T10:54:35.867 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:54:35.933 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new d968f5c3-c7f1-4e12-8531-2194aa167d4c 0 2024-09-14T10:54:36.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.073+0000 7f3a29b2b640 1 Processor -- start 2024-09-14T10:54:36.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.073+0000 7f3a29b2b640 1 -- start start 2024-09-14T10:54:36.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a29b2b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3a24110070 0x7f3a24110470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a29b2b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a24110b30 con 0x7f3a24115670 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a29b2b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f3a24116230 con 0x7f3a24110070 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a237fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3a24110070 0x7f3a24110470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a237fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3a24110070 0x7f3a24110470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36170/0 (socket says 172.21.15.164:36170) 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a237fe640 1 -- 172.21.15.164:0/1706785819 learned_addr learned my addr 172.21.15.164:0/1706785819 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a1affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3a24115670 0x7f3a24115b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:44458/0 (socket says 172.21.15.164:44458) 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a22ffd640 1 -- 172.21.15.164:0/1706785819 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410967356 0 0) 0x7f3a24110b30 con 0x7f3a24115670 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a22ffd640 1 -- 172.21.15.164:0/1706785819 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a10003520 con 0x7f3a24115670 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a237fe640 1 -- 172.21.15.164:0/1706785819 >> v1:172.21.15.116:6789/0 conn(0x7f3a24115670 legacy=0x7f3a24115b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.074+0000 7f3a237fe640 1 -- 172.21.15.164:0/1706785819 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241163e0 con 0x7f3a24110070 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.075+0000 7f3a237fe640 1 --2- 172.21.15.164:0/1706785819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a24110470 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097f0 tx=0x7f3a1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f702c1b1cff44c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.075+0000 7f3a22ffd640 1 -- 172.21.15.164:0/1706785819 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14037070 con 0x7f3a24110070 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.075+0000 7f3a22ffd640 1 -- 172.21.15.164:0/1706785819 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14032440 con 0x7f3a24110070 2024-09-14T10:54:36.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.075+0000 7f3a22ffd640 1 -- 172.21.15.164:0/1706785819 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a1402ae60 con 0x7f3a24110070 2024-09-14T10:54:36.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 -- 172.21.15.164:0/1706785819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 msgr2=0x7f3a24110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 --2- 172.21.15.164:0/1706785819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a24110470 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097f0 tx=0x7f3a1402a1e0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 -- 172.21.15.164:0/1706785819 shutdown_connections 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 --2- 172.21.15.164:0/1706785819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a24110470 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 -- 172.21.15.164:0/1706785819 >> 172.21.15.164:0/1706785819 conn(0x7f3a240710d0 msgr2=0x7f3a240734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 -- 172.21.15.164:0/1706785819 shutdown_connections 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 -- 172.21.15.164:0/1706785819 wait complete. 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.076+0000 7f3a29b2b640 1 Processor -- start 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a29b2b640 1 -- start start 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a29b2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a29b2b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2406d7f0 con 0x7f3a24110070 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36184/0 (socket says 172.21.15.164:36184) 2024-09-14T10:54:36.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a237fe640 1 -- 172.21.15.164:0/2420977391 learned_addr learned my addr 172.21.15.164:0/2420977391 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.077+0000 7f3a237fe640 1 -- 172.21.15.164:0/2420977391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241a7c80 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a237fe640 1 --2- 172.21.15.164:0/2420977391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097f0 tx=0x7f3a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14041070 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1403c670 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a14037040 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a241a7f70 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241ad140 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a14044070 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.078+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3a14046c40 con 0x7f3a24110070 2024-09-14T10:54:36.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.079+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a241a82b0 con 0x7f3a24110070 2024-09-14T10:54:36.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.081+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3a14046450 con 0x7f3a24110070 2024-09-14T10:54:36.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.150+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d968f5c3-c7f1-4e12-8531-2194aa167d4c", "id": 0} v 0) -- 0x7f3a24110470 con 0x7f3a24110070 2024-09-14T10:54:36.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.151+0000 7f3a20ff9640 1 -- 172.21.15.164:0/2420977391 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d968f5c3-c7f1-4e12-8531-2194aa167d4c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3a1403c990 con 0x7f3a24110070 2024-09-14T10:54:36.150 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-09-14T10:54:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 msgr2=0x7f3a241a76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 --2- 172.21.15.164:0/2420977391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3a140097f0 tx=0x7f3a140046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 shutdown_connections 2024-09-14T10:54:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 --2- 172.21.15.164:0/2420977391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3a24110070 0x7f3a241a76b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 >> 172.21.15.164:0/2420977391 conn(0x7f3a240710d0 msgr2=0x7f3a240734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 shutdown_connections 2024-09-14T10:54:36.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.152+0000 7f3a29b2b640 1 -- 172.21.15.164:0/2420977391 wait complete. 2024-09-14T10:54:36.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 6dc56737-f3c6-4bcc-ab17-1b5b8ace4592 1 2024-09-14T10:54:36.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.260+0000 7fc66816b640 1 Processor -- start 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc66816b640 1 -- start start 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc66816b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc6601104b0 0x7fc66011c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc66816b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6601109a0 con 0x7fc660074e80 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc66816b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fc660110b70 con 0x7fc6601104b0 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc665706640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc6601104b0 0x7fc66011c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc665f07640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc660074e80 0x7fc66010fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:44472/0 (socket says 172.21.15.164:44472) 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc665f07640 1 -- 172.21.15.164:0/2124711026 learned_addr learned my addr 172.21.15.164:0/2124711026 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc665706640 1 -- 172.21.15.164:0/2124711026 >> v1:172.21.15.116:6789/0 conn(0x7fc660074e80 legacy=0x7fc66010fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc665706640 1 -- 172.21.15.164:0/2124711026 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66011d680 con 0x7fc6601104b0 2024-09-14T10:54:36.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.261+0000 7fc664f05640 1 -- 172.21.15.164:0/2124711026 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710720648 0 0) 0x7fc6601109a0 con 0x7fc660074e80 2024-09-14T10:54:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.262+0000 7fc665706640 1 --2- 172.21.15.164:0/2124711026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6601104b0 0x7fc66011c130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc650009720 tx=0x7fc65002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d2071ee65ebd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.262+0000 7fc664f05640 1 -- 172.21.15.164:0/2124711026 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc650037070 con 0x7fc6601104b0 2024-09-14T10:54:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.262+0000 7fc664f05640 1 -- 172.21.15.164:0/2124711026 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65002ad90 con 0x7fc6601104b0 2024-09-14T10:54:36.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.262+0000 7fc664f05640 1 -- 172.21.15.164:0/2124711026 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc650032590 con 0x7fc6601104b0 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 -- 172.21.15.164:0/2124711026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6601104b0 msgr2=0x7fc66011c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 --2- 172.21.15.164:0/2124711026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6601104b0 0x7fc66011c130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc650009720 tx=0x7fc65002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 -- 172.21.15.164:0/2124711026 shutdown_connections 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 --2- 172.21.15.164:0/2124711026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6601104b0 0x7fc66011c130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 -- 172.21.15.164:0/2124711026 >> 172.21.15.164:0/2124711026 conn(0x7fc660070580 msgr2=0x7fc6600729a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 -- 172.21.15.164:0/2124711026 shutdown_connections 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.263+0000 7fc66816b640 1 -- 172.21.15.164:0/2124711026 wait complete. 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc66816b640 1 Processor -- start 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc66816b640 1 -- start start 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc66816b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc66816b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc66011cb20 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc665f07640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc665f07640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36194/0 (socket says 172.21.15.164:36194) 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc665f07640 1 -- 172.21.15.164:0/3996164224 learned_addr learned my addr 172.21.15.164:0/3996164224 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.264+0000 7fc665f07640 1 -- 172.21.15.164:0/3996164224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6601a7e30 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc665f07640 1 --2- 172.21.15.164:0/3996164224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c3d0 tx=0x7fc65c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc65c0074d0 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc65c0047e0 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc65c007670 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6601a8120 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6601ad270 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc65c011070 con 0x7fc660074e80 2024-09-14T10:54:36.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.265+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc65c013770 con 0x7fc660074e80 2024-09-14T10:54:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.266+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6601a8460 con 0x7fc660074e80 2024-09-14T10:54:36.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.268+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc65c013a10 con 0x7fc660074e80 2024-09-14T10:54:36.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.338+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6dc56737-f3c6-4bcc-ab17-1b5b8ace4592", "id": 1} v 0) -- 0x7fc66011d120 con 0x7fc660074e80 2024-09-14T10:54:36.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.339+0000 7fc6567fc640 1 -- 172.21.15.164:0/3996164224 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6dc56737-f3c6-4bcc-ab17-1b5b8ace4592", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc65c013bf0 con 0x7fc660074e80 2024-09-14T10:54:36.338 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-09-14T10:54:36.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 msgr2=0x7fc6601a7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 --2- 172.21.15.164:0/3996164224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00c3d0 tx=0x7fc65c00c890 comp rx=0 tx=0).stop 2024-09-14T10:54:36.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 shutdown_connections 2024-09-14T10:54:36.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 --2- 172.21.15.164:0/3996164224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc660074e80 0x7fc6601a7860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 >> 172.21.15.164:0/3996164224 conn(0x7fc660070580 msgr2=0x7fc6601118b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 shutdown_connections 2024-09-14T10:54:36.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.340+0000 7fc66816b640 1 -- 172.21.15.164:0/3996164224 wait complete. 2024-09-14T10:54:36.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new be1f280b-51cf-499b-9163-01191ffe1ed5 2 2024-09-14T10:54:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.447+0000 7fdf666b8640 1 Processor -- start 2024-09-14T10:54:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.447+0000 7fdf666b8640 1 -- start start 2024-09-14T10:54:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf666b8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdf60116b50 0x7fdf60116f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf666b8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf60117650 con 0x7fdf60112dc0 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf666b8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fdf60113960 con 0x7fdf60116b50 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdf60116b50 0x7fdf60116f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5f7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdf60112dc0 0x7fdf60113250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:44480/0 (socket says 172.21.15.164:44480) 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5f7fe640 1 -- 172.21.15.164:0/495933530 learned_addr learned my addr 172.21.15.164:0/495933530 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5ffff640 1 -- 172.21.15.164:0/495933530 >> v1:172.21.15.116:6789/0 conn(0x7fdf60112dc0 legacy=0x7fdf60113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5ffff640 1 -- 172.21.15.164:0/495933530 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf60113b10 con 0x7fdf60116b50 2024-09-14T10:54:36.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.448+0000 7fdf5effd640 1 -- 172.21.15.164:0/495933530 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886347850 0 0) 0x7fdf60117650 con 0x7fdf60112dc0 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.449+0000 7fdf5ffff640 1 --2- 172.21.15.164:0/495933530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60116b50 0x7fdf60116f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009720 tx=0x7fdf5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d33b11f249513af server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.449+0000 7fdf5effd640 1 -- 172.21.15.164:0/495933530 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf50037070 con 0x7fdf60116b50 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.449+0000 7fdf5effd640 1 -- 172.21.15.164:0/495933530 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf5002ad90 con 0x7fdf60116b50 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.449+0000 7fdf5effd640 1 -- 172.21.15.164:0/495933530 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf50032590 con 0x7fdf60116b50 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 -- 172.21.15.164:0/495933530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60116b50 msgr2=0x7fdf60116f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 --2- 172.21.15.164:0/495933530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60116b50 0x7fdf60116f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009720 tx=0x7fdf5002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 -- 172.21.15.164:0/495933530 shutdown_connections 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 --2- 172.21.15.164:0/495933530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60116b50 0x7fdf60116f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 -- 172.21.15.164:0/495933530 >> 172.21.15.164:0/495933530 conn(0x7fdf6006f730 msgr2=0x7fdf6006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 -- 172.21.15.164:0/495933530 shutdown_connections 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.450+0000 7fdf666b8640 1 -- 172.21.15.164:0/495933530 wait complete. 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf666b8640 1 Processor -- start 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf666b8640 1 -- start start 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf666b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf666b8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6011efa0 con 0x7fdf60112dc0 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf5ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36216/0 (socket says 172.21.15.164:36216) 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf5ffff640 1 -- 172.21.15.164:0/883285019 learned_addr learned my addr 172.21.15.164:0/883285019 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:54:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.451+0000 7fdf5ffff640 1 -- 172.21.15.164:0/883285019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601a7cb0 con 0x7fdf60112dc0 2024-09-14T10:54:36.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5ffff640 1 --2- 172.21.15.164:0/883285019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009840 tx=0x7fdf500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf50041070 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf5003c460 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf601a7f40 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf50037040 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601acf10 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdf50044070 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.452+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdf50046b30 con 0x7fdf60112dc0 2024-09-14T10:54:36.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.453+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60116b50 con 0x7fdf60112dc0 2024-09-14T10:54:36.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.455+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdf50046920 con 0x7fdf60112dc0 2024-09-14T10:54:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.547+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be1f280b-51cf-499b-9163-01191ffe1ed5", "id": 2} v 0) -- 0x7fdf60116d20 con 0x7fdf60112dc0 2024-09-14T10:54:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.548+0000 7fdf5cff9640 1 -- 172.21.15.164:0/883285019 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be1f280b-51cf-499b-9163-01191ffe1ed5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdf50046dd0 con 0x7fdf60112dc0 2024-09-14T10:54:36.547 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-09-14T10:54:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 msgr2=0x7fdf601a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 --2- 172.21.15.164:0/883285019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009840 tx=0x7fdf500046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 shutdown_connections 2024-09-14T10:54:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 --2- 172.21.15.164:0/883285019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdf60112dc0 0x7fdf601a76e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 >> 172.21.15.164:0/883285019 conn(0x7fdf6006f730 msgr2=0x7fdf60111db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 shutdown_connections 2024-09-14T10:54:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.549+0000 7fdf666b8640 1 -- 172.21.15.164:0/883285019 wait complete. 2024-09-14T10:54:36.558 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 511e0723-5c72-47fc-8bde-5f4106483858 3 2024-09-14T10:54:36.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12f047640 1 Processor -- start 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12f047640 1 -- start start 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12f047640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb128119950 0x7fb12811bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12f047640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb12811c280 con 0x7fb128111080 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12f047640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fb12811d480 con 0x7fb128119950 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb127fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb128119950 0x7fb12811bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12cde3640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb128111080 0x7fb128111460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:44484/0 (socket says 172.21.15.164:44484) 2024-09-14T10:54:36.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb127fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb128119950 0x7fb12811bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36230/0 (socket says 172.21.15.164:36230) 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.657+0000 7fb12cde3640 1 -- 172.21.15.164:0/3100975975 learned_addr learned my addr 172.21.15.164:0/3100975975 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb127fff640 1 -- 172.21.15.164:0/3100975975 >> v1:172.21.15.116:6789/0 conn(0x7fb128111080 legacy=0x7fb128111460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb127fff640 1 -- 172.21.15.164:0/3100975975 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12811d630 con 0x7fb128119950 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb127fff640 1 --2- 172.21.15.164:0/3100975975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128119950 0x7fb12811bd40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb114009720 tx=0x7fb11402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79dda623a65060b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb1277fe640 1 -- 172.21.15.164:0/3100975975 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114037070 con 0x7fb128119950 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb1277fe640 1 -- 172.21.15.164:0/3100975975 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11402ad90 con 0x7fb128119950 2024-09-14T10:54:36.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.658+0000 7fb1277fe640 1 -- 172.21.15.164:0/3100975975 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114032590 con 0x7fb128119950 2024-09-14T10:54:36.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 -- 172.21.15.164:0/3100975975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128119950 msgr2=0x7fb12811bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 --2- 172.21.15.164:0/3100975975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128119950 0x7fb12811bd40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb114009720 tx=0x7fb11402a110 comp rx=0 tx=0).stop 2024-09-14T10:54:36.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 -- 172.21.15.164:0/3100975975 shutdown_connections 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 --2- 172.21.15.164:0/3100975975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128119950 0x7fb12811bd40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 -- 172.21.15.164:0/3100975975 >> 172.21.15.164:0/3100975975 conn(0x7fb128072170 msgr2=0x7fb128074590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 -- 172.21.15.164:0/3100975975 shutdown_connections 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.659+0000 7fb12f047640 1 -- 172.21.15.164:0/3100975975 wait complete. 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12f047640 1 Processor -- start 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12f047640 1 -- start start 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12f047640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12f047640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb12811c930 con 0x7fb128111080 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12cde3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12cde3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:36236/0 (socket says 172.21.15.164:36236) 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.660+0000 7fb12cde3640 1 -- 172.21.15.164:0/949437602 learned_addr learned my addr 172.21.15.164:0/949437602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb12cde3640 1 -- 172.21.15.164:0/949437602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb128070530 con 0x7fb128111080 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb12cde3640 1 --2- 172.21.15.164:0/949437602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c480 tx=0x7fb11c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c017070 con 0x7fb128111080 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c005c10 con 0x7fb128111080 2024-09-14T10:54:36.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c007070 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12806ebd0 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12806f170 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb11c01a070 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.661+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb11c01c440 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.662+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb12811cec0 con 0x7fb128111080 2024-09-14T10:54:36.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.664+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb11c01c690 con 0x7fb128111080 2024-09-14T10:54:36.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.734+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "511e0723-5c72-47fc-8bde-5f4106483858", "id": 3} v 0) -- 0x7fb12802e5c0 con 0x7fb128111080 2024-09-14T10:54:36.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.737+0000 7fb1257fa640 1 -- 172.21.15.164:0/949437602 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "511e0723-5c72-47fc-8bde-5f4106483858", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb11c01cb60 con 0x7fb128111080 2024-09-14T10:54:36.737 INFO:teuthology.orchestra.run.smithi164.stdout:3 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 msgr2=0x7fb12806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 --2- 172.21.15.164:0/949437602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00c480 tx=0x7fb11c00c940 comp rx=0 tx=0).stop 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 shutdown_connections 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 --2- 172.21.15.164:0/949437602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb128111080 0x7fb12806e630 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 >> 172.21.15.164:0/949437602 conn(0x7fb128072170 msgr2=0x7fb128115e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 shutdown_connections 2024-09-14T10:54:36.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:54:36.738+0000 7fb12f047640 1 -- 172.21.15.164:0/949437602 wait complete. 2024-09-14T10:54:36.748 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:54:36.748 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:54:36.750 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:54:36.751 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:54:36.751 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:54:36.753 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:54:36.753 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:54:36.753 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:54:36.755 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:54:36.755 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:54:36.756 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:54:36.758 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:54:36.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:36.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.860+0000 7fdba7e3c640 1 Processor -- start 2024-09-14T10:54:36.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.860+0000 7fdba7e3c640 1 -- start start 2024-09-14T10:54:36.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba7e3c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdba012cba0 0x7fdba01315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba7e3c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba0099e20 con 0x7fdba012c0b0 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba7e3c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00715a0 con 0x7fdba012cba0 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba53d7640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdba012cba0 0x7fdba01315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba5bd8640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdba012c0b0 0x7fdba012c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35818/0 (socket says 172.21.15.116:35818) 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba5bd8640 1 -- 172.21.15.116:0/3043827916 learned_addr learned my addr 172.21.15.116:0/3043827916 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba53d7640 1 -- 172.21.15.116:0/3043827916 >> v1:172.21.15.116:6789/0 conn(0x7fdba012c0b0 legacy=0x7fdba012c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba4bd6640 1 -- 172.21.15.116:0/3043827916 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798559063 0 0) 0x7fdba0099e20 con 0x7fdba012c0b0 2024-09-14T10:54:36.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.861+0000 7fdba53d7640 1 -- 172.21.15.116:0/3043827916 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00705b0 con 0x7fdba012cba0 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.862+0000 7fdba53d7640 1 --2- 172.21.15.116:0/3043827916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012cba0 0x7fdba01315e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009750 tx=0x7fdb9002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a011fd957d5557 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.862+0000 7fdba4bd6640 1 -- 172.21.15.116:0/3043827916 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb90037070 con 0x7fdba012cba0 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.862+0000 7fdba4bd6640 1 -- 172.21.15.116:0/3043827916 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9002ad80 con 0x7fdba012cba0 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.862+0000 7fdba4bd6640 1 -- 172.21.15.116:0/3043827916 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb90032590 con 0x7fdba012cba0 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 -- 172.21.15.116:0/3043827916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012cba0 msgr2=0x7fdba01315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 --2- 172.21.15.116:0/3043827916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012cba0 0x7fdba01315e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009750 tx=0x7fdb9002a140 comp rx=0 tx=0).stop 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 -- 172.21.15.116:0/3043827916 shutdown_connections 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 --2- 172.21.15.116:0/3043827916 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012cba0 0x7fdba01315e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 -- 172.21.15.116:0/3043827916 >> 172.21.15.116:0/3043827916 conn(0x7fdba009abc0 msgr2=0x7fdba0098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 -- 172.21.15.116:0/3043827916 shutdown_connections 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 -- 172.21.15.116:0/3043827916 wait complete. 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.863+0000 7fdba7e3c640 1 Processor -- start 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba7e3c640 1 -- start start 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba7e3c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba7e3c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdba0131b20 con 0x7fdba012c0b0 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba5bd8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba5bd8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51052/0 (socket says 172.21.15.116:51052) 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba5bd8640 1 -- 172.21.15.116:0/1903055511 learned_addr learned my addr 172.21.15.116:0/1903055511 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba5bd8640 1 -- 172.21.15.116:0/1903055511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0125fd0 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdba5bd8640 1 --2- 172.21.15.116:0/1903055511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c3d0 tx=0x7fdb9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb980074d0 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.864+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb980047e0 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba0124600 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb98007670 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba0125200 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb98011070 con 0x7fdba012c0b0 2024-09-14T10:54:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fdb980138d0 con 0x7fdba012c0b0 2024-09-14T10:54:36.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.865+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba012c490 con 0x7fdba012c0b0 2024-09-14T10:54:36.866 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.867+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdb98004c20 con 0x7fdba012c0b0 2024-09-14T10:54:36.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.925+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdba0050ee0 con 0x7fdba012c0b0 2024-09-14T10:54:36.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.925+0000 7fdb967fc640 1 -- 172.21.15.116:0/1903055511 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fdb98004e00 con 0x7fdba012c0b0 2024-09-14T10:54:36.923 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:36.923 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":6,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:36.736511+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:36.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 msgr2=0x7fdba0122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:36.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 --2- 172.21.15.116:0/1903055511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800c3d0 tx=0x7fdb9800c890 comp rx=0 tx=0).stop 2024-09-14T10:54:36.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 shutdown_connections 2024-09-14T10:54:36.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 --2- 172.21.15.116:0/1903055511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba012c0b0 0x7fdba0122df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:36.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 >> 172.21.15.116:0/1903055511 conn(0x7fdba009abc0 msgr2=0x7fdba0071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:36.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 shutdown_connections 2024-09-14T10:54:36.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:36.926+0000 7fdba7e3c640 1 -- 172.21.15.116:0/1903055511 wait complete. 2024-09-14T10:54:36.934 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:54:36.934 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:54:37.337 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:37.432 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.433+0000 7f4816695640 1 Processor -- start 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.433+0000 7f4816695640 1 -- start start 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f4816695640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f481006e8c0 0x7f481006eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f4816695640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4810071750 con 0x7f481006f1e0 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f4816695640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f4810070ba0 con 0x7f481006e8c0 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f481006e8c0 0x7f481006eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f481006e8c0 0x7f481006eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51054/0 (socket says 172.21.15.116:51054) 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480ffff640 1 -- 172.21.15.116:0/2056929212 learned_addr learned my addr 172.21.15.116:0/2056929212 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480f7fe640 1 --1- 172.21.15.116:0/2056929212 >> v1:172.21.15.116:6789/0 conn(0x7f481006f1e0 0x7f481006f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:35830/0 (socket says 172.21.15.116:35830) 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480ffff640 1 -- 172.21.15.116:0/2056929212 >> v1:172.21.15.116:6789/0 conn(0x7f481006f1e0 legacy=0x7f481006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480ffff640 1 -- 172.21.15.116:0/2056929212 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810135ff0 con 0x7f481006e8c0 2024-09-14T10:54:37.433 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.434+0000 7f480effd640 1 -- 172.21.15.116:0/2056929212 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487252663 0 0) 0x7f4810071750 con 0x7f481006f1e0 2024-09-14T10:54:37.436 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.435+0000 7f480ffff640 1 --2- 172.21.15.116:0/2056929212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f481006eca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4800009820 tx=0x7f480002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffde85a454b9a7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:37.436 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.435+0000 7f480effd640 1 -- 172.21.15.116:0/2056929212 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4800037070 con 0x7f481006e8c0 2024-09-14T10:54:37.436 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.435+0000 7f480effd640 1 -- 172.21.15.116:0/2056929212 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480002ae50 con 0x7f481006e8c0 2024-09-14T10:54:37.436 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.435+0000 7f480effd640 1 -- 172.21.15.116:0/2056929212 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4800032590 con 0x7f481006e8c0 2024-09-14T10:54:37.436 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 -- 172.21.15.116:0/2056929212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 msgr2=0x7f481006eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 --2- 172.21.15.116:0/2056929212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f481006eca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4800009820 tx=0x7f480002a210 comp rx=0 tx=0).stop 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 -- 172.21.15.116:0/2056929212 shutdown_connections 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 --2- 172.21.15.116:0/2056929212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f481006eca0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 -- 172.21.15.116:0/2056929212 >> 172.21.15.116:0/2056929212 conn(0x7f481009ff40 msgr2=0x7f48100a0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 -- 172.21.15.116:0/2056929212 shutdown_connections 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.436+0000 7f4816695640 1 -- 172.21.15.116:0/2056929212 wait complete. 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f4816695640 1 Processor -- start 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f4816695640 1 -- start start 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f4816695640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f4816695640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4810135370 con 0x7f481006e8c0 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f480ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:37.437 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f480ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:51060/0 (socket says 172.21.15.116:51060) 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f480ffff640 1 -- 172.21.15.116:0/1404405491 learned_addr learned my addr 172.21.15.116:0/1404405491 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.437+0000 7f480ffff640 1 -- 172.21.15.116:0/1404405491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481009a800 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480ffff640 1 --2- 172.21.15.116:0/1404405491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f480002a250 tx=0x7f48000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4800037040 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4800004160 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481009ac50 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4800004440 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4810134740 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f480003a040 con 0x7f481006e8c0 2024-09-14T10:54:37.438 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.438+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f480003c430 con 0x7f481006e8c0 2024-09-14T10:54:37.439 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.439+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481006eca0 con 0x7f481006e8c0 2024-09-14T10:54:37.439 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.441+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4800042020 con 0x7f481006e8c0 2024-09-14T10:54:37.497 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.499+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4810073ca0 con 0x7f481006e8c0 2024-09-14T10:54:37.497 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.499+0000 7f480cff9640 1 -- 172.21.15.116:0/1404405491 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f480003e460 con 0x7f481006e8c0 2024-09-14T10:54:37.497 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T10:54:37.497 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":6,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:36.736511+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:37.498 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 msgr2=0x7f4810134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 --2- 172.21.15.116:0/1404405491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f480002a250 tx=0x7f48000046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 shutdown_connections 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 --2- 172.21.15.116:0/1404405491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f481006e8c0 0x7f4810134200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 >> 172.21.15.116:0/1404405491 conn(0x7f481009ff40 msgr2=0x7f4810072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 shutdown_connections 2024-09-14T10:54:37.499 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:37.500+0000 7f4816695640 1 -- 172.21.15.116:0/1404405491 wait complete. 2024-09-14T10:54:37.507 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-14T10:54:38.164 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T10:54:38.166+0000 7fe118287640 -1 Falling back to public interface 2024-09-14T10:54:38.235 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-14T10:54:38.236+0000 7f9cab4b6640 -1 Falling back to public interface 2024-09-14T10:54:38.236 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:38.236+0000 7ff53ee0e640 -1 Falling back to public interface 2024-09-14T10:54:38.236 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:38.236+0000 7ff53d7f2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-14T10:54:38.236 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:38.236+0000 7ff53d7f2640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-09-14T10:54:38.236 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-14T10:54:38.237+0000 7f9caa45e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2024-09-14T10:54:38.479 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-14T10:54:38.480+0000 7f031be16640 -1 Falling back to public interface 2024-09-14T10:54:41.056 INFO:tasks.ceph.mgr.x.smithi164.stderr:2024-09-14T10:54:41.058+0000 7f8d45a38640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-14T10:54:41.925 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T10:54:41.927+0000 7fe118287640 -1 osd.0 0 log_to_monitors true 2024-09-14T10:54:42.076 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:42.077+0000 7ff53ee0e640 -1 osd.1 0 log_to_monitors true 2024-09-14T10:54:42.281 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-14T10:54:42.282+0000 7f031be16640 -1 osd.3 0 log_to_monitors true 2024-09-14T10:54:42.324 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-14T10:54:42.325+0000 7f9cab4b6640 -1 osd.2 0 log_to_monitors true 2024-09-14T10:54:43.894 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T10:54:43.896+0000 7fe114a2a640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:54:43.903 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-09-14T10:54:43.906+0000 7fe10c035640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:54:43.910 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:44.001 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde6310e640 1 Processor -- start 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde6310e640 1 -- start start 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde6310e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde5c0712e0 0x7fde5c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde6310e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5c06cc20 con 0x7fde5c129370 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde6310e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fde5c074250 con 0x7fde5c0712e0 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde5bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde5c0712e0 0x7fde5c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde5bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fde5c0712e0 0x7fde5c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:47916/0 (socket says 172.21.15.116:47916) 2024-09-14T10:54:44.002 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde60eaa640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fde5c129370 0x7fde5c129750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36026/0 (socket says 172.21.15.116:36026) 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.001+0000 7fde5bfff640 1 -- 172.21.15.116:0/2326787902 learned_addr learned my addr 172.21.15.116:0/2326787902 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5bfff640 1 -- 172.21.15.116:0/2326787902 >> v1:172.21.15.116:6789/0 conn(0x7fde5c129370 legacy=0x7fde5c129750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5b7fe640 1 -- 172.21.15.116:0/2326787902 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594061311 0 0) 0x7fde5c06cc20 con 0x7fde5c129370 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5bfff640 1 -- 172.21.15.116:0/2326787902 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c06e640 con 0x7fde5c0712e0 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5bfff640 1 --2- 172.21.15.116:0/2326787902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c1317f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009e50 tx=0x7fde4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8c11ed0bab823b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5b7fe640 1 -- 172.21.15.116:0/2326787902 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c036070 con 0x7fde5c0712e0 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5b7fe640 1 -- 172.21.15.116:0/2326787902 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c031400 con 0x7fde5c0712e0 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.002+0000 7fde5b7fe640 1 -- 172.21.15.116:0/2326787902 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c0315d0 con 0x7fde5c0712e0 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 -- 172.21.15.116:0/2326787902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 msgr2=0x7fde5c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 --2- 172.21.15.116:0/2326787902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c1317f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009e50 tx=0x7fde4c02a730 comp rx=0 tx=0).stop 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 -- 172.21.15.116:0/2326787902 shutdown_connections 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 --2- 172.21.15.116:0/2326787902 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c1317f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:44.003 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 -- 172.21.15.116:0/2326787902 >> 172.21.15.116:0/2326787902 conn(0x7fde5c09b950 msgr2=0x7fde5c09bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:44.004 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 -- 172.21.15.116:0/2326787902 shutdown_connections 2024-09-14T10:54:44.004 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.003+0000 7fde6310e640 1 -- 172.21.15.116:0/2326787902 wait complete. 2024-09-14T10:54:44.004 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde6310e640 1 Processor -- start 2024-09-14T10:54:44.004 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde6310e640 1 -- start start 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde6310e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde6310e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c071a50 con 0x7fde5c0712e0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde60eaa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde60eaa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:47928/0 (socket says 172.21.15.116:47928) 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.004+0000 7fde60eaa640 1 -- 172.21.15.116:0/1748399969 learned_addr learned my addr 172.21.15.116:0/1748399969 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde60eaa640 1 -- 172.21.15.116:0/1748399969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c06eed0 con 0x7fde5c0712e0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde60eaa640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde5400c480 tx=0x7fde5400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde54017070 con 0x7fde5c0712e0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde54007470 con 0x7fde5c0712e0 2024-09-14T10:54:44.006 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde54005810 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c06fb40 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.005+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c097da0 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.006+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (secure 0 0 0) 0x7fde5401a070 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.006+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c0008d0 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.006+0000 7fde597fa640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 0x7fde3c0409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.006+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1465+0+0 (secure 0 0 0) 0x7fde54051600 con 0x7fde5c0712e0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.007+0000 7fde5bfff640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 0x7fde3c0409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:44.007 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.007+0000 7fde5bfff640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 0x7fde3c0409a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fde4c033000 tx=0x7fde4c009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:44.009 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.011+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fde54010300 con 0x7fde5c0712e0 2024-09-14T10:54:44.187 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.189+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde5c075760 con 0x7fde5c0712e0 2024-09-14T10:54:44.188 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.190+0000 7fde597fa640 1 -- 172.21.15.116:0/1748399969 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4661 (secure 0 0 0) 0x7fde54010e20 con 0x7fde5c0712e0 2024-09-14T10:54:44.188 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T10:54:44.188 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":9,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:44.063108+0000","last_up_change":"2024-09-14T10:54:44.063108+0000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6801","nonce":1614093354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6803","nonce":1614093354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6807","nonce":1614093354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6805","nonce":1614093354}]},"public_addr":"172.21.15.116:6801/1614093354","cluster_addr":"172.21.15.116:6803/1614093354","heartbeat_back_addr":"172.21.15.116:6807/1614093354","heartbeat_front_addr":"172.21.15.116:6805/1614093354","state":["exists","up"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:44.190 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 msgr2=0x7fde3c0409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:44.190 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 0x7fde3c0409a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fde4c033000 tx=0x7fde4c009000 comp rx=0 tx=0).stop 2024-09-14T10:54:44.190 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 msgr2=0x7fde5c097860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde5400c480 tx=0x7fde5400c940 comp rx=0 tx=0).stop 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 shutdown_connections 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fde3c03e4e0 0x7fde3c0409a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 --2- 172.21.15.116:0/1748399969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde5c0712e0 0x7fde5c097860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 >> 172.21.15.116:0/1748399969 conn(0x7fde5c09b950 msgr2=0x7fde5c098450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 shutdown_connections 2024-09-14T10:54:44.191 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:44.192+0000 7fde6310e640 1 -- 172.21.15.116:0/1748399969 wait complete. 2024-09-14T10:54:44.199 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-09-14T10:54:45.760 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:45.762+0000 7ff53afed640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:54:45.771 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-14T10:54:45.774+0000 7f0317853640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:54:45.772 INFO:tasks.ceph.osd.1.smithi164.stderr:2024-09-14T10:54:45.775+0000 7ff5325f8640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:54:45.782 INFO:tasks.ceph.osd.3.smithi164.stderr:2024-09-14T10:54:45.785+0000 7f030f672640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:54:45.785 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-14T10:54:45.787+0000 7f9ca7c59640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:54:45.796 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-09-14T10:54:45.799+0000 7f9c9f264640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:54:50.605 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:50.707 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.708+0000 7fb60e391640 1 Processor -- start 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.708+0000 7fb60e391640 1 -- start start 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb60e391640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb6080712e0 0x7fb6081317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb60e391640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60806cc20 con 0x7fb608129370 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb60e391640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fb608074250 con 0x7fb6080712e0 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb607fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb608129370 0x7fb608129750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36036/0 (socket says 172.21.15.116:36036) 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb607fff640 1 -- 172.21.15.116:0/502122426 learned_addr learned my addr 172.21.15.116:0/502122426 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb6077fe640 1 --2- 172.21.15.116:0/502122426 >> v2:172.21.15.116:3300/0 conn(0x7fb6080712e0 0x7fb6081317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb606ffd640 1 -- 172.21.15.116:0/502122426 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466196095 0 0) 0x7fb60806cc20 con 0x7fb608129370 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb606ffd640 1 -- 172.21.15.116:0/502122426 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5f0003520 con 0x7fb608129370 2024-09-14T10:54:50.708 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb6077fe640 1 -- 172.21.15.116:0/502122426 >> v1:172.21.15.116:6789/0 conn(0x7fb608129370 legacy=0x7fb608129750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:50.709 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.709+0000 7fb6077fe640 1 -- 172.21.15.116:0/502122426 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60806e640 con 0x7fb6080712e0 2024-09-14T10:54:50.711 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.710+0000 7fb6077fe640 1 --2- 172.21.15.116:0/502122426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb6081317f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009720 tx=0x7fb5fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40d3da17260cec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:50.711 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.710+0000 7fb606ffd640 1 -- 172.21.15.116:0/502122426 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5fc037070 con 0x7fb6080712e0 2024-09-14T10:54:50.711 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.710+0000 7fb606ffd640 1 -- 172.21.15.116:0/502122426 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5fc02ad90 con 0x7fb6080712e0 2024-09-14T10:54:50.711 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.710+0000 7fb606ffd640 1 -- 172.21.15.116:0/502122426 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5fc032570 con 0x7fb6080712e0 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 -- 172.21.15.116:0/502122426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 msgr2=0x7fb6081317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 --2- 172.21.15.116:0/502122426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb6081317f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009720 tx=0x7fb5fc02a110 comp rx=0 tx=0).stop 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 -- 172.21.15.116:0/502122426 shutdown_connections 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 --2- 172.21.15.116:0/502122426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb6081317f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 -- 172.21.15.116:0/502122426 >> 172.21.15.116:0/502122426 conn(0x7fb60809b950 msgr2=0x7fb60809bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 -- 172.21.15.116:0/502122426 shutdown_connections 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.711+0000 7fb60e391640 1 -- 172.21.15.116:0/502122426 wait complete. 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.712+0000 7fb60e391640 1 Processor -- start 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.712+0000 7fb60e391640 1 -- start start 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.712+0000 7fb60e391640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.712+0000 7fb60e391640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb608071a50 con 0x7fb6080712e0 2024-09-14T10:54:50.712 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb607fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb607fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:47948/0 (socket says 172.21.15.116:47948) 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb607fff640 1 -- 172.21.15.116:0/2030337991 learned_addr learned my addr 172.21.15.116:0/2030337991 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb607fff640 1 -- 172.21.15.116:0/2030337991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60806eed0 con 0x7fb6080712e0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb607fff640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c480 tx=0x7fb5f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f8017070 con 0x7fb6080712e0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8005cd0 con 0x7fb6080712e0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb608126ca0 con 0x7fb6080712e0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5f8007200 con 0x7fb6080712e0 2024-09-14T10:54:50.713 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.713+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60812db70 con 0x7fb6080712e0 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.714+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (secure 0 0 0) 0x7fb5f801a070 con 0x7fb6080712e0 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.714+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60812d660 con 0x7fb6080712e0 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.714+0000 7fb604ff9640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 0x7fb5f40409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.714+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fb5f8051b60 con 0x7fb6080712e0 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.715+0000 7fb6077fe640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 0x7fb5f40409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:50.714 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.715+0000 7fb6077fe640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 0x7fb5f40409a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc034000 tx=0x7fb5fc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:50.717 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.719+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fb5f801b750 con 0x7fb6080712e0 2024-09-14T10:54:50.897 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.898+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb60806f8f0 con 0x7fb6080712e0 2024-09-14T10:54:50.897 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.899+0000 7fb604ff9640 1 -- 172.21.15.116:0/2030337991 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8014 (secure 0 0 0) 0x7fb5f801abb0 con 0x7fb6080712e0 2024-09-14T10:54:50.897 INFO:teuthology.misc.health.smithi116.stdout: 2024-09-14T10:54:50.897 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":15,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:50.798453+0000","last_up_change":"2024-09-14T10:54:46.775997+0000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:54:48.071849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6801","nonce":1614093354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6803","nonce":1614093354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6807","nonce":1614093354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6805","nonce":1614093354}]},"public_addr":"172.21.15.116:6801/1614093354","cluster_addr":"172.21.15.116:6803/1614093354","heartbeat_back_addr":"172.21.15.116:6807/1614093354","heartbeat_front_addr":"172.21.15.116:6805/1614093354","state":["exists","up"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6804","nonce":3845281611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6808","nonce":3845281611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6815","nonce":3845281611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6812","nonce":3845281611}]},"public_addr":"172.21.15.164:6804/3845281611","cluster_addr":"172.21.15.164:6808/3845281611","heartbeat_back_addr":"172.21.15.164:6815/3845281611","heartbeat_front_addr":"172.21.15.164:6812/3845281611","state":["exists","up"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6801","nonce":813620551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6805","nonce":813620551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6813","nonce":813620551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6809","nonce":813620551}]},"public_addr":"172.21.15.164:6801/813620551","cluster_addr":"172.21.15.164:6805/813620551","heartbeat_back_addr":"172.21.15.164:6813/813620551","heartbeat_front_addr":"172.21.15.164:6809/813620551","state":["exists","up"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6817","nonce":3361197980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6819","nonce":3361197980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6823","nonce":3361197980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6821","nonce":3361197980}]},"public_addr":"172.21.15.164:6817/3361197980","cluster_addr":"172.21.15.164:6819/3361197980","heartbeat_back_addr":"172.21.15.164:6823/3361197980","heartbeat_front_addr":"172.21.15.164:6821/3361197980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:42.887950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.053178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.353606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:50.899 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 msgr2=0x7fb5f40409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:50.899 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 0x7fb5f40409a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc034000 tx=0x7fb5fc02e000 comp rx=0 tx=0).stop 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 msgr2=0x7fb608097630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c480 tx=0x7fb5f800c940 comp rx=0 tx=0).stop 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 shutdown_connections 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5f403e4e0 0x7fb5f40409a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 --2- 172.21.15.116:0/2030337991 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb6080712e0 0x7fb608097630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 >> 172.21.15.116:0/2030337991 conn(0x7fb60809b950 msgr2=0x7fb608098450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 shutdown_connections 2024-09-14T10:54:50.900 INFO:teuthology.misc.health.smithi116.stderr:2024-09-14T10:54:50.901+0000 7fb60e391640 1 -- 172.21.15.116:0/2030337991 wait complete. 2024-09-14T10:54:50.913 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-14T10:54:50.913 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:54:50.913 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:54:51.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.014+0000 7f1b97c71640 1 Processor -- start 2024-09-14T10:54:51.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.014+0000 7f1b97c71640 1 -- start start 2024-09-14T10:54:51.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.014+0000 7f1b97c71640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1b9012bff0 0x7f1b9012c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.014+0000 7f1b97c71640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b90099e20 con 0x7f1b9012c910 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.014+0000 7f1b97c71640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900713c0 con 0x7f1b9012bff0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1b9012bff0 0x7f1b9012c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1b9012bff0 0x7f1b9012c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34140/0 (socket says 172.21.15.116:34140) 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b9520c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1b9012c910 0x7f1b90097120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50970/0 (socket says 172.21.15.116:50970) 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 -- 172.21.15.116:0/3218038953 learned_addr learned my addr 172.21.15.116:0/3218038953 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 -- 172.21.15.116:0/3218038953 >> v1:172.21.15.116:6789/0 conn(0x7f1b9012c910 legacy=0x7f1b90097120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 -- 172.21.15.116:0/3218038953 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b90070610 con 0x7f1b9012bff0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.015+0000 7f1b95a0d640 1 --2- 172.21.15.116:0/3218038953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b9012c3d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba90 tx=0x7f1b8c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423999d19e5df596 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b94a0b640 1 -- 172.21.15.116:0/3218038953 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c036020 con 0x7f1b9012bff0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b94a0b640 1 -- 172.21.15.116:0/3218038953 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c032770 con 0x7f1b9012bff0 2024-09-14T10:54:51.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b94a0b640 1 -- 172.21.15.116:0/3218038953 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c032a70 con 0x7f1b9012bff0 2024-09-14T10:54:51.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 -- 172.21.15.116:0/3218038953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 msgr2=0x7f1b9012c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 --2- 172.21.15.116:0/3218038953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b9012c3d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ba90 tx=0x7f1b8c02c940 comp rx=0 tx=0).stop 2024-09-14T10:54:51.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 -- 172.21.15.116:0/3218038953 shutdown_connections 2024-09-14T10:54:51.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 --2- 172.21.15.116:0/3218038953 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b9012c3d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 -- 172.21.15.116:0/3218038953 >> 172.21.15.116:0/3218038953 conn(0x7f1b9009abc0 msgr2=0x7f1b90098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 -- 172.21.15.116:0/3218038953 shutdown_connections 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.016+0000 7f1b97c71640 1 -- 172.21.15.116:0/3218038953 wait complete. 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.017+0000 7f1b97c71640 1 Processor -- start 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.017+0000 7f1b97c71640 1 -- start start 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.017+0000 7f1b97c71640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.017+0000 7f1b97c71640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f1b90070180 con 0x7f1b9012bff0 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b95a0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b95a0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34142/0 (socket says 172.21.15.116:34142) 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b95a0d640 1 -- 172.21.15.116:0/1874516600 learned_addr learned my addr 172.21.15.116:0/1874516600 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b95a0d640 1 -- 172.21.15.116:0/1874516600 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b90128f50 con 0x7f1b9012bff0 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b95a0d640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b2c0 tx=0x7f1b8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:51.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c03ac40 con 0x7f1b9012bff0 2024-09-14T10:54:51.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c03ade0 con 0x7f1b9012bff0 2024-09-14T10:54:51.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b90091460 con 0x7f1b9012bff0 2024-09-14T10:54:51.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8c0465b0 con 0x7f1b9012bff0 2024-09-14T10:54:51.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.018+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b901c4d90 con 0x7f1b9012bff0 2024-09-14T10:54:51.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.019+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (secure 0 0 0) 0x7f1b8c039020 con 0x7f1b9012bff0 2024-09-14T10:54:51.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.019+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b901297f0 con 0x7f1b9012bff0 2024-09-14T10:54:51.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.019+0000 7f1b867fc640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 0x7f1b740409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.019+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7f1b8c02f070 con 0x7f1b9012bff0 2024-09-14T10:54:51.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.020+0000 7f1b9520c640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 0x7f1b740409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.020+0000 7f1b9520c640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 0x7f1b740409d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b80001630 tx=0x7f1b80007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:51.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.024+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f1b8c03bc20 con 0x7f1b9012bff0 2024-09-14T10:54:51.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.199+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1b90097c90 con 0x7f1b9012bff0 2024-09-14T10:54:51.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.886+0000 7f1b867fc640 1 -- 172.21.15.116:0/1874516600 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7f1b8c0453e0 con 0x7f1b9012bff0 2024-09-14T10:54:51.884 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'rbd' created 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 msgr2=0x7f1b740409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 0x7f1b740409d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b80001630 tx=0x7f1b80007a20 comp rx=0 tx=0).stop 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 msgr2=0x7f1b901c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b2c0 tx=0x7f1b8c004730 comp rx=0 tx=0).stop 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 shutdown_connections 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1b7403e510 0x7f1b740409d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 --2- 172.21.15.116:0/1874516600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1b9012bff0 0x7f1b901c4670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 >> 172.21.15.116:0/1874516600 conn(0x7f1b9009abc0 msgr2=0x7f1b9009c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:51.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 shutdown_connections 2024-09-14T10:54:51.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.889+0000 7f1b97c71640 1 -- 172.21.15.116:0/1874516600 wait complete. 2024-09-14T10:54:51.899 DEBUG:teuthology.orchestra.run.smithi116:> rbd --cluster ceph pool init rbd 2024-09-14T10:54:51.955 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:51.955 INFO:teuthology.orchestra.run.smithi116.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:51.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.958+0000 7f3d58dac140 1 Processor -- start 2024-09-14T10:54:51.956 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.958+0000 7f3d58dac140 1 -- start start 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d58dac140 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c3895733c0 0x55c3895737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d58dac140 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55c389410d90 con 0x55c389573ce0 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d58dac140 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55c389460a80 con 0x55c3895733c0 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57897640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c3895733c0 0x55c3895737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57897640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c3895733c0 0x55c3895737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34150/0 (socket says 172.21.15.116:34150) 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57096640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55c389573ce0 0x55c38961d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50980/0 (socket says 172.21.15.116:50980) 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57897640 1 -- 172.21.15.116:0/3593395775 learned_addr learned my addr 172.21.15.116:0/3593395775 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:51.957 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57897640 1 -- 172.21.15.116:0/3593395775 >> v1:172.21.15.116:6789/0 conn(0x55c389573ce0 legacy=0x55c38961d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d57897640 1 -- 172.21.15.116:0/3593395775 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c389428410 con 0x55c3895733c0 2024-09-14T10:54:51.958 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.959+0000 7f3d56895640 1 -- 172.21.15.116:0/3593395775 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758494187 0 0) 0x55c389410d90 con 0x55c389573ce0 2024-09-14T10:54:51.959 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d57897640 1 --2- 172.21.15.116:0/3593395775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c3895737a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d48005fd0 tx=0x7f3d48045da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e5d9b6dedcfdbe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d56895640 1 -- 172.21.15.116:0/3593395775 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d4804d560 con 0x55c3895733c0 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d56895640 1 -- 172.21.15.116:0/3593395775 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48051070 con 0x55c3895733c0 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d56895640 1 -- 172.21.15.116:0/3593395775 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d4804d850 con 0x55c3895733c0 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 -- 172.21.15.116:0/3593395775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 msgr2=0x55c3895737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 --2- 172.21.15.116:0/3593395775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c3895737a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d48005fd0 tx=0x7f3d48045da0 comp rx=0 tx=0).stop 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 -- 172.21.15.116:0/3593395775 shutdown_connections 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 --2- 172.21.15.116:0/3593395775 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c3895737a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 -- 172.21.15.116:0/3593395775 >> 172.21.15.116:0/3593395775 conn(0x55c38958cdd0 msgr2=0x55c38958fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.961+0000 7f3d58dac140 1 -- 172.21.15.116:0/3593395775 shutdown_connections 2024-09-14T10:54:51.960 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.962+0000 7f3d58dac140 1 -- 172.21.15.116:0/3593395775 wait complete. 2024-09-14T10:54:51.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.962+0000 7f3d58dac140 1 Processor -- start 2024-09-14T10:54:51.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.962+0000 7f3d58dac140 1 -- start start 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d58dac140 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d58dac140 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c389464890 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d57897640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d57897640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34154/0 (socket says 172.21.15.116:34154) 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d57897640 1 -- 172.21.15.116:0/2957104525 learned_addr learned my addr 172.21.15.116:0/2957104525 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d57897640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3893df720 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d57897640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d48057040 tx=0x7f3d48003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48064070 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4804d620 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d48060430 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c389613f70 con 0x55c3895733c0 2024-09-14T10:54:51.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.963+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c389613a30 con 0x55c3895733c0 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.964+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) ==== 50898+0+0 (secure 0 0 0) 0x7f3d4805e040 con 0x55c3895733c0 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.964+0000 7f3d4ffff640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 0x7f3d3803f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.965+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3471+0+0 (secure 0 0 0) 0x7f3d4805b040 con 0x55c3895733c0 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.965+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55c389611860 con 0x55c3895733c0 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.965+0000 7f3d57096640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 0x7f3d3803f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:51.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:51.965+0000 7f3d57096640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 0x7f3d3803f290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d40000c00 tx=0x7f3d400013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:52.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.892+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7f3d48018be0 con 0x55c3895733c0 2024-09-14T10:54:52.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.892+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d48051070 con 0x55c3895733c0 2024-09-14T10:54:52.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.895+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d48053030 con 0x55c3895733c0 2024-09-14T10:54:52.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.897+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 8 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3d48060e20 con 0x55c3895733c0 2024-09-14T10:54:52.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.897+0000 7f3d56094640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f3d3c002ae0 con 0x55c3895733c0 2024-09-14T10:54:52.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.897+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 9 ==== osd_map(17..17 src has 1..17) ==== 650+0+0 (secure 0 0 0) 0x7f3d48097430 con 0x55c3895733c0 2024-09-14T10:54:52.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.897+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 0x55c38962fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:52.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.897+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x55c389634620 con 0x55c389573ce0 2024-09-14T10:54:52.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.898+0000 7f3d58af9640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 0x55c38962fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:52.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.899+0000 7f3d58af9640 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 0x55c38962fca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:52.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.907+0000 7f3d58af9640 1 -- 172.21.15.116:0/2957104525 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f3d5000c430 con 0x55c389573ce0 2024-09-14T10:54:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.910+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55c389686a00 con 0x55c389573ce0 2024-09-14T10:54:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.910+0000 7f3d58af9640 1 -- 172.21.15.116:0/2957104525 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3d5000c430 con 0x55c389573ce0 2024-09-14T10:54:52.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.910+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x55c389685b10 con 0x55c389573ce0 2024-09-14T10:54:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.911+0000 7f3d58af9640 1 -- 172.21.15.116:0/2957104525 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3d5000c430 con 0x55c389573ce0 2024-09-14T10:54:52.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:52.911+0000 7f3d55893640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f3d30001f00 con 0x55c3895733c0 2024-09-14T10:54:53.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.894+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7f3d4801ae60 con 0x55c3895733c0 2024-09-14T10:54:53.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.894+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f3d38042bb0 con 0x55c3895733c0 2024-09-14T10:54:53.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.895+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 11 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7f3d48097030 con 0x55c3895733c0 2024-09-14T10:54:53.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.895+0000 7f3d56094640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f3d3c005780 con 0x55c389573ce0 2024-09-14T10:54:53.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.903+0000 7f3d58af9640 1 -- 172.21.15.116:0/2957104525 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f3d5000c430 con 0x55c389573ce0 2024-09-14T10:54:53.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:53.903+0000 7f3d55893640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f3d30003350 con 0x55c3895733c0 2024-09-14T10:54:54.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.899+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7f3d48085020 con 0x55c3895733c0 2024-09-14T10:54:54.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.899+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=19}) -- 0x7f3d38042bb0 con 0x55c3895733c0 2024-09-14T10:54:54.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.899+0000 7f3d4ffff640 1 -- 172.21.15.116:0/2957104525 <== mon.0 v2:172.21.15.116:3300/0 13 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7f3d4805b240 con 0x55c3895733c0 2024-09-14T10:54:54.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.899+0000 7f3d56094640 1 -- 172.21.15.116:0/2957104525 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f3d3c005b20 con 0x55c389573ce0 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.903+0000 7f3d58af9640 1 -- 172.21.15.116:0/2957104525 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d5000c430 con 0x55c389573ce0 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 msgr2=0x55c38962fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 0x55c38962fca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 msgr2=0x7f3d3803f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 0x7f3d3803f290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d40000c00 tx=0x7f3d400013b0 comp rx=0 tx=0).stop 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 msgr2=0x55c389610ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d48057040 tx=0x7f3d48003330 comp rx=0 tx=0).stop 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 shutdown_connections 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c389573ce0 0x55c38962fca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:54.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d3803cdd0 0x7f3d3803f290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:54.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 --2- 172.21.15.116:0/2957104525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c3895733c0 0x55c389610ff0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:54.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 >> 172.21.15.116:0/2957104525 conn(0x55c38958cdd0 msgr2=0x55c389620a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:54.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 shutdown_connections 2024-09-14T10:54:54.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:54.904+0000 7f3d58dac140 1 -- 172.21.15.116:0/2957104525 wait complete. 2024-09-14T10:54:54.907 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:54:54.907 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:54:54.908 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:54:55.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.017+0000 7f00f7310640 1 Processor -- start 2024-09-14T10:54:55.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.017+0000 7f00f7310640 1 -- start start 2024-09-14T10:54:55.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f7310640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00f006efc0 0x7f00f0130e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f7310640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f006f9f0 con 0x7f00f012be50 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f7310640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f00f006f580 con 0x7f00f006efc0 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f48ab640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f00f006efc0 0x7f00f0130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f50ac640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f00f012be50 0x7f00f012c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50986/0 (socket says 172.21.15.116:50986) 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f50ac640 1 -- 172.21.15.116:0/3319221069 learned_addr learned my addr 172.21.15.116:0/3319221069 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f48ab640 1 -- 172.21.15.116:0/3319221069 >> v1:172.21.15.116:6789/0 conn(0x7f00f012be50 legacy=0x7f00f012c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00f48ab640 1 -- 172.21.15.116:0/3319221069 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f0070f50 con 0x7f00f006efc0 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.018+0000 7f00e7fff640 1 -- 172.21.15.116:0/3319221069 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190676856 0 0) 0x7f00f006f9f0 con 0x7f00f012be50 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f48ab640 1 --2- 172.21.15.116:0/3319221069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f0130e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009720 tx=0x7f00e002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bd9e7cceed465b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00e7fff640 1 -- 172.21.15.116:0/3319221069 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00e0037070 con 0x7f00f006efc0 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00e7fff640 1 -- 172.21.15.116:0/3319221069 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e002ad90 con 0x7f00f006efc0 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00e7fff640 1 -- 172.21.15.116:0/3319221069 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00e0032590 con 0x7f00f006efc0 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f7310640 1 -- 172.21.15.116:0/3319221069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 msgr2=0x7f00f0130e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f7310640 1 --2- 172.21.15.116:0/3319221069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f0130e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009720 tx=0x7f00e002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f7310640 1 -- 172.21.15.116:0/3319221069 shutdown_connections 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f7310640 1 --2- 172.21.15.116:0/3319221069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f0130e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.019+0000 7f00f7310640 1 -- 172.21.15.116:0/3319221069 >> 172.21.15.116:0/3319221069 conn(0x7f00f009abc0 msgr2=0x7f00f0098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.020+0000 7f00f7310640 1 -- 172.21.15.116:0/3319221069 shutdown_connections 2024-09-14T10:54:55.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.020+0000 7f00f7310640 1 -- 172.21.15.116:0/3319221069 wait complete. 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.020+0000 7f00f7310640 1 Processor -- start 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.020+0000 7f00f7310640 1 -- start start 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f7310640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f7310640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0131360 con 0x7f00f006efc0 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f50ac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f50ac640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34162/0 (socket says 172.21.15.116:34162) 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f50ac640 1 -- 172.21.15.116:0/2027670774 learned_addr learned my addr 172.21.15.116:0/2027670774 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f50ac640 1 -- 172.21.15.116:0/2027670774 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f0127990 con 0x7f00f006efc0 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f50ac640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c3e0 tx=0x7f00ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ec017070 con 0x7f00f006efc0 2024-09-14T10:54:55.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ec005c10 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f0128ac0 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.021+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ec0070d0 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.022+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f0128590 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.022+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f00ec01a070 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.022+0000 7f00e5ffb640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 0x7f00d4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.022+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f00ec051f90 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.023+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0050ee0 con 0x7f00f006efc0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.023+0000 7f00f48ab640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 0x7f00d4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.023+0000 7f00f48ab640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 0x7f00d4040a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f00e0034000 tx=0x7f00e002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.027+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f00ec010300 con 0x7f00f006efc0 2024-09-14T10:54:55.198 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.200+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f00f0129230 con 0x7f00f006efc0 2024-09-14T10:54:55.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.201+0000 7f00e5ffb640 1 -- 172.21.15.116:0/2027670774 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7f00ec010e20 con 0x7f00f006efc0 2024-09-14T10:54:55.199 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 msgr2=0x7f00d4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 0x7f00d4040a30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f00e0034000 tx=0x7f00e002e000 comp rx=0 tx=0).stop 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 msgr2=0x7f00f01263f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f00ec00c3e0 tx=0x7f00ec00c8a0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 shutdown_connections 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f00d403e570 0x7f00d4040a30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 --2- 172.21.15.116:0/2027670774 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00f006efc0 0x7f00f01263f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 >> 172.21.15.116:0/2027670774 conn(0x7f00f009abc0 msgr2=0x7f00f0097330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 shutdown_connections 2024-09-14T10:54:55.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.203+0000 7f00f7310640 1 -- 172.21.15.116:0/2027670774 wait complete. 2024-09-14T10:54:55.211 INFO:teuthology.orchestra.run.smithi116.stdout:[{"version":5,"timestamp":"2024-09-14T10:54:45.789063+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5480.412764"}]}] 2024-09-14T10:54:55.211 INFO:tasks.ceph_manager:config epoch is 5 2024-09-14T10:54:55.212 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:54:55.212 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:54:55.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:54:55.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.310+0000 7f8f9cccd640 1 Processor -- start 2024-09-14T10:54:55.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9cccd640 1 -- start start 2024-09-14T10:54:55.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9cccd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f9812c0b0 0x7f8f9812c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9cccd640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f9809a290 con 0x7f8f9812c9d0 2024-09-14T10:54:55.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9cccd640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f8f98071860 con 0x7f8f9812c0b0 2024-09-14T10:54:55.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8f9812c0b0 0x7f8f9812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f8ffff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8f9812c9d0 0x7f8f98097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:50988/0 (socket says 172.21.15.116:50988) 2024-09-14T10:54:55.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f8ffff640 1 -- 172.21.15.116:0/1553817814 learned_addr learned my addr 172.21.15.116:0/1553817814 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:55.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9659c640 1 -- 172.21.15.116:0/1553817814 >> v1:172.21.15.116:6789/0 conn(0x7f8f9812c9d0 legacy=0x7f8f98097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.311+0000 7f8f9659c640 1 -- 172.21.15.116:0/1553817814 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f98099e20 con 0x7f8f9812c0b0 2024-09-14T10:54:55.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.312+0000 7f8f9659c640 1 --2- 172.21.15.116:0/1553817814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f9812c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009750 tx=0x7f8f8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b9875197e32d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.312+0000 7f8f95d9b640 1 -- 172.21.15.116:0/1553817814 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88037070 con 0x7f8f9812c0b0 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.312+0000 7f8f95d9b640 1 -- 172.21.15.116:0/1553817814 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8802ad80 con 0x7f8f9812c0b0 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.312+0000 7f8f95d9b640 1 -- 172.21.15.116:0/1553817814 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88032590 con 0x7f8f9812c0b0 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 -- 172.21.15.116:0/1553817814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 msgr2=0x7f8f9812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/1553817814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f9812c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009750 tx=0x7f8f8802a140 comp rx=0 tx=0).stop 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 -- 172.21.15.116:0/1553817814 shutdown_connections 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/1553817814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f9812c490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 -- 172.21.15.116:0/1553817814 >> 172.21.15.116:0/1553817814 conn(0x7f8f9809abc0 msgr2=0x7f8f98098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 -- 172.21.15.116:0/1553817814 shutdown_connections 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.313+0000 7f8f9cccd640 1 -- 172.21.15.116:0/1553817814 wait complete. 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9cccd640 1 Processor -- start 2024-09-14T10:54:55.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9cccd640 1 -- start start 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9cccd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9cccd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9812ce00 con 0x7f8f9812c0b0 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34172/0 (socket says 172.21.15.116:34172) 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9659c640 1 -- 172.21.15.116:0/337118483 learned_addr learned my addr 172.21.15.116:0/337118483 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.314+0000 7f8f9659c640 1 -- 172.21.15.116:0/337118483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f98091070 con 0x7f8f9812c0b0 2024-09-14T10:54:55.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f9659c640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f8802a180 tx=0x7f8f880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88041070 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8803c670 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f98090a00 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88037040 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.315+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f981c4ba0 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.316+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8f88044070 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.316+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f980907c0 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.316+0000 7f8f8effd640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 0x7f8f78040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.316+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8f88073520 con 0x7f8f9812c0b0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.316+0000 7f8f8ffff640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 0x7f8f78040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.317+0000 7f8f8ffff640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 0x7f8f78040a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f80007fd0 tx=0x7f8f80007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.320+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f8f88044c60 con 0x7f8f9812c0b0 2024-09-14T10:54:55.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.536+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8f9812c490 con 0x7f8f9812c0b0 2024-09-14T10:54:55.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.538+0000 7f8f8effd640 1 -- 172.21.15.116:0/337118483 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97908 (secure 0 0 0) 0x7f8f8802ad10 con 0x7f8f9812c0b0 2024-09-14T10:54:55.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:55.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 msgr2=0x7f8f78040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 0x7f8f78040a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8f80007fd0 tx=0x7f8f80007aa0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 msgr2=0x7f8f981c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f8802a180 tx=0x7f8f880046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 shutdown_connections 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8f7803e570 0x7f8f78040a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 --2- 172.21.15.116:0/337118483 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f9812c0b0 0x7f8f981c4660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 >> 172.21.15.116:0/337118483 conn(0x7f8f9809abc0 msgr2=0x7f8f9809c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 shutdown_connections 2024-09-14T10:54:55.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.540+0000 7f8f9cccd640 1 -- 172.21.15.116:0/337118483 wait complete. 2024-09-14T10:54:55.549 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1645614220},{"type":"v1","addr":"172.21.15.164:6825","nonce":1645614220}]},"active_addr":"172.21.15.164:6825/1645614220","active_change":"2024-09-14T10:54:40.051633+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3541868751}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2540938504}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":4159684618}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3611800715}]}]} 2024-09-14T10:54:55.551 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:54:55.551 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:54:55.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:55.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.650+0000 7fabec85a640 1 Processor -- start 2024-09-14T10:54:55.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.650+0000 7fabec85a640 1 -- start start 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabec85a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fabe806efc0 0x7fabe806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabec85a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe8070330 con 0x7fabe806f8e0 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabec85a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fabe809f310 con 0x7fabe806efc0 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe659c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fabe806efc0 0x7fabe806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe5d9b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fabe806f8e0 0x7fabe809b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51002/0 (socket says 172.21.15.116:51002) 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe5d9b640 1 -- 172.21.15.116:0/3303296561 learned_addr learned my addr 172.21.15.116:0/3303296561 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe659c640 1 -- 172.21.15.116:0/3303296561 >> v1:172.21.15.116:6789/0 conn(0x7fabe806f8e0 legacy=0x7fabe809b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe659c640 1 -- 172.21.15.116:0/3303296561 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe8070640 con 0x7fabe806efc0 2024-09-14T10:54:55.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.651+0000 7fabe559a640 1 -- 172.21.15.116:0/3303296561 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035580697 0 0) 0x7fabe8070330 con 0x7fabe806f8e0 2024-09-14T10:54:55.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.652+0000 7fabe659c640 1 --2- 172.21.15.116:0/3303296561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe806f3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009720 tx=0x7fabd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba6452fd378505c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.652+0000 7fabe559a640 1 -- 172.21.15.116:0/3303296561 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0037070 con 0x7fabe806efc0 2024-09-14T10:54:55.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.652+0000 7fabe559a640 1 -- 172.21.15.116:0/3303296561 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd002ad90 con 0x7fabe806efc0 2024-09-14T10:54:55.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.652+0000 7fabe559a640 1 -- 172.21.15.116:0/3303296561 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0032590 con 0x7fabe806efc0 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 -- 172.21.15.116:0/3303296561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 msgr2=0x7fabe806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 --2- 172.21.15.116:0/3303296561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe806f3a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009720 tx=0x7fabd002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 -- 172.21.15.116:0/3303296561 shutdown_connections 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 --2- 172.21.15.116:0/3303296561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe806f3a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 -- 172.21.15.116:0/3303296561 >> 172.21.15.116:0/3303296561 conn(0x7fabe80a2460 msgr2=0x7fabe809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 -- 172.21.15.116:0/3303296561 shutdown_connections 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.653+0000 7fabec85a640 1 -- 172.21.15.116:0/3303296561 wait complete. 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabec85a640 1 Processor -- start 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabec85a640 1 -- start start 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabec85a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabec85a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fabe809f870 con 0x7fabe806efc0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabe659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabe659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34198/0 (socket says 172.21.15.116:34198) 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabe659c640 1 -- 172.21.15.116:0/4179154371 learned_addr learned my addr 172.21.15.116:0/4179154371 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.654+0000 7fabe659c640 1 -- 172.21.15.116:0/4179154371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe8073fe0 con 0x7fabe806efc0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabe659c640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009720 tx=0x7fabd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0041070 con 0x7fabe806efc0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd003c460 con 0x7fabe806efc0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe8090ba0 con 0x7fabe806efc0 2024-09-14T10:54:55.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd0037040 con 0x7fabe806efc0 2024-09-14T10:54:55.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.655+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe80918b0 con 0x7fabe806efc0 2024-09-14T10:54:55.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.656+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fabd0044070 con 0x7fabe806efc0 2024-09-14T10:54:55.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.656+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe806f3a0 con 0x7fabe806efc0 2024-09-14T10:54:55.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.656+0000 7fabdeffd640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 0x7fabc8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.656+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fabd0073580 con 0x7fabe806efc0 2024-09-14T10:54:55.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.656+0000 7fabe5d9b640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 0x7fabc8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.657+0000 7fabe5d9b640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 0x7fabc8040a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fabd8000c00 tx=0x7fabd80078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.661+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fabe80918b0 con 0x7fabe806efc0 2024-09-14T10:54:55.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.833+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabe8092250 con 0x7fabe806efc0 2024-09-14T10:54:55.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.834+0000 7fabdeffd640 1 -- 172.21.15.116:0/4179154371 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9914 (secure 0 0 0) 0x7fabe8073fe0 con 0x7fabe806efc0 2024-09-14T10:54:55.832 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:55.832 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":19,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:54.896629+0000","last_up_change":"2024-09-14T10:54:46.775997+0000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:54:48.071849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:54:51.203142+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6801","nonce":1614093354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6803","nonce":1614093354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6807","nonce":1614093354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6805","nonce":1614093354}]},"public_addr":"172.21.15.116:6801/1614093354","cluster_addr":"172.21.15.116:6803/1614093354","heartbeat_back_addr":"172.21.15.116:6807/1614093354","heartbeat_front_addr":"172.21.15.116:6805/1614093354","state":["exists","up"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6804","nonce":3845281611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6808","nonce":3845281611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6815","nonce":3845281611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6812","nonce":3845281611}]},"public_addr":"172.21.15.164:6804/3845281611","cluster_addr":"172.21.15.164:6808/3845281611","heartbeat_back_addr":"172.21.15.164:6815/3845281611","heartbeat_front_addr":"172.21.15.164:6812/3845281611","state":["exists","up"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6801","nonce":813620551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6805","nonce":813620551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6813","nonce":813620551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6809","nonce":813620551}]},"public_addr":"172.21.15.164:6801/813620551","cluster_addr":"172.21.15.164:6805/813620551","heartbeat_back_addr":"172.21.15.164:6813/813620551","heartbeat_front_addr":"172.21.15.164:6809/813620551","state":["exists","up"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6817","nonce":3361197980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6819","nonce":3361197980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6823","nonce":3361197980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6821","nonce":3361197980}]},"public_addr":"172.21.15.164:6817/3361197980","cluster_addr":"172.21.15.164:6819/3361197980","heartbeat_back_addr":"172.21.15.164:6823/3361197980","heartbeat_front_addr":"172.21.15.164:6821/3361197980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:42.887950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.053178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.353606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 msgr2=0x7fabc8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 0x7fabc8040a30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fabd8000c00 tx=0x7fabd80078d0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 msgr2=0x7fabe812b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009720 tx=0x7fabd00046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 shutdown_connections 2024-09-14T10:54:55.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fabc803e570 0x7fabc8040a30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 --2- 172.21.15.116:0/4179154371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fabe806efc0 0x7fabe812b630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 >> 172.21.15.116:0/4179154371 conn(0x7fabe80a2460 msgr2=0x7fabe809d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 shutdown_connections 2024-09-14T10:54:55.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.836+0000 7fabec85a640 1 -- 172.21.15.116:0/4179154371 wait complete. 2024-09-14T10:54:55.844 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:54:55.845 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea981e2640 1 Processor -- start 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea981e2640 1 -- start start 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea981e2640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fea9006efc0 0x7fea9006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea981e2640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea90070330 con 0x7fea9006f8e0 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea981e2640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fea9009f310 con 0x7fea9006efc0 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.944+0000 7fea95f7e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fea9006efc0 0x7fea9006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.945+0000 7fea9577d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fea9006f8e0 0x7fea9009b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51018/0 (socket says 172.21.15.116:51018) 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.945+0000 7fea9577d640 1 -- 172.21.15.116:0/1877062977 learned_addr learned my addr 172.21.15.116:0/1877062977 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.945+0000 7fea95f7e640 1 -- 172.21.15.116:0/1877062977 >> v1:172.21.15.116:6789/0 conn(0x7fea9006f8e0 legacy=0x7fea9009b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.945+0000 7fea95f7e640 1 -- 172.21.15.116:0/1877062977 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90070640 con 0x7fea9006efc0 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.945+0000 7fea95f7e640 1 --2- 172.21.15.116:0/1877062977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea9006f3a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009720 tx=0x7fea8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce877d2308574c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea94f7c640 1 -- 172.21.15.116:0/1877062977 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c037070 con 0x7fea9006efc0 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea94f7c640 1 -- 172.21.15.116:0/1877062977 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c02ad90 con 0x7fea9006efc0 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea94f7c640 1 -- 172.21.15.116:0/1877062977 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c032590 con 0x7fea9006efc0 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 -- 172.21.15.116:0/1877062977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 msgr2=0x7fea9006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 --2- 172.21.15.116:0/1877062977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea9006f3a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009720 tx=0x7fea8c02a110 comp rx=0 tx=0).stop 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 -- 172.21.15.116:0/1877062977 shutdown_connections 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 --2- 172.21.15.116:0/1877062977 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea9006f3a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 -- 172.21.15.116:0/1877062977 >> 172.21.15.116:0/1877062977 conn(0x7fea900a2460 msgr2=0x7fea9009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 -- 172.21.15.116:0/1877062977 shutdown_connections 2024-09-14T10:54:55.945 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.946+0000 7fea981e2640 1 -- 172.21.15.116:0/1877062977 wait complete. 2024-09-14T10:54:55.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea981e2640 1 Processor -- start 2024-09-14T10:54:55.946 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea981e2640 1 -- start start 2024-09-14T10:54:55.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea981e2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.947 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea981e2640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fea9009f870 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea95f7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea95f7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34206/0 (socket says 172.21.15.116:34206) 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.947+0000 7fea95f7e640 1 -- 172.21.15.116:0/487942621 learned_addr learned my addr 172.21.15.116:0/487942621 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea95f7e640 1 -- 172.21.15.116:0/487942621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90091c50 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea95f7e640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009840 tx=0x7fea8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c041020 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c03d550 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9009b730 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c037040 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.948+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea90090b10 con 0x7fea9006efc0 2024-09-14T10:54:55.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.949+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9006f3a0 con 0x7fea9006efc0 2024-09-14T10:54:55.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.949+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fea8c044020 con 0x7fea9006efc0 2024-09-14T10:54:55.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.949+0000 7fea867fc640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 0x7fea74040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:55.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.949+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fea8c073260 con 0x7fea9006efc0 2024-09-14T10:54:55.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.950+0000 7fea9577d640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 0x7fea74040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:55.949 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.950+0000 7fea9577d640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 0x7fea74040a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea80007fd0 tx=0x7fea80007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:55.951 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:55.953+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fea8c04b030 con 0x7fea9006efc0 2024-09-14T10:54:56.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.129+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea90073fe0 con 0x7fea9006efc0 2024-09-14T10:54:56.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.130+0000 7fea867fc640 1 -- 172.21.15.116:0/487942621 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9914 (secure 0 0 0) 0x7fea8c073020 con 0x7fea9006efc0 2024-09-14T10:54:56.128 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:56.128 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":19,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:54:54.896629+0000","last_up_change":"2024-09-14T10:54:46.775997+0000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:54:48.071849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:54:51.203142+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6801","nonce":1614093354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6803","nonce":1614093354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6807","nonce":1614093354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6805","nonce":1614093354}]},"public_addr":"172.21.15.116:6801/1614093354","cluster_addr":"172.21.15.116:6803/1614093354","heartbeat_back_addr":"172.21.15.116:6807/1614093354","heartbeat_front_addr":"172.21.15.116:6805/1614093354","state":["exists","up"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6804","nonce":3845281611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6808","nonce":3845281611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6815","nonce":3845281611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6812","nonce":3845281611}]},"public_addr":"172.21.15.164:6804/3845281611","cluster_addr":"172.21.15.164:6808/3845281611","heartbeat_back_addr":"172.21.15.164:6815/3845281611","heartbeat_front_addr":"172.21.15.164:6812/3845281611","state":["exists","up"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6801","nonce":813620551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6805","nonce":813620551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6813","nonce":813620551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6809","nonce":813620551}]},"public_addr":"172.21.15.164:6801/813620551","cluster_addr":"172.21.15.164:6805/813620551","heartbeat_back_addr":"172.21.15.164:6813/813620551","heartbeat_front_addr":"172.21.15.164:6809/813620551","state":["exists","up"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6817","nonce":3361197980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6819","nonce":3361197980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6823","nonce":3361197980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6821","nonce":3361197980}]},"public_addr":"172.21.15.164:6817/3361197980","cluster_addr":"172.21.15.164:6819/3361197980","heartbeat_back_addr":"172.21.15.164:6823/3361197980","heartbeat_front_addr":"172.21.15.164:6821/3361197980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:42.887950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.053178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.353606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:54:56.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 msgr2=0x7fea74040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 0x7fea74040a30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fea80007fd0 tx=0x7fea80007aa0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 msgr2=0x7fea900903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009840 tx=0x7fea8c0046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 shutdown_connections 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fea7403e570 0x7fea74040a30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 --2- 172.21.15.116:0/487942621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fea9006efc0 0x7fea900903f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 >> 172.21.15.116:0/487942621 conn(0x7fea900a2460 msgr2=0x7fea9009cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 shutdown_connections 2024-09-14T10:54:56.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.132+0000 7fea981e2640 1 -- 172.21.15.116:0/487942621 wait complete. 2024-09-14T10:54:56.141 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:54:56.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:54:56.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:54:56.142 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:54:56.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7f4201260640 1 Processor -- start 2024-09-14T10:54:56.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fe398bdf640 1 Processor -- start 2024-09-14T10:54:56.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fe02be6e640 1 Processor -- start 2024-09-14T10:54:56.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7f4201260640 1 -- start start 2024-09-14T10:54:56.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fe398bdf640 1 -- start start 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fdbaf02a640 1 Processor -- start 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fdbaf02a640 1 -- start start 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.247+0000 7fe02be6e640 1 -- start start 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f4201260640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f41fc06dfb0 0x7f41fc06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f4201260640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc0729b0 con 0x7f41fc06e8d0 2024-09-14T10:54:56.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f4201260640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f41fc0714b0 con 0x7f41fc06dfb0 2024-09-14T10:54:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe398bdf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe394132850 0x7fe394134c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdbaf02a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdba806efc0 0x7fdba8130e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe398bdf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39412f4e0 con 0x7fe39412f910 2024-09-14T10:54:56.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe398bdf640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fe39409f3f0 con 0x7fe394132850 2024-09-14T10:54:56.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe02be6e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe02412be50 0x7fe02412c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdbaf02a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba806f9f0 con 0x7fdba812be50 2024-09-14T10:54:56.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41fa59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f41fc06e8d0 0x7f41fc097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51022/0 (socket says 172.21.15.116:51022) 2024-09-14T10:54:56.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41fa59c640 1 -- 172.21.15.116:0/3982942247 learned_addr learned my addr 172.21.15.116:0/3982942247 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:56.249 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41fad9d640 1 --2- 172.21.15.116:0/3982942247 >> v2:172.21.15.116:3300/0 conn(0x7f41fc06dfb0 0x7f41fc06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdbaf02a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fdba806f580 con 0x7fdba806efc0 2024-09-14T10:54:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe02be6e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02406f9f0 con 0x7fe02412c770 2024-09-14T10:54:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe02be6e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fe02406f580 con 0x7fe02412be50 2024-09-14T10:54:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdbacdc6640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdba812be50 0x7fdba812c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51030/0 (socket says 172.21.15.116:51030) 2024-09-14T10:54:56.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdbacdc6640 1 -- 172.21.15.116:0/1500012924 learned_addr learned my addr 172.21.15.116:0/1500012924 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe391d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe394132850 0x7fe394134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe029c0a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe02412be50 0x7fe02412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe391d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe394132850 0x7fe394134c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34230/0 (socket says 172.21.15.116:34230) 2024-09-14T10:54:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe391d9b640 1 -- 172.21.15.116:0/3306763153 learned_addr learned my addr 172.21.15.116:0/3306763153 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fdba7fff640 1 --2- 172.21.15.116:0/1500012924 >> v2:172.21.15.116:3300/0 conn(0x7fdba806efc0 0x7fdba8130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe029c0a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe02412be50 0x7fe02412c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34232/0 (socket says 172.21.15.116:34232) 2024-09-14T10:54:56.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7fe029c0a640 1 -- 172.21.15.116:0/2777483458 learned_addr learned my addr 172.21.15.116:0/2777483458 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41f9d9b640 1 -- 172.21.15.116:0/3982942247 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123022697 0 0) 0x7f41f0001110 con 0x7f41fc06e8d0 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41f9d9b640 1 -- 172.21.15.116:0/3982942247 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e4003520 con 0x7f41fc06e8d0 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.248+0000 7f41fad9d640 1 -- 172.21.15.116:0/3982942247 >> v1:172.21.15.116:6789/0 conn(0x7f41fc06e8d0 legacy=0x7f41fc097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7f41fad9d640 1 -- 172.21.15.116:0/3982942247 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc0725f0 con 0x7f41fc06dfb0 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fe391d9b640 1 -- 172.21.15.116:0/3306763153 >> v1:172.21.15.116:6789/0 conn(0x7fe39412f910 legacy=0x7fe39412fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-14T10:54:56.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fe391d9b640 1 -- 172.21.15.116:0/3306763153 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe394130400 con 0x7fe394132850 2024-09-14T10:54:56.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fe029c0a640 1 -- 172.21.15.116:0/2777483458 >> v1:172.21.15.116:6789/0 conn(0x7fe02412c770 legacy=0x7fe02406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fe029c0a640 1 -- 172.21.15.116:0/2777483458 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe024070f50 con 0x7fe02412be50 2024-09-14T10:54:56.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fdba7fff640 1 -- 172.21.15.116:0/1500012924 >> v1:172.21.15.116:6789/0 conn(0x7fdba812be50 legacy=0x7fdba812c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.249+0000 7fdba7fff640 1 -- 172.21.15.116:0/1500012924 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba8070f50 con 0x7fdba806efc0 2024-09-14T10:54:56.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe391d9b640 1 --2- 172.21.15.116:0/3306763153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe394132850 0x7fe394134c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe39409f570 tx=0x7fe38802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b02a82eead56a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7f41fad9d640 1 --2- 172.21.15.116:0/3982942247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc06e390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009750 tx=0x7f41ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7891dfe97ffa6b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe029c0a640 1 --2- 172.21.15.116:0/2777483458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe02412c230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe02000ba90 tx=0x7fe02002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d96aede69275fa server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe39159a640 1 -- 172.21.15.116:0/3306763153 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388037070 con 0x7fe394132850 2024-09-14T10:54:56.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe39159a640 1 -- 172.21.15.116:0/3306763153 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38802ae40 con 0x7fe394132850 2024-09-14T10:54:56.255 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fdba7fff640 1 --2- 172.21.15.116:0/1500012924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba8130e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009720 tx=0x7fdb9402e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1d2bbc0dd036d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe39159a640 1 -- 172.21.15.116:0/3306763153 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388032590 con 0x7fe394132850 2024-09-14T10:54:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7f41f9d9b640 1 -- 172.21.15.116:0/3982942247 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec037070 con 0x7f41fc06dfb0 2024-09-14T10:54:56.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7f41f9d9b640 1 -- 172.21.15.116:0/3982942247 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ec02ae20 con 0x7f41fc06dfb0 2024-09-14T10:54:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe028c08640 1 -- 172.21.15.116:0/2777483458 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020033570 con 0x7fe02412be50 2024-09-14T10:54:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe028c08640 1 -- 172.21.15.116:0/2777483458 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020038070 con 0x7fe02412be50 2024-09-14T10:54:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fdba77fe640 1 -- 172.21.15.116:0/1500012924 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb9403a070 con 0x7fdba806efc0 2024-09-14T10:54:56.257 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fe028c08640 1 -- 172.21.15.116:0/2777483458 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020033860 con 0x7fe02412be50 2024-09-14T10:54:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fdba77fe640 1 -- 172.21.15.116:0/1500012924 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb94033640 con 0x7fdba806efc0 2024-09-14T10:54:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7fdba77fe640 1 -- 172.21.15.116:0/1500012924 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb9403a070 con 0x7fdba806efc0 2024-09-14T10:54:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.250+0000 7f41f9d9b640 1 -- 172.21.15.116:0/3982942247 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec032570 con 0x7f41fc06dfb0 2024-09-14T10:54:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 -- 172.21.15.116:0/3306763153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe394132850 msgr2=0x7fe394134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.258 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 --2- 172.21.15.116:0/3306763153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe394132850 0x7fe394134c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe39409f570 tx=0x7fe38802a1c0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 -- 172.21.15.116:0/3982942247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 msgr2=0x7f41fc06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 --2- 172.21.15.116:0/3982942247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc06e390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009750 tx=0x7f41ec02a1e0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 -- 172.21.15.116:0/2777483458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 msgr2=0x7fe02412c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.259 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 --2- 172.21.15.116:0/2777483458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe02412c230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe02000ba90 tx=0x7fe02002c8b0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 -- 172.21.15.116:0/3306763153 shutdown_connections 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 --2- 172.21.15.116:0/3306763153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe394132850 0x7fe394134c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 -- 172.21.15.116:0/3306763153 >> 172.21.15.116:0/3306763153 conn(0x7fe3940a2540 msgr2=0x7fe39409ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 -- 172.21.15.116:0/1500012924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 msgr2=0x7fdba8130e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/1500012924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba8130e20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009720 tx=0x7fdb9402e650 comp rx=0 tx=0).stop 2024-09-14T10:54:56.260 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 -- 172.21.15.116:0/2777483458 shutdown_connections 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 -- 172.21.15.116:0/3982942247 shutdown_connections 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 --2- 172.21.15.116:0/3982942247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc06e390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 -- 172.21.15.116:0/3982942247 >> 172.21.15.116:0/3982942247 conn(0x7f41fc09abc0 msgr2=0x7f41fc098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 -- 172.21.15.116:0/3982942247 shutdown_connections 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7f4201260640 1 -- 172.21.15.116:0/3982942247 wait complete. 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 --2- 172.21.15.116:0/2777483458 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe02412c230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.261 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 -- 172.21.15.116:0/2777483458 >> 172.21.15.116:0/2777483458 conn(0x7fe02409abc0 msgr2=0x7fe024098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 -- 172.21.15.116:0/1500012924 shutdown_connections 2024-09-14T10:54:56.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/1500012924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba8130e20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 -- 172.21.15.116:0/1500012924 >> 172.21.15.116:0/1500012924 conn(0x7fdba809abc0 msgr2=0x7fdba8098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 -- 172.21.15.116:0/3306763153 shutdown_connections 2024-09-14T10:54:56.262 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 -- 172.21.15.116:0/1500012924 shutdown_connections 2024-09-14T10:54:56.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 -- 172.21.15.116:0/2777483458 shutdown_connections 2024-09-14T10:54:56.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fdbaf02a640 1 -- 172.21.15.116:0/1500012924 wait complete. 2024-09-14T10:54:56.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe398bdf640 1 -- 172.21.15.116:0/3306763153 wait complete. 2024-09-14T10:54:56.263 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.251+0000 7fe02be6e640 1 -- 172.21.15.116:0/2777483458 wait complete. 2024-09-14T10:54:56.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.252+0000 7fdbaf02a640 1 Processor -- start 2024-09-14T10:54:56.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.252+0000 7fdbaf02a640 1 -- start start 2024-09-14T10:54:56.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.252+0000 7fe398bdf640 1 Processor -- start 2024-09-14T10:54:56.264 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.252+0000 7fe398bdf640 1 -- start start 2024-09-14T10:54:56.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f4201260640 1 Processor -- start 2024-09-14T10:54:56.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe02be6e640 1 Processor -- start 2024-09-14T10:54:56.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f4201260640 1 -- start start 2024-09-14T10:54:56.265 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbaf02a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe02be6e640 1 -- start start 2024-09-14T10:54:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbaf02a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fdba8099bb0 con 0x7fdba806efc0 2024-09-14T10:54:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbacdc6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbacdc6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34240/0 (socket says 172.21.15.116:34240) 2024-09-14T10:54:56.266 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbacdc6640 1 -- 172.21.15.116:0/3740037200 learned_addr learned my addr 172.21.15.116:0/3740037200 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe398bdf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe398bdf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe394135180 con 0x7fe39412f910 2024-09-14T10:54:56.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe39259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe39259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34250/0 (socket says 172.21.15.116:34250) 2024-09-14T10:54:56.267 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fe39259c640 1 -- 172.21.15.116:0/1289319942 learned_addr learned my addr 172.21.15.116:0/1289319942 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f4201260640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f4201260640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc071d70 con 0x7f41fc06dfb0 2024-09-14T10:54:56.268 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbacdc6640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba812b220 con 0x7fdba806efc0 2024-09-14T10:54:56.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f41fad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f41fad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34256/0 (socket says 172.21.15.116:34256) 2024-09-14T10:54:56.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7f41fad9d640 1 -- 172.21.15.116:0/3734387012 learned_addr learned my addr 172.21.15.116:0/3734387012 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.253+0000 7fdbacdc6640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c450 tx=0x7fdb9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.269 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe39259c640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3940712c0 con 0x7fe39412f910 2024-09-14T10:54:56.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c017070 con 0x7fdba806efc0 2024-09-14T10:54:56.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba808e9c0 con 0x7fdba806efc0 2024-09-14T10:54:56.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe39259c640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c3b0 tx=0x7fe38400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7f41fad9d640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc08c980 con 0x7f41fc06dfb0 2024-09-14T10:54:56.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb9c005c10 con 0x7fdba806efc0 2024-09-14T10:54:56.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba81c0590 con 0x7fdba806efc0 2024-09-14T10:54:56.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb9c0070d0 con 0x7fdba806efc0 2024-09-14T10:54:56.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7f41fad9d640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41ec035040 tx=0x7f41ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3840116c0 con 0x7fe39412f910 2024-09-14T10:54:56.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3940715b0 con 0x7fe39412f910 2024-09-14T10:54:56.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe02be6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe02be6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe024099f40 con 0x7fe02412be50 2024-09-14T10:54:56.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe394128630 con 0x7fe39412f910 2024-09-14T10:54:56.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe029c0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe029c0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34270/0 (socket says 172.21.15.116:34270) 2024-09-14T10:54:56.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.254+0000 7fe029c0a640 1 -- 172.21.15.116:0/4094497708 learned_addr learned my addr 172.21.15.116:0/4094497708 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe384017070 con 0x7fe39412f910 2024-09-14T10:54:56.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe384011860 con 0x7fe39412f910 2024-09-14T10:54:56.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdba80737f0 con 0x7fdba806efc0 2024-09-14T10:54:56.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe378000f80 con 0x7fe39412f910 2024-09-14T10:54:56.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec037040 con 0x7f41fc06dfb0 2024-09-14T10:54:56.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fe029c0a640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02408e330 con 0x7fe02412be50 2024-09-14T10:54:56.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc096ea0 con 0x7f41fc06dfb0 2024-09-14T10:54:56.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc08df10 con 0x7f41fc06dfb0 2024-09-14T10:54:56.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fe029c0a640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe02000ba90 tx=0x7fe0200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.255+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fdb9c01a070 con 0x7fdba806efc0 2024-09-14T10:54:56.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ec0093c0 con 0x7f41fc06dfb0 2024-09-14T10:54:56.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba57fa640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 0x7fdb8c0409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41ec004030 con 0x7f41fc06dfb0 2024-09-14T10:54:56.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fdb9c051fa0 con 0x7fdba806efc0 2024-09-14T10:54:56.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe384011a00 con 0x7fe39412f910 2024-09-14T10:54:56.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba57fa640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 0x7fdb8c046120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb8c0467f0 con 0x7fdb8c043ca0 2024-09-14T10:54:56.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba7fff640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 0x7fdb8c0409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdb9c00e280 con 0x7fdba806efc0 2024-09-14T10:54:56.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe382ffd640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 0x7fe3740409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fdbad5c7640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 0x7fdb8c046120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fe384052850 con 0x7fe39412f910 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe382ffd640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 0x7fe374046120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe391d9b640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 0x7fe3740409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe384012e50 con 0x7fe374043ca0 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020046520 con 0x7fe02412be50 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.256+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41dc000f80 con 0x7f41fc06dfb0 2024-09-14T10:54:56.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02412aef0 con 0x7fe02412be50 2024-09-14T10:54:56.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe392d9d640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 0x7fe374046120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02408d5f0 con 0x7fe02412be50 2024-09-14T10:54:56.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fdba7fff640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 0x7fdb8c0409e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdb94037000 tx=0x7fdb94008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fdbad5c7640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 0x7fdb8c046120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200466c0 con 0x7fe02412be50 2024-09-14T10:54:56.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200469c0 con 0x7fe02412be50 2024-09-14T10:54:56.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f41ec03a070 con 0x7f41fc06dfb0 2024-09-14T10:54:56.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe02409d210 con 0x7fe02412be50 2024-09-14T10:54:56.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe391d9b640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 0x7fe3740409e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe388034000 tx=0x7fe38802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb8c0467f0 con 0x7fdb8c043ca0 2024-09-14T10:54:56.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.257+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe384010ac0 con 0x7fe39412f910 2024-09-14T10:54:56.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe392d9d640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 0x7fe374046120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe02004d060 con 0x7fe02412be50 2024-09-14T10:54:56.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41e37fe640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 0x7f41e8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 0x7fe008040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.283 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f41ec073390 con 0x7f41fc06dfb0 2024-09-14T10:54:56.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fe020075590 con 0x7fe02412be50 2024-09-14T10:54:56.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41e37fe640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 0x7f41e80461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41ec047e50 con 0x7f41e8043d40 2024-09-14T10:54:56.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f41ec07a050 con 0x7f41fc06dfb0 2024-09-14T10:54:56.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 0x7fe008046170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41fa59c640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 0x7f41e8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe020044ec0 con 0x7fe008043cf0 2024-09-14T10:54:56.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe02007c050 con 0x7fe02412be50 2024-09-14T10:54:56.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41fb59e640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 0x7f41e80461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe029409640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 0x7fe008040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7fe02a40b640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 0x7fe008046170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.258+0000 7f41fb59e640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 0x7f41e80461c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe384012e50 con 0x7fe374043ca0 2024-09-14T10:54:56.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7f41fa59c640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 0x7f41e8040a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f41f0001680 tx=0x7f41f0001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7fe02a40b640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 0x7fe008046170 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7fe029409640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 0x7fe008040a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe014001600 tx=0x7fe0140079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41ec047e50 con 0x7f41e8043d40 2024-09-14T10:54:56.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.259+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe020044ec0 con 0x7fe008043cf0 2024-09-14T10:54:56.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.272+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdba808dd70 con 0x7fdb8c043ca0 2024-09-14T10:54:56.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.272+0000 7fdba57fa640 1 -- 172.21.15.116:0/3740037200 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdba000ad10 con 0x7fdb8c043ca0 2024-09-14T10:54:56.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.272+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 msgr2=0x7fdb8c046120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.272+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 0x7fdb8c046120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.272+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe378002c70 con 0x7fe374043ca0 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 msgr2=0x7fdb8c0409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 0x7fdb8c0409e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdb94037000 tx=0x7fdb94008030 comp rx=0 tx=0).stop 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 msgr2=0x7fdba81c0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00c450 tx=0x7fdb9c00c910 comp rx=0 tx=0).stop 2024-09-14T10:54:56.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41dc002c70 con 0x7f41e8043d40 2024-09-14T10:54:56.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe382ffd640 1 -- 172.21.15.116:0/1289319942 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe378002c70 con 0x7fe374043ca0 2024-09-14T10:54:56.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 shutdown_connections 2024-09-14T10:54:56.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7fdb8c043ca0 0x7fdb8c046120 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdb8c03e520 0x7fdb8c0409e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 --2- 172.21.15.116:0/3740037200 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdba806efc0 0x7fdba81c0050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 >> 172.21.15.116:0/3740037200 conn(0x7fdba809abc0 msgr2=0x7fdba809c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 shutdown_connections 2024-09-14T10:54:56.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fdbaf02a640 1 -- 172.21.15.116:0/3740037200 wait complete. 2024-09-14T10:54:56.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f41e37fe640 1 -- 172.21.15.116:0/3734387012 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41dc002c70 con 0x7f41e8043d40 2024-09-14T10:54:56.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 msgr2=0x7fe374046120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 0x7fe374046120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 msgr2=0x7fe3740409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 msgr2=0x7f41e80461c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 0x7f41e80461c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 0x7fe3740409e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe388034000 tx=0x7fe38802e000 comp rx=0 tx=0).stop 2024-09-14T10:54:56.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 msgr2=0x7fe394127f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c3b0 tx=0x7fe38400c870 comp rx=0 tx=0).stop 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 msgr2=0x7f41e8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.273+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 0x7f41e8040a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f41f0001680 tx=0x7f41f0001250 comp rx=0 tx=0).stop 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 msgr2=0x7f41fc129820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41ec035040 tx=0x7f41ec0046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 shutdown_connections 2024-09-14T10:54:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f41e8043d40 0x7f41e80461c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 shutdown_connections 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7fe374043ca0 0x7fe374046120 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe37403e520 0x7fe3740409e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 --2- 172.21.15.116:0/1289319942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe39412f910 0x7fe394127f10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f41e803e5c0 0x7f41e8040a80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 --2- 172.21.15.116:0/3734387012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f41fc06dfb0 0x7f41fc129820 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 >> 172.21.15.116:0/1289319942 conn(0x7fe3940a2540 msgr2=0x7fe39406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 shutdown_connections 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe398bdf640 1 -- 172.21.15.116:0/1289319942 wait complete. 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 >> 172.21.15.116:0/3734387012 conn(0x7f41fc09abc0 msgr2=0x7f41fc12db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 shutdown_connections 2024-09-14T10:54:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7f4201260640 1 -- 172.21.15.116:0/3734387012 wait complete. 2024-09-14T10:54:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.274+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe02412c230 con 0x7fe008043cf0 2024-09-14T10:54:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe01a7fc640 1 -- 172.21.15.116:0/4094497708 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe02412c230 con 0x7fe008043cf0 2024-09-14T10:54:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 msgr2=0x7fe008046170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 0x7fe008046170 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 msgr2=0x7fe008040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 0x7fe008040a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe014001600 tx=0x7fe0140079f0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 msgr2=0x7fe0241bfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe02000ba90 tx=0x7fe0200046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 shutdown_connections 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe008043cf0 0x7fe008046170 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00803e570 0x7fe008040a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 --2- 172.21.15.116:0/4094497708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe02412be50 0x7fe0241bfcd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 >> 172.21.15.116:0/4094497708 conn(0x7fe02409abc0 msgr2=0x7fe02409c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 shutdown_connections 2024-09-14T10:54:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.275+0000 7fe02be6e640 1 -- 172.21.15.116:0/4094497708 wait complete. 2024-09-14T10:54:56.304 INFO:teuthology.orchestra.run.smithi116.stdout:47244640262 2024-09-14T10:54:56.304 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:54:56.305 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T10:54:56.305 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:54:56.306 INFO:teuthology.orchestra.run.smithi116.stdout:38654705670 2024-09-14T10:54:56.306 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:54:56.307 INFO:teuthology.orchestra.run.smithi116.stdout:47244640260 2024-09-14T10:54:56.307 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:54:56.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.450+0000 7f7c00989640 1 Processor -- start 2024-09-14T10:54:56.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f7c00989640 1 -- start start 2024-09-14T10:54:56.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fa3df0d6640 1 Processor -- start 2024-09-14T10:54:56.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0ce16b640 1 Processor -- start 2024-09-14T10:54:56.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fa3df0d6640 1 -- start start 2024-09-14T10:54:56.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0ce16b640 1 -- start start 2024-09-14T10:54:56.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f6062189640 1 Processor -- start 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fa3df0d6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa3d8071310 0x7fa3d80716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fa3df0d6640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d80724c0 con 0x7fa3d8071c30 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f6062189640 1 -- start start 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f7c00989640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bfc128980 0x7f7bfc1309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f7c00989640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc06f8e0 con 0x7f7bfc127e90 2024-09-14T10:54:56.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7f7c00989640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0702c0 con 0x7f7bfc128980 2024-09-14T10:54:56.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fa3df0d6640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d809c2e0 con 0x7fa3d8071310 2024-09-14T10:54:56.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0ce16b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0c812cba0 0x7fc0c81315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0ce16b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c8099e20 con 0x7fc0c812c0b0 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0ce16b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c80715a0 con 0x7fc0c812cba0 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0c6ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0c812cba0 0x7fc0c81315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0c6ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc0c812cba0 0x7fc0c81315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34284/0 (socket says 172.21.15.116:34284) 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0c6ffd640 1 -- 172.21.15.116:0/1204744545 learned_addr learned my addr 172.21.15.116:0/1204744545 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.451+0000 7fc0c77fe640 1 --1- 172.21.15.116:0/1204744545 >> v1:172.21.15.116:6789/0 conn(0x7fc0c812c0b0 0x7fc0c812c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51066/0 (socket says 172.21.15.116:51066) 2024-09-14T10:54:56.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3d7fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa3d8071c30 0x7fa3d8096080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51078/0 (socket says 172.21.15.116:51078) 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f7bf9d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7bfc128980 0x7f7bfc1309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f7bfa59c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7bfc127e90 0x7f7bfc128270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51068/0 (socket says 172.21.15.116:51068) 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f7bfa59c640 1 -- 172.21.15.116:0/2297422138 learned_addr learned my addr 172.21.15.116:0/2297422138 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3dce72640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa3d8071310 0x7fa3d80716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3d7fff640 1 -- 172.21.15.116:0/2275063178 learned_addr learned my addr 172.21.15.116:0/2275063178 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:56.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f6062189640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f605c095dc0 0x7f605c0961a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fc0c6ffd640 1 -- 172.21.15.116:0/1204744545 >> v1:172.21.15.116:6789/0 conn(0x7fc0c812c0b0 legacy=0x7fc0c812c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fc0c6ffd640 1 -- 172.21.15.116:0/1204744545 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c80705b0 con 0x7fc0c812cba0 2024-09-14T10:54:56.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f7bf9d9b640 1 -- 172.21.15.116:0/2297422138 >> v1:172.21.15.116:6789/0 conn(0x7f7bfc127e90 legacy=0x7f7bfc128270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f7bf9d9b640 1 -- 172.21.15.116:0/2297422138 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc099e20 con 0x7f7bfc128980 2024-09-14T10:54:56.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f6062189640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c096ee0 con 0x7f605c0966e0 2024-09-14T10:54:56.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3d77fe640 1 -- 172.21.15.116:0/2275063178 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845560841 0 0) 0x7fa3d80724c0 con 0x7fa3d8071c30 2024-09-14T10:54:56.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3d77fe640 1 -- 172.21.15.116:0/2275063178 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3c8003520 con 0x7fa3d8071c30 2024-09-14T10:54:56.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f6062189640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f605c075c80 con 0x7f605c095dc0 2024-09-14T10:54:56.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3dce72640 1 -- 172.21.15.116:0/2275063178 >> v1:172.21.15.116:6789/0 conn(0x7fa3d8071c30 legacy=0x7fa3d8096080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f605affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f605c0966e0 0x7f605c133d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51088/0 (socket says 172.21.15.116:51088) 2024-09-14T10:54:56.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f605affd640 1 -- 172.21.15.116:0/1728169180 learned_addr learned my addr 172.21.15.116:0/1728169180 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:56.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7fa3dce72640 1 -- 172.21.15.116:0/2275063178 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d809be60 con 0x7fa3d8071310 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f605b7fe640 1 --2- 172.21.15.116:0/1728169180 >> v2:172.21.15.116:3300/0 conn(0x7f605c095dc0 0x7f605c0961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226443977 0 0) 0x7f605c096ee0 con 0x7f605c0966e0 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.452+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6044003520 con 0x7f605c0966e0 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2927235409 0 0) 0x7f6044003520 con 0x7f605c0966e0 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 >> v2:172.21.15.116:3300/0 conn(0x7f605c095dc0 msgr2=0x7f605c0961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 --2- 172.21.15.116:0/1728169180 >> v2:172.21.15.116:3300/0 conn(0x7f605c095dc0 0x7f605c0961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c097100 con 0x7f605c0966e0 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 268910272 0 0) 0x7f6050001620 con 0x7f605c0966e0 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 >> v1:172.21.15.116:6789/0 conn(0x7f605c0966e0 legacy=0x7f605c133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 --2- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f6044003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f605c075c80 con 0x7f6044003aa0 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fc0c6ffd640 1 --2- 172.21.15.116:0/1204744545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812cba0 0x7fc0c81315e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009820 tx=0x7fc0bc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4690beddf7841527 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605b7fe640 1 --2- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f6044003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f7bf9d9b640 1 --2- 172.21.15.116:0/2297422138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc128980 0x7f7bfc1309d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009720 tx=0x7f7be402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1cbe152b97745f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fa3dce72640 1 --2- 172.21.15.116:0/2275063178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d80716f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009720 tx=0x7fa3cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2777fc694ed95d22 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fc0c67fc640 1 -- 172.21.15.116:0/1204744545 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc037070 con 0x7fc0c812cba0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fc0c67fc640 1 -- 172.21.15.116:0/1204744545 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0bc02ae50 con 0x7fc0c812cba0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fc0c67fc640 1 -- 172.21.15.116:0/1204744545 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0bc032590 con 0x7fc0c812cba0 2024-09-14T10:54:56.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7f605b7fe640 1 -- 172.21.15.116:0/1728169180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6044003520 con 0x7f6044003aa0 2024-09-14T10:54:56.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fa3d77fe640 1 -- 172.21.15.116:0/2275063178 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3cc037070 con 0x7fa3d8071310 2024-09-14T10:54:56.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fa3d77fe640 1 -- 172.21.15.116:0/2275063178 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc02ae20 con 0x7fa3d8071310 2024-09-14T10:54:56.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.453+0000 7fa3d77fe640 1 -- 172.21.15.116:0/2275063178 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3cc037070 con 0x7fa3d8071310 2024-09-14T10:54:56.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2275063178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 msgr2=0x7fa3d80716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2275063178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d80716f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009720 tx=0x7fa3cc02a1a0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7f7bf959a640 1 -- 172.21.15.116:0/2297422138 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be4037070 con 0x7f7bfc128980 2024-09-14T10:54:56.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fc0ce16b640 1 -- 172.21.15.116:0/1204744545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812cba0 msgr2=0x7fc0c81315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2275063178 shutdown_connections 2024-09-14T10:54:56.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2275063178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d80716f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2275063178 >> 172.21.15.116:0/2275063178 conn(0x7fa3d809cb40 msgr2=0x7fa3d809cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/1204744545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812cba0 0x7fc0c81315e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009820 tx=0x7fc0bc02a210 comp rx=0 tx=0).stop 2024-09-14T10:54:56.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7f7bf959a640 1 -- 172.21.15.116:0/2297422138 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be402ae20 con 0x7f7bfc128980 2024-09-14T10:54:56.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7f605b7fe640 1 --2- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f6044003ea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f604c009a40 tx=0x7f6044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7b4761115f9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7f7bf959a640 1 -- 172.21.15.116:0/2297422138 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be4032590 con 0x7f7bfc128980 2024-09-14T10:54:56.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2275063178 shutdown_connections 2024-09-14T10:54:56.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2275063178 wait complete. 2024-09-14T10:54:56.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fc0ce16b640 1 -- 172.21.15.116:0/1204744545 shutdown_connections 2024-09-14T10:54:56.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/1204744545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812cba0 0x7fc0c81315e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7fc0ce16b640 1 -- 172.21.15.116:0/1204744545 >> 172.21.15.116:0/1204744545 conn(0x7fc0c809abc0 msgr2=0x7fc0c8098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.454+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604c036070 con 0x7f6044003aa0 2024-09-14T10:54:56.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c031530 con 0x7f6044003aa0 2024-09-14T10:54:56.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f605a7fc640 1 -- 172.21.15.116:0/1728169180 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604c009690 con 0x7f6044003aa0 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7fc0ce16b640 1 -- 172.21.15.116:0/1204744545 shutdown_connections 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7fc0ce16b640 1 -- 172.21.15.116:0/1204744545 wait complete. 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 -- 172.21.15.116:0/2297422138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc128980 msgr2=0x7f7bfc1309d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 --2- 172.21.15.116:0/2297422138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc128980 0x7f7bfc1309d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009720 tx=0x7f7be402a1a0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 -- 172.21.15.116:0/2297422138 shutdown_connections 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 --2- 172.21.15.116:0/2297422138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc128980 0x7f7bfc1309d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 -- 172.21.15.116:0/2297422138 >> 172.21.15.116:0/2297422138 conn(0x7f7bfc09abc0 msgr2=0x7f7bfc098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7fa3df0d6640 1 Processor -- start 2024-09-14T10:54:56.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 -- 172.21.15.116:0/2297422138 shutdown_connections 2024-09-14T10:54:56.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f7c00989640 1 -- 172.21.15.116:0/2297422138 wait complete. 2024-09-14T10:54:56.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7fa3df0d6640 1 -- start start 2024-09-14T10:54:56.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 -- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 msgr2=0x7f6044003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 --2- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f6044003ea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f604c009a40 tx=0x7f6044005830 comp rx=0 tx=0).stop 2024-09-14T10:54:56.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 -- 172.21.15.116:0/1728169180 shutdown_connections 2024-09-14T10:54:56.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 --2- 172.21.15.116:0/1728169180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f6044003ea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 --2- 172.21.15.116:0/1728169180 >> v2:172.21.15.116:3300/0 conn(0x7f605c095dc0 0x7f605c0961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 -- 172.21.15.116:0/1728169180 >> 172.21.15.116:0/1728169180 conn(0x7f605c09e7e0 msgr2=0x7f605c09ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.455+0000 7f6062189640 1 -- 172.21.15.116:0/1728169180 shutdown_connections 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7f6062189640 1 -- 172.21.15.116:0/1728169180 wait complete. 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3df0d6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3df0d6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8096910 con 0x7fa3d8071310 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3dce72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3dce72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34332/0 (socket says 172.21.15.116:34332) 2024-09-14T10:54:56.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3dce72640 1 -- 172.21.15.116:0/2299295739 learned_addr learned my addr 172.21.15.116:0/2299295739 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fc0ce16b640 1 Processor -- start 2024-09-14T10:54:56.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fc0ce16b640 1 -- start start 2024-09-14T10:54:56.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7f7c00989640 1 Processor -- start 2024-09-14T10:54:56.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7f7c00989640 1 -- start start 2024-09-14T10:54:56.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f6062189640 1 Processor -- start 2024-09-14T10:54:56.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3dce72640 1 -- 172.21.15.116:0/2299295739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d8070a10 con 0x7fa3d8071310 2024-09-14T10:54:56.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.456+0000 7fa3dce72640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc02a1e0 tx=0x7fa3cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7c00989640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3cc037070 con 0x7fa3d8071310 2024-09-14T10:54:56.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc004030 con 0x7fa3d8071310 2024-09-14T10:54:56.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3cc006e10 con 0x7fa3d8071310 2024-09-14T10:54:56.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d80979d0 con 0x7fa3d8071310 2024-09-14T10:54:56.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fc0ce16b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7c00989640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc070840 con 0x7f7bfc127e90 2024-09-14T10:54:56.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d8098970 con 0x7fa3d8071310 2024-09-14T10:54:56.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f6062189640 1 -- start start 2024-09-14T10:54:56.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7bfa59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fc0ce16b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c806dfb0 con 0x7fc0c812c0b0 2024-09-14T10:54:56.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7bfa59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34334/0 (socket says 172.21.15.116:34334) 2024-09-14T10:54:56.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7bfa59c640 1 -- 172.21.15.116:0/2770858306 learned_addr learned my addr 172.21.15.116:0/2770858306 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fc0c77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fc0c77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34348/0 (socket says 172.21.15.116:34348) 2024-09-14T10:54:56.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7fc0c77fe640 1 -- 172.21.15.116:0/3909746828 learned_addr learned my addr 172.21.15.116:0/3909746828 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.457+0000 7f7bfa59c640 1 -- 172.21.15.116:0/2770858306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc125730 con 0x7f7bfc127e90 2024-09-14T10:54:56.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7bfa59c640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c450 tx=0x7f7bec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f6062189640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f6062189640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1345a0 con 0x7f6044003aa0 2024-09-14T10:54:56.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bec017070 con 0x7f7bfc127e90 2024-09-14T10:54:56.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d80724c0 con 0x7fa3d8071310 2024-09-14T10:54:56.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fc0c77fe640 1 -- 172.21.15.116:0/3909746828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c8137d00 con 0x7fc0c812c0b0 2024-09-14T10:54:56.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fc0c77fe640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c450 tx=0x7fc0b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec005c10 con 0x7f7bfc127e90 2024-09-14T10:54:56.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bec0070d0 con 0x7f7bfc127e90 2024-09-14T10:54:56.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f605b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f605b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34356/0 (socket says 172.21.15.116:34356) 2024-09-14T10:54:56.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f605b7fe640 1 -- 172.21.15.116:0/1658263511 learned_addr learned my addr 172.21.15.116:0/1658263511 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:56.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc073b00 con 0x7f7bfc127e90 2024-09-14T10:54:56.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa3cc004330 con 0x7fa3d8071310 2024-09-14T10:54:56.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc071f50 con 0x7f7bfc127e90 2024-09-14T10:54:56.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b8007410 con 0x7fc0c812c0b0 2024-09-14T10:54:56.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c8138c30 con 0x7fc0c812c0b0 2024-09-14T10:54:56.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c8123110 con 0x7fc0c812c0b0 2024-09-14T10:54:56.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7f605b7fe640 1 -- 172.21.15.116:0/1658263511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c08efc0 con 0x7f6044003aa0 2024-09-14T10:54:56.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.458+0000 7fa3d57fa640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 0x7fa3bc040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fa3cc073370 con 0x7fa3d8071310 2024-09-14T10:54:56.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7f605b7fe640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7fa3d7fff640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 0x7fa3bc040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b80075b0 con 0x7fc0c812c0b0 2024-09-14T10:54:56.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0b8004950 con 0x7fc0c812c0b0 2024-09-14T10:54:56.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7fa3d7fff640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 0x7fa3bc040a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4001610 tx=0x7fa3c40078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.459+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc128270 con 0x7f7bfc127e90 2024-09-14T10:54:56.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.460+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a8005080 con 0x7fc0c812c0b0 2024-09-14T10:54:56.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.463+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604c041020 con 0x7f6044003aa0 2024-09-14T10:54:56.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.463+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c08fc30 con 0x7f6044003aa0 2024-09-14T10:54:56.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.463+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fa3cc043020 con 0x7fa3d8071310 2024-09-14T10:54:56.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.463+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c091f60 con 0x7f6044003aa0 2024-09-14T10:54:56.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.464+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7bec01a070 con 0x7f7bfc127e90 2024-09-14T10:54:56.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.464+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc0b8004af0 con 0x7fc0c812c0b0 2024-09-14T10:54:56.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.464+0000 7f7bf2ffd640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 0x7f7bdc040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.464+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f7bec052310 con 0x7f7bfc127e90 2024-09-14T10:54:56.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.464+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f604c009750 con 0x7f6044003aa0 2024-09-14T10:54:56.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604c036040 con 0x7f6044003aa0 2024-09-14T10:54:56.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7fc0affff640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 0x7fc0b4040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fc0b8052a10 con 0x7fc0c812c0b0 2024-09-14T10:54:56.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7f7bf9d9b640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 0x7f7bdc040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7fc0c6ffd640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 0x7fc0b4040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603c005080 con 0x7f6044003aa0 2024-09-14T10:54:56.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f604c044020 con 0x7f6044003aa0 2024-09-14T10:54:56.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.465+0000 7f6043fff640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 0x7f60480409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:56.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.466+0000 7fc0c6ffd640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 0x7fc0b4040a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009820 tx=0x7fc0bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.466+0000 7f605affd640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 0x7f60480409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:56.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.466+0000 7f7bf9d9b640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 0x7f7bdc040a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7be4034000 tx=0x7f7be402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.466+0000 7f605affd640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 0x7f60480409e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60500078d0 tx=0x7f6050001530 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:56.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.469+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f7bec021020 con 0x7f7bfc127e90 2024-09-14T10:54:56.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.473+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f604c00f040 con 0x7f6044003aa0 2024-09-14T10:54:56.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.474+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fc0b8019310 con 0x7fc0c812c0b0 2024-09-14T10:54:56.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.478+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f604c04b070 con 0x7f6044003aa0 2024-09-14T10:54:56.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.645+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa3d8098160 con 0x7fa3d8071310 2024-09-14T10:54:56.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.646+0000 7fa3d57fa640 1 -- 172.21.15.116:0/2299295739 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3cc02ae20 con 0x7fa3d8071310 2024-09-14T10:54:56.644 INFO:teuthology.orchestra.run.smithi116.stdout:38654705668 2024-09-14T10:54:56.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 msgr2=0x7fa3bc040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 0x7fa3bc040a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4001610 tx=0x7fa3c40078f0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 msgr2=0x7fa3d81c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc02a1e0 tx=0x7fa3cc0046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 shutdown_connections 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa3bc03e5c0 0x7fa3bc040a80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 --2- 172.21.15.116:0/2299295739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d8071310 0x7fa3d81c4e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 >> 172.21.15.116:0/2299295739 conn(0x7fa3d809cb40 msgr2=0x7fa3d8129f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 shutdown_connections 2024-09-14T10:54:56.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.648+0000 7fa3df0d6640 1 -- 172.21.15.116:0/2299295739 wait complete. 2024-09-14T10:54:56.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.0 2024-09-14T10:54:56.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.661+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f603c005370 con 0x7f6044003aa0 2024-09-14T10:54:56.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.662+0000 7f6043fff640 1 -- 172.21.15.116:0/1658263511 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f604c030db0 con 0x7f6044003aa0 2024-09-14T10:54:56.659 INFO:teuthology.orchestra.run.smithi116.stdout:47244640260 2024-09-14T10:54:56.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 msgr2=0x7f60480409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 0x7f60480409e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60500078d0 tx=0x7f6050001530 comp rx=0 tx=0).stop 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 msgr2=0x7f605c08d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f604c000c00 tx=0x7f604c004730 comp rx=0 tx=0).stop 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 shutdown_connections 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f604803e520 0x7f60480409e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 --2- 172.21.15.116:0/1658263511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6044003aa0 0x7f605c08d6b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 >> 172.21.15.116:0/1658263511 conn(0x7f605c09e7e0 msgr2=0x7f605c0937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 shutdown_connections 2024-09-14T10:54:56.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.664+0000 7f6062189640 1 -- 172.21.15.116:0/1658263511 wait complete. 2024-09-14T10:54:56.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.674+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7bfc073cd0 con 0x7f7bfc127e90 2024-09-14T10:54:56.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.674+0000 7f7bf2ffd640 1 -- 172.21.15.116:0/2770858306 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7bec01ada0 con 0x7f7bfc127e90 2024-09-14T10:54:56.672 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T10:54:56.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-14T10:54:56.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 msgr2=0x7f7bdc040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 0x7f7bdc040a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7be4034000 tx=0x7f7be402e000 comp rx=0 tx=0).stop 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 msgr2=0x7f7bfc124130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c450 tx=0x7f7bec00c910 comp rx=0 tx=0).stop 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 shutdown_connections 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7bdc03e570 0x7f7bdc040a30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 --2- 172.21.15.116:0/2770858306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7bfc127e90 0x7f7bfc124130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 >> 172.21.15.116:0/2770858306 conn(0x7f7bfc09abc0 msgr2=0x7f7bfc098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 shutdown_connections 2024-09-14T10:54:56.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.676+0000 7f7c00989640 1 -- 172.21.15.116:0/2770858306 wait complete. 2024-09-14T10:54:56.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.677+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc0a8005640 con 0x7fc0c812c0b0 2024-09-14T10:54:56.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.678+0000 7fc0affff640 1 -- 172.21.15.116:0/3909746828 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc0b8004de0 con 0x7fc0c812c0b0 2024-09-14T10:54:56.676 INFO:teuthology.orchestra.run.smithi116.stdout:47244640259 2024-09-14T10:54:56.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 msgr2=0x7fc0b4040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 0x7fc0b4040a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009820 tx=0x7fc0bc02e000 comp rx=0 tx=0).stop 2024-09-14T10:54:56.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 msgr2=0x7fc0c8136610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800c450 tx=0x7fc0b800c910 comp rx=0 tx=0).stop 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 shutdown_connections 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc0b403e5c0 0x7fc0b4040a80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 --2- 172.21.15.116:0/3909746828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0c812c0b0 0x7fc0c8136610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 >> 172.21.15.116:0/3909746828 conn(0x7fc0c809abc0 msgr2=0x7fc0c809bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 shutdown_connections 2024-09-14T10:54:56.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:56.680+0000 7fc0ce16b640 1 -- 172.21.15.116:0/3909746828 wait complete. 2024-09-14T10:54:56.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-14T10:54:56.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.2 2024-09-14T10:54:57.658 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:54:57.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:54:57.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:54:57.690 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:54:57.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.775+0000 7faa7602a640 1 Processor -- start 2024-09-14T10:54:57.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.775+0000 7faa7602a640 1 -- start start 2024-09-14T10:54:57.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa7602a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faa7006efc0 0x7faa7006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa7602a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa70070330 con 0x7faa7006f8e0 2024-09-14T10:54:57.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa7602a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7faa7009f310 con 0x7faa7006efc0 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6f7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7faa7006efc0 0x7faa7006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6effd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7faa7006f8e0 0x7faa7009b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51092/0 (socket says 172.21.15.116:51092) 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6effd640 1 -- 172.21.15.116:0/1978894725 learned_addr learned my addr 172.21.15.116:0/1978894725 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6f7fe640 1 -- 172.21.15.116:0/1978894725 >> v1:172.21.15.116:6789/0 conn(0x7faa7006f8e0 legacy=0x7faa7009b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6f7fe640 1 -- 172.21.15.116:0/1978894725 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa70070640 con 0x7faa7006efc0 2024-09-14T10:54:57.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.776+0000 7faa6e7fc640 1 -- 172.21.15.116:0/1978894725 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638241842 0 0) 0x7faa70070330 con 0x7faa7006f8e0 2024-09-14T10:54:57.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.777+0000 7faa6f7fe640 1 --2- 172.21.15.116:0/1978894725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7006f3a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa60009720 tx=0x7faa6002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5903e8c7bb4103b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.777+0000 7faa6e7fc640 1 -- 172.21.15.116:0/1978894725 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa60037070 con 0x7faa7006efc0 2024-09-14T10:54:57.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.778+0000 7faa6e7fc640 1 -- 172.21.15.116:0/1978894725 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6002ad90 con 0x7faa7006efc0 2024-09-14T10:54:57.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.778+0000 7faa6e7fc640 1 -- 172.21.15.116:0/1978894725 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa60032590 con 0x7faa7006efc0 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.778+0000 7faa7602a640 1 -- 172.21.15.116:0/1978894725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 msgr2=0x7faa7006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.778+0000 7faa7602a640 1 --2- 172.21.15.116:0/1978894725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7006f3a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa60009720 tx=0x7faa6002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 -- 172.21.15.116:0/1978894725 shutdown_connections 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 --2- 172.21.15.116:0/1978894725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7006f3a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 -- 172.21.15.116:0/1978894725 >> 172.21.15.116:0/1978894725 conn(0x7faa700a2460 msgr2=0x7faa7009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 -- 172.21.15.116:0/1978894725 shutdown_connections 2024-09-14T10:54:57.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 -- 172.21.15.116:0/1978894725 wait complete. 2024-09-14T10:54:57.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.779+0000 7faa7602a640 1 Processor -- start 2024-09-14T10:54:57.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa7602a640 1 -- start start 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa7602a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa7602a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7faa7009f870 con 0x7faa7006efc0 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34376/0 (socket says 172.21.15.116:34376) 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.780+0000 7faa6f7fe640 1 -- 172.21.15.116:0/3640418940 learned_addr learned my addr 172.21.15.116:0/3640418940 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa6f7fe640 1 -- 172.21.15.116:0/3640418940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa70090a00 con 0x7faa7006efc0 2024-09-14T10:54:57.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa6f7fe640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa60035040 tx=0x7faa600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa60037040 con 0x7faa7006efc0 2024-09-14T10:54:57.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa60004160 con 0x7faa7006efc0 2024-09-14T10:54:57.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa7602a640 1 -- 172.21.15.116:0/3640418940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7012b500 con 0x7faa7006efc0 2024-09-14T10:54:57.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa60004440 con 0x7faa7006efc0 2024-09-14T10:54:57.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.781+0000 7faa7602a640 1 -- 172.21.15.116:0/3640418940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7012b9d0 con 0x7faa7006efc0 2024-09-14T10:54:57.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.783+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7faa60003610 con 0x7faa7006efc0 2024-09-14T10:54:57.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.783+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa48005080 con 0x7faa7006efc0 2024-09-14T10:54:57.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.783+0000 7faa57fff640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 0x7faa5c040a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.783+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7faa60073b60 con 0x7faa7006efc0 2024-09-14T10:54:57.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.783+0000 7faa6effd640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 0x7faa5c040a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.784+0000 7faa6effd640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 0x7faa5c040a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa64000c00 tx=0x7faa640078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.788+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7faa60003900 con 0x7faa7006efc0 2024-09-14T10:54:57.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.813+0000 7f40e773d640 1 Processor -- start 2024-09-14T10:54:57.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20fc6a640 1 Processor -- start 2024-09-14T10:54:57.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f8162bf3640 1 Processor -- start 2024-09-14T10:54:57.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f40e773d640 1 -- start start 2024-09-14T10:54:57.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f8162bf3640 1 -- start start 2024-09-14T10:54:57.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20fc6a640 1 -- start start 2024-09-14T10:54:57.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f40e773d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f40e0132850 0x7f40e0134c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20fc6a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd20812c0b0 0x7fd20812c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f8162bf3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f815c127e90 0x7f815c128270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20fc6a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd208099e20 con 0x7fd20812c9d0 2024-09-14T10:54:57.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20fc6a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fd2080715a0 con 0x7fd20812c0b0 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f8162bf3640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815c06f8e0 con 0x7f815c1287b0 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f8162bf3640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f815c0702c0 con 0x7f815c127e90 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f816098f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f815c127e90 0x7f815c128270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f815bfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f815c1287b0 0x7f815c097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51100/0 (socket says 172.21.15.116:51100) 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f816098f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f815c127e90 0x7f815c128270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34396/0 (socket says 172.21.15.116:34396) 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f40e54d9640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f40e012f910 0x7f40e012fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51094/0 (socket says 172.21.15.116:51094) 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f40e54d9640 1 -- 172.21.15.116:0/19005280 learned_addr learned my addr 172.21.15.116:0/19005280 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:57.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7f40e773d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40e012f4e0 con 0x7f40e012f910 2024-09-14T10:54:57.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20d205640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd20812c9d0 0x7fd208097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51098/0 (socket says 172.21.15.116:51098) 2024-09-14T10:54:57.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20da06640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd20812c0b0 0x7fd20812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.814+0000 7fd20d205640 1 -- 172.21.15.116:0/2884384054 learned_addr learned my addr 172.21.15.116:0/2884384054 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:57.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f815bfff640 1 -- 172.21.15.116:0/1736944713 learned_addr learned my addr 172.21.15.116:0/1736944713 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f40e009f3f0 con 0x7f40e0132850 2024-09-14T10:54:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40e4cd8640 1 --2- 172.21.15.116:0/19005280 >> v2:172.21.15.116:3300/0 conn(0x7f40e0132850 0x7f40e0134c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40d7fff640 1 -- 172.21.15.116:0/19005280 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842120640 0 0) 0x7f40e012f4e0 con 0x7f40e012f910 2024-09-14T10:54:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40d7fff640 1 -- 172.21.15.116:0/19005280 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40cc003520 con 0x7f40e012f910 2024-09-14T10:54:57.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7fd20da06640 1 -- 172.21.15.116:0/2884384054 >> v1:172.21.15.116:6789/0 conn(0x7fd20812c9d0 legacy=0x7fd208097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7fd20da06640 1 -- 172.21.15.116:0/2884384054 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2080705b0 con 0x7fd20812c0b0 2024-09-14T10:54:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358981476 0 0) 0x7f815c06f8e0 con 0x7f815c1287b0 2024-09-14T10:54:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814c003520 con 0x7f815c1287b0 2024-09-14T10:54:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40e4cd8640 1 -- 172.21.15.116:0/19005280 >> v1:172.21.15.116:6789/0 conn(0x7f40e012f910 legacy=0x7f40e012fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f40e4cd8640 1 -- 172.21.15.116:0/19005280 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e0130400 con 0x7f40e0132850 2024-09-14T10:54:57.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 925134994 0 0) 0x7f814c003520 con 0x7f815c1287b0 2024-09-14T10:54:57.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f816098f640 1 -- 172.21.15.116:0/1736944713 >> v1:172.21.15.116:6789/0 conn(0x7f815c1287b0 legacy=0x7f815c097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.815+0000 7f816098f640 1 -- 172.21.15.116:0/1736944713 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c099e20 con 0x7f815c127e90 2024-09-14T10:54:57.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.816+0000 7fd20da06640 1 --2- 172.21.15.116:0/2884384054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd20812c490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd204009750 tx=0x7fd20402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb736b26bf69d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.816+0000 7fd20ca04640 1 -- 172.21.15.116:0/2884384054 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204037070 con 0x7fd20812c0b0 2024-09-14T10:54:57.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.816+0000 7fd20ca04640 1 -- 172.21.15.116:0/2884384054 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20402ad80 con 0x7fd20812c0b0 2024-09-14T10:54:57.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.816+0000 7fd20ca04640 1 -- 172.21.15.116:0/2884384054 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204032590 con 0x7fd20812c0b0 2024-09-14T10:54:57.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.816+0000 7f40e4cd8640 1 --2- 172.21.15.116:0/19005280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e0132850 0x7f40e0134c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40e009f570 tx=0x7f40d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed84d4dba17c170 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40d7fff640 1 -- 172.21.15.116:0/19005280 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0037070 con 0x7f40e0132850 2024-09-14T10:54:57.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40d7fff640 1 -- 172.21.15.116:0/19005280 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d002ae20 con 0x7f40e0132850 2024-09-14T10:54:57.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40d7fff640 1 -- 172.21.15.116:0/19005280 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0032590 con 0x7f40e0132850 2024-09-14T10:54:57.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f816098f640 1 --2- 172.21.15.116:0/1736944713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c128270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8150009720 tx=0x7f815002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be6255675a2bed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 -- 172.21.15.116:0/2884384054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 msgr2=0x7fd20812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/2884384054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd20812c490 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd204009750 tx=0x7fd20402a140 comp rx=0 tx=0).stop 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 -- 172.21.15.116:0/2884384054 shutdown_connections 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/2884384054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd20812c490 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 -- 172.21.15.116:0/2884384054 >> 172.21.15.116:0/2884384054 conn(0x7fd20809abc0 msgr2=0x7fd208098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8150037070 con 0x7f815c127e90 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815002abc0 con 0x7f815c127e90 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 -- 172.21.15.116:0/2884384054 shutdown_connections 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7fd20fc6a640 1 -- 172.21.15.116:0/2884384054 wait complete. 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f815b7fe640 1 -- 172.21.15.116:0/1736944713 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8148001620 con 0x7f815c127e90 2024-09-14T10:54:57.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e0132850 msgr2=0x7f40e0134c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40e773d640 1 --2- 172.21.15.116:0/19005280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e0132850 0x7f40e0134c40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f40e009f570 tx=0x7f40d002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 shutdown_connections 2024-09-14T10:54:57.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40e773d640 1 --2- 172.21.15.116:0/19005280 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e0132850 0x7f40e0134c40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.817+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 >> 172.21.15.116:0/19005280 conn(0x7f40e00a2540 msgr2=0x7f40e009ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:57.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 shutdown_connections 2024-09-14T10:54:57.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f40e773d640 1 -- 172.21.15.116:0/19005280 wait complete. 2024-09-14T10:54:57.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 -- 172.21.15.116:0/1736944713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 msgr2=0x7f815c128270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 --2- 172.21.15.116:0/1736944713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c128270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8150009720 tx=0x7f815002a130 comp rx=0 tx=0).stop 2024-09-14T10:54:57.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 -- 172.21.15.116:0/1736944713 shutdown_connections 2024-09-14T10:54:57.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 --2- 172.21.15.116:0/1736944713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c128270 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7fd20fc6a640 1 Processor -- start 2024-09-14T10:54:57.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 -- 172.21.15.116:0/1736944713 >> 172.21.15.116:0/1736944713 conn(0x7f815c09abc0 msgr2=0x7f815c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:57.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 -- 172.21.15.116:0/1736944713 shutdown_connections 2024-09-14T10:54:57.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7fd20fc6a640 1 -- start start 2024-09-14T10:54:57.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7f8162bf3640 1 -- 172.21.15.116:0/1736944713 wait complete. 2024-09-14T10:54:57.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.818+0000 7fd20fc6a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e773d640 1 Processor -- start 2024-09-14T10:54:57.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20fc6a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fd20812ce60 con 0x7fd20812c0b0 2024-09-14T10:54:57.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e773d640 1 -- start start 2024-09-14T10:54:57.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20da06640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f8162bf3640 1 Processor -- start 2024-09-14T10:54:57.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20da06640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34402/0 (socket says 172.21.15.116:34402) 2024-09-14T10:54:57.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20da06640 1 -- 172.21.15.116:0/408172550 learned_addr learned my addr 172.21.15.116:0/408172550 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:57.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f8162bf3640 1 -- start start 2024-09-14T10:54:57.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20da06640 1 -- 172.21.15.116:0/408172550 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd208097030 con 0x7fd20812c0b0 2024-09-14T10:54:57.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e773d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e773d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0135180 con 0x7f40e012f910 2024-09-14T10:54:57.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd20da06640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c00 tx=0x7fd2040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e54d9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e54d9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34408/0 (socket says 172.21.15.116:34408) 2024-09-14T10:54:57.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f40e54d9640 1 -- 172.21.15.116:0/2591145573 learned_addr learned my addr 172.21.15.116:0/2591145573 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:57.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204041070 con 0x7fd20812c0b0 2024-09-14T10:54:57.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20403c860 con 0x7fd20812c0b0 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f8162bf3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.819+0000 7f8162bf3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0700d0 con 0x7f815c127e90 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f816098f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f816098f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34416/0 (socket says 172.21.15.116:34416) 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f816098f640 1 -- 172.21.15.116:0/4225587665 learned_addr learned my addr 172.21.15.116:0/4225587665 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20808cae0 con 0x7fd20812c0b0 2024-09-14T10:54:57.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f40e54d9640 1 -- 172.21.15.116:0/2591145573 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e0129b10 con 0x7f40e012f910 2024-09-14T10:54:57.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd204037040 con 0x7fd20812c0b0 2024-09-14T10:54:57.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2081289b0 con 0x7fd20812c0b0 2024-09-14T10:54:57.833 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f40e54d9640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001eb0 tx=0x7f40dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f816098f640 1 -- 172.21.15.116:0/4225587665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c073940 con 0x7f815c127e90 2024-09-14T10:54:57.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40dc007410 con 0x7f40e012f910 2024-09-14T10:54:57.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.820+0000 7f816098f640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8150035040 tx=0x7f81500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8150041070 con 0x7f815c127e90 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e0070e90 con 0x7f40e012f910 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc0075d0 con 0x7f40e012f910 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40dc004950 con 0x7f40e012f910 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815003c590 con 0x7f815c127e90 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c092bc0 con 0x7f815c127e90 2024-09-14T10:54:57.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c091ae0 con 0x7f815c127e90 2024-09-14T10:54:57.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8150037040 con 0x7f815c127e90 2024-09-14T10:54:57.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20809b680 con 0x7fd20812c0b0 2024-09-14T10:54:57.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e00718c0 con 0x7f40e012f910 2024-09-14T10:54:57.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.821+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd204044070 con 0x7fd20812c0b0 2024-09-14T10:54:57.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.822+0000 7fd1fe7fc640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 0x7fd1ec040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.822+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e012fcf0 con 0x7f40e012f910 2024-09-14T10:54:57.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.822+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815c12b260 con 0x7f815c127e90 2024-09-14T10:54:57.837 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.822+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fd204078060 con 0x7fd20812c0b0 2024-09-14T10:54:57.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.822+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f40dc011070 con 0x7f40e012f910 2024-09-14T10:54:57.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7fd20d205640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 0x7fd1ec040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f40d5ffb640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 0x7f40c40409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f40dc052740 con 0x7f40e012f910 2024-09-14T10:54:57.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f40e4cd8640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 0x7f40c40409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8150044070 con 0x7f815c127e90 2024-09-14T10:54:57.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7fd20d205640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 0x7fd1ec040a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8007fd0 tx=0x7fd1f8007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f81597fa640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 0x7f81400409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:57.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f40e4cd8640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 0x7f40c40409e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d0034000 tx=0x7f40d002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.823+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8150073980 con 0x7f815c127e90 2024-09-14T10:54:57.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.824+0000 7f815bfff640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 0x7f81400409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:57.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.824+0000 7f815bfff640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 0x7f81400409e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8148005880 tx=0x7f8148001060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:57.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.827+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fd20808cae0 con 0x7fd20812c0b0 2024-09-14T10:54:57.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.832+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f815003bce0 con 0x7f815c127e90 2024-09-14T10:54:57.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.836+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f40dc011c60 con 0x7f40e012f910 2024-09-14T10:54:57.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.977+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faa48005370 con 0x7faa7006efc0 2024-09-14T10:54:57.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.977+0000 7faa57fff640 1 -- 172.21.15.116:0/3640418940 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa6003dd20 con 0x7faa7006efc0 2024-09-14T10:54:57.975 INFO:teuthology.orchestra.run.smithi116.stdout:38654705669 2024-09-14T10:54:57.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 msgr2=0x7faa5c040a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 0x7faa5c040a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa64000c00 tx=0x7faa640078d0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 msgr2=0x7faa7009af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:57.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa60035040 tx=0x7faa600046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 shutdown_connections 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faa5c03e550 0x7faa5c040a10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 --2- 172.21.15.116:0/3640418940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faa7006efc0 0x7faa7009af30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 >> 172.21.15.116:0/3640418940 conn(0x7faa700a2460 msgr2=0x7faa7012f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 shutdown_connections 2024-09-14T10:54:57.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:57.980+0000 7faa55ffb640 1 -- 172.21.15.116:0/3640418940 wait complete. 2024-09-14T10:54:57.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-09-14T10:54:58.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.021+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f40e0050ee0 con 0x7f40e012f910 2024-09-14T10:54:58.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.022+0000 7f40d5ffb640 1 -- 172.21.15.116:0/2591145573 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40dc012d90 con 0x7f40e012f910 2024-09-14T10:54:58.020 INFO:teuthology.orchestra.run.smithi116.stdout:47244640259 2024-09-14T10:54:58.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 msgr2=0x7f40c40409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 0x7f40c40409e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40d0034000 tx=0x7f40d002e000 comp rx=0 tx=0).stop 2024-09-14T10:54:58.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 msgr2=0x7f40e00725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40dc001eb0 tx=0x7f40dc00c8e0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 shutdown_connections 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f40c403e520 0x7f40c40409e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 --2- 172.21.15.116:0/2591145573 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40e012f910 0x7f40e00725a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 >> 172.21.15.116:0/2591145573 conn(0x7f40e00a2540 msgr2=0x7f40e012e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 shutdown_connections 2024-09-14T10:54:58.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.024+0000 7f40e773d640 1 -- 172.21.15.116:0/2591145573 wait complete. 2024-09-14T10:54:58.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.031+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd208129620 con 0x7fd20812c0b0 2024-09-14T10:54:58.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.032+0000 7fd1fe7fc640 1 -- 172.21.15.116:0/408172550 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd20403a9c0 con 0x7fd20812c0b0 2024-09-14T10:54:58.030 INFO:teuthology.orchestra.run.smithi116.stdout:47244640260 2024-09-14T10:54:58.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 msgr2=0x7fd1ec040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 0x7fd1ec040a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8007fd0 tx=0x7fd1f8007aa0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 msgr2=0x7fd2081bc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd204000c00 tx=0x7fd2040046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 shutdown_connections 2024-09-14T10:54:58.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1ec03e5a0 0x7fd1ec040a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 --2- 172.21.15.116:0/408172550 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd20812c0b0 0x7fd2081bc650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 >> 172.21.15.116:0/408172550 conn(0x7fd20809abc0 msgr2=0x7fd208072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:58.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 shutdown_connections 2024-09-14T10:54:58.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.034+0000 7fd20fc6a640 1 -- 172.21.15.116:0/408172550 wait complete. 2024-09-14T10:54:58.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.2 2024-09-14T10:54:58.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.037+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f815c06cb70 con 0x7f815c127e90 2024-09-14T10:54:58.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.038+0000 7f81597fa640 1 -- 172.21.15.116:0/4225587665 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f815003c890 con 0x7f815c127e90 2024-09-14T10:54:58.035 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T10:54:58.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 msgr2=0x7f81400409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 0x7f81400409e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8148005880 tx=0x7f8148001060 comp rx=0 tx=0).stop 2024-09-14T10:54:58.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 msgr2=0x7f815c0903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:58.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8150035040 tx=0x7f81500046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 shutdown_connections 2024-09-14T10:54:58.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f814003e520 0x7f81400409e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 --2- 172.21.15.116:0/4225587665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f815c127e90 0x7f815c0903f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:58.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 >> 172.21.15.116:0/4225587665 conn(0x7f815c09abc0 msgr2=0x7f815c09b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:58.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 shutdown_connections 2024-09-14T10:54:58.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:58.040+0000 7f8162bf3640 1 -- 172.21.15.116:0/4225587665 wait complete. 2024-09-14T10:54:58.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.1 2024-09-14T10:54:58.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-14T10:54:58.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:54:59.035 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:54:59.044 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:54:59.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:54:59.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.110+0000 7f23c5982640 1 Processor -- start 2024-09-14T10:54:59.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.110+0000 7f23c5982640 1 -- start start 2024-09-14T10:54:59.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23c5982640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23c006efc0 0x7f23c006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23c5982640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c0070330 con 0x7f23c006f8e0 2024-09-14T10:54:59.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23c5982640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f23c009f310 con 0x7f23c006efc0 2024-09-14T10:54:59.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23beffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f23c006efc0 0x7f23c006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23be7fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f23c006f8e0 0x7f23c009b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51116/0 (socket says 172.21.15.116:51116) 2024-09-14T10:54:59.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23be7fc640 1 -- 172.21.15.116:0/2147579314 learned_addr learned my addr 172.21.15.116:0/2147579314 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:59.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.111+0000 7f23beffd640 1 -- 172.21.15.116:0/2147579314 >> v1:172.21.15.116:6789/0 conn(0x7f23c006f8e0 legacy=0x7f23c009b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.112+0000 7f23beffd640 1 -- 172.21.15.116:0/2147579314 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0070640 con 0x7f23c006efc0 2024-09-14T10:54:59.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.112+0000 7f23beffd640 1 --2- 172.21.15.116:0/2147579314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c006f3a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009720 tx=0x7f23b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f366122f96eb770 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.112+0000 7f23bdffb640 1 -- 172.21.15.116:0/2147579314 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b0037070 con 0x7f23c006efc0 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.112+0000 7f23bdffb640 1 -- 172.21.15.116:0/2147579314 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b002ad90 con 0x7f23c006efc0 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.112+0000 7f23bdffb640 1 -- 172.21.15.116:0/2147579314 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b0032590 con 0x7f23c006efc0 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 -- 172.21.15.116:0/2147579314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 msgr2=0x7f23c006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 --2- 172.21.15.116:0/2147579314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c006f3a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009720 tx=0x7f23b002a110 comp rx=0 tx=0).stop 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 -- 172.21.15.116:0/2147579314 shutdown_connections 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 --2- 172.21.15.116:0/2147579314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c006f3a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 -- 172.21.15.116:0/2147579314 >> 172.21.15.116:0/2147579314 conn(0x7f23c00a2460 msgr2=0x7f23c009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 -- 172.21.15.116:0/2147579314 shutdown_connections 2024-09-14T10:54:59.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.113+0000 7f23c5982640 1 -- 172.21.15.116:0/2147579314 wait complete. 2024-09-14T10:54:59.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23c5982640 1 Processor -- start 2024-09-14T10:54:59.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23c5982640 1 -- start start 2024-09-14T10:54:59.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23c5982640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23c5982640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f23c009f870 con 0x7f23c006efc0 2024-09-14T10:54:59.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23beffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23beffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34442/0 (socket says 172.21.15.116:34442) 2024-09-14T10:54:59.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.115+0000 7f23beffd640 1 -- 172.21.15.116:0/392345024 learned_addr learned my addr 172.21.15.116:0/392345024 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23beffd640 1 -- 172.21.15.116:0/392345024 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0091c50 con 0x7f23c006efc0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23beffd640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009840 tx=0x7f23b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b0041020 con 0x7f23c006efc0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b003d550 con 0x7f23c006efc0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c009b730 con 0x7f23c006efc0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b0037040 con 0x7f23c006efc0 2024-09-14T10:54:59.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.116+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c0090b10 con 0x7f23c006efc0 2024-09-14T10:54:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.118+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f23b0044020 con 0x7f23c006efc0 2024-09-14T10:54:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.118+0000 7f23a7fff640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 0x7f23ac040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.118+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f23b0073260 con 0x7f23c006efc0 2024-09-14T10:54:59.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.118+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c006f3a0 con 0x7f23c006efc0 2024-09-14T10:54:59.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.118+0000 7f23be7fc640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 0x7f23ac040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.119+0000 7f23be7fc640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 0x7f23ac040a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23b4007fd0 tx=0x7f23b4007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.123+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f23b0073020 con 0x7f23c006efc0 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.146+0000 7fed06fbb640 1 Processor -- start 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.146+0000 7fed06fbb640 1 -- start start 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.146+0000 7fed06fbb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fed0006efc0 0x7fed0006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.146+0000 7fed06fbb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed00070330 con 0x7fed0006f8e0 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.146+0000 7fed06fbb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fed0009f310 con 0x7fed0006efc0 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fed04d57640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fed0006efc0 0x7fed0006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fed04d57640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fed0006efc0 0x7fed0006f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34450/0 (socket says 172.21.15.116:34450) 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fed04d57640 1 -- 172.21.15.116:0/839199276 learned_addr learned my addr 172.21.15.116:0/839199276 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fecfffff640 1 --1- 172.21.15.116:0/839199276 >> v1:172.21.15.116:6789/0 conn(0x7fed0006f8e0 0x7fed0009b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51124/0 (socket says 172.21.15.116:51124) 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fed04d57640 1 -- 172.21.15.116:0/839199276 >> v1:172.21.15.116:6789/0 conn(0x7fed0006f8e0 legacy=0x7fed0009b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.147+0000 7fed04d57640 1 -- 172.21.15.116:0/839199276 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed00070640 con 0x7fed0006efc0 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed04d57640 1 --2- 172.21.15.116:0/839199276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed0006f3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fecf40097f0 tx=0x7fecf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4688631a31d916 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fecff7fe640 1 -- 172.21.15.116:0/839199276 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf4037070 con 0x7fed0006efc0 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fecff7fe640 1 -- 172.21.15.116:0/839199276 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4032440 con 0x7fed0006efc0 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fecff7fe640 1 -- 172.21.15.116:0/839199276 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf402ae60 con 0x7fed0006efc0 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed06fbb640 1 -- 172.21.15.116:0/839199276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 msgr2=0x7fed0006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed06fbb640 1 --2- 172.21.15.116:0/839199276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed0006f3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fecf40097f0 tx=0x7fecf402a1e0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed06fbb640 1 -- 172.21.15.116:0/839199276 shutdown_connections 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed06fbb640 1 --2- 172.21.15.116:0/839199276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed0006f3a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.148+0000 7fed06fbb640 1 -- 172.21.15.116:0/839199276 >> 172.21.15.116:0/839199276 conn(0x7fed000a2460 msgr2=0x7fed0009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.149+0000 7fed06fbb640 1 -- 172.21.15.116:0/839199276 shutdown_connections 2024-09-14T10:54:59.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.149+0000 7fed06fbb640 1 -- 172.21.15.116:0/839199276 wait complete. 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.149+0000 7fed06fbb640 1 Processor -- start 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.149+0000 7fed06fbb640 1 -- start start 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed06fbb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed06fbb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fed0009f870 con 0x7fed0006efc0 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed04d57640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed04d57640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34466/0 (socket says 172.21.15.116:34466) 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed04d57640 1 -- 172.21.15.116:0/3376302339 learned_addr learned my addr 172.21.15.116:0/3376302339 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.150+0000 7fed04d57640 1 -- 172.21.15.116:0/3376302339 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed00091c50 con 0x7fed0006efc0 2024-09-14T10:54:59.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.151+0000 7fed04d57640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fecf4035040 tx=0x7fecf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.151+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf4041020 con 0x7fed0006efc0 2024-09-14T10:54:59.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.151+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40307f0 con 0x7fed0006efc0 2024-09-14T10:54:59.150 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.151+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf4037040 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.152+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0009b730 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.152+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed00090b10 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.152+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fecf4044020 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.153+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0006f3a0 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.153+0000 7fecfd7fa640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 0x7fece4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.153+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fecf4073580 con 0x7fed0006efc0 2024-09-14T10:54:59.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.153+0000 7fecfffff640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 0x7fece4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.153+0000 7fecfffff640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 0x7fece4040a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecec001630 tx=0x7fecec007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.157+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fecf404b030 con 0x7fed0006efc0 2024-09-14T10:54:59.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.187+0000 7f02ae9ca640 1 Processor -- start 2024-09-14T10:54:59.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.187+0000 7f02ae9ca640 1 -- start start 2024-09-14T10:54:59.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02ae9ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f02a809bf90 0x7f02a8134a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02ae9ca640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a80706a0 con 0x7f02a809b4a0 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02ae9ca640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f02a809f400 con 0x7f02a809bf90 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02a77fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f02a809bf90 0x7f02a8134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02a77fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f02a809bf90 0x7f02a8134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34470/0 (socket says 172.21.15.116:34470) 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02a77fe640 1 -- 172.21.15.116:0/2677282336 learned_addr learned my addr 172.21.15.116:0/2677282336 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02a77fe640 1 -- 172.21.15.116:0/2677282336 >> v1:172.21.15.116:6789/0 conn(0x7f02a809b4a0 legacy=0x7f02a809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.187 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.188+0000 7f02a77fe640 1 -- 172.21.15.116:0/2677282336 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a809f950 con 0x7f02a809bf90 2024-09-14T10:54:59.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.189+0000 7f02a77fe640 1 --2- 172.21.15.116:0/2677282336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809bf90 0x7f02a8134a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f029c0097f0 tx=0x7f029c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78728eef7078fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.189+0000 7f02a6ffd640 1 -- 172.21.15.116:0/2677282336 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c037070 con 0x7f02a809bf90 2024-09-14T10:54:59.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.189+0000 7f02a6ffd640 1 -- 172.21.15.116:0/2677282336 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c032440 con 0x7f02a809bf90 2024-09-14T10:54:59.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.189+0000 7f02a6ffd640 1 -- 172.21.15.116:0/2677282336 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f029c032740 con 0x7f02a809bf90 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 -- 172.21.15.116:0/2677282336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809bf90 msgr2=0x7f02a8134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/2677282336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809bf90 0x7f02a8134a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f029c0097f0 tx=0x7f029c02a270 comp rx=0 tx=0).stop 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 -- 172.21.15.116:0/2677282336 shutdown_connections 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/2677282336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809bf90 0x7f02a8134a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 -- 172.21.15.116:0/2677282336 >> 172.21.15.116:0/2677282336 conn(0x7f02a80a25b0 msgr2=0x7f02a809ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 -- 172.21.15.116:0/2677282336 shutdown_connections 2024-09-14T10:54:59.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.190+0000 7f02ae9ca640 1 -- 172.21.15.116:0/2677282336 wait complete. 2024-09-14T10:54:59.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.192+0000 7f02ae9ca640 1 Processor -- start 2024-09-14T10:54:59.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.192+0000 7f02ae9ca640 1 -- start start 2024-09-14T10:54:59.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.192+0000 7f02ae9ca640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.192+0000 7f02ae9ca640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f02a81350d0 con 0x7f02a809b4a0 2024-09-14T10:54:59.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34486/0 (socket says 172.21.15.116:34486) 2024-09-14T10:54:59.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a7fff640 1 -- 172.21.15.116:0/167353232 learned_addr learned my addr 172.21.15.116:0/167353232 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a7fff640 1 -- 172.21.15.116:0/167353232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a81319b0 con 0x7f02a809b4a0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a7fff640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f029800c3d0 tx=0x7f029800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0298017070 con 0x7f02a809b4a0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0298005240 con 0x7f02a809b4a0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02980035f0 con 0x7f02a809b4a0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a8131240 con 0x7f02a809b4a0 2024-09-14T10:54:59.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.193+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a81c4b10 con 0x7f02a809b4a0 2024-09-14T10:54:59.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.194+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a809b880 con 0x7f02a809b4a0 2024-09-14T10:54:59.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.195+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f029801a070 con 0x7f02a809b4a0 2024-09-14T10:54:59.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.195+0000 7f02a4ff9640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 0x7f0294040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.195+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f0298051e20 con 0x7f02a809b4a0 2024-09-14T10:54:59.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.196+0000 7f02a77fe640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 0x7f0294040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.194 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.196+0000 7f02a77fe640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 0x7f0294040a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f029c034000 tx=0x7f029c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.197 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.200+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f0298011590 con 0x7f02a809b4a0 2024-09-14T10:54:59.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.221+0000 7fe509b9f640 1 Processor -- start 2024-09-14T10:54:59.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.221+0000 7fe509b9f640 1 -- start start 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe509b9f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe50412f2d0 0x7fe50412f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe509b9f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50406f770 con 0x7fe50412fda0 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe509b9f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fe5040705e0 con 0x7fe50412f2d0 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe508b9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe50412f2d0 0x7fe50412f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe508b9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe50412f2d0 0x7fe50412f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34498/0 (socket says 172.21.15.116:34498) 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe508b9d640 1 -- 172.21.15.116:0/1895992218 learned_addr learned my addr 172.21.15.116:0/1895992218 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe503fff640 1 --1- 172.21.15.116:0/1895992218 >> v1:172.21.15.116:6789/0 conn(0x7fe50412fda0 0x7fe50412bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51146/0 (socket says 172.21.15.116:51146) 2024-09-14T10:54:59.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe508b9d640 1 -- 172.21.15.116:0/1895992218 >> v1:172.21.15.116:6789/0 conn(0x7fe50412fda0 legacy=0x7fe50412bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe5037fe640 1 -- 172.21.15.116:0/1895992218 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860134432 0 0) 0x7fe50406f770 con 0x7fe50412fda0 2024-09-14T10:54:59.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.222+0000 7fe508b9d640 1 -- 172.21.15.116:0/1895992218 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50406fcf0 con 0x7fe50412f2d0 2024-09-14T10:54:59.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.223+0000 7fe508b9d640 1 --2- 172.21.15.116:0/1895992218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe50412f860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097f0 tx=0x7fe4f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f0690b476e557 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.223+0000 7fe5037fe640 1 -- 172.21.15.116:0/1895992218 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f8037070 con 0x7fe50412f2d0 2024-09-14T10:54:59.221 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.223+0000 7fe5037fe640 1 -- 172.21.15.116:0/1895992218 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f8032440 con 0x7fe50412f2d0 2024-09-14T10:54:59.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.223+0000 7fe5037fe640 1 -- 172.21.15.116:0/1895992218 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f8032740 con 0x7fe50412f2d0 2024-09-14T10:54:59.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.224+0000 7fe509b9f640 1 -- 172.21.15.116:0/1895992218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 msgr2=0x7fe50412f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.224+0000 7fe509b9f640 1 --2- 172.21.15.116:0/1895992218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe50412f860 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80097f0 tx=0x7fe4f802a270 comp rx=0 tx=0).stop 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.224+0000 7fe509b9f640 1 -- 172.21.15.116:0/1895992218 shutdown_connections 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.224+0000 7fe509b9f640 1 --2- 172.21.15.116:0/1895992218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe50412f860 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.224+0000 7fe509b9f640 1 -- 172.21.15.116:0/1895992218 >> 172.21.15.116:0/1895992218 conn(0x7fe50409c8a0 msgr2=0x7fe50409ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.225+0000 7fe509b9f640 1 -- 172.21.15.116:0/1895992218 shutdown_connections 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.225+0000 7fe509b9f640 1 -- 172.21.15.116:0/1895992218 wait complete. 2024-09-14T10:54:59.223 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.226+0000 7fe509b9f640 1 Processor -- start 2024-09-14T10:54:59.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.226+0000 7fe509b9f640 1 -- start start 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe509b9f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe509b9f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe50412c4e0 con 0x7fe50412f2d0 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe508b9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe508b9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34502/0 (socket says 172.21.15.116:34502) 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe508b9d640 1 -- 172.21.15.116:0/4162460027 learned_addr learned my addr 172.21.15.116:0/4162460027 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.225 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe508b9d640 1 -- 172.21.15.116:0/4162460027 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50412bc50 con 0x7fe50412f2d0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe508b9d640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8035040 tx=0x7fe4f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.227+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f8041070 con 0x7fe50412f2d0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.228+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f803c7a0 con 0x7fe50412f2d0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.228+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe504091610 con 0x7fe50412f2d0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.228+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4f8037040 con 0x7fe50412f2d0 2024-09-14T10:54:59.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.228+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe504092920 con 0x7fe50412f2d0 2024-09-14T10:54:59.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.229+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe4f8044070 con 0x7fe50412f2d0 2024-09-14T10:54:59.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.229+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe504093100 con 0x7fe50412f2d0 2024-09-14T10:54:59.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.229+0000 7fe5017fa640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 0x7fe4e8040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.229+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fe4f8073570 con 0x7fe50412f2d0 2024-09-14T10:54:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.230+0000 7fe503fff640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 0x7fe4e8040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.230+0000 7fe503fff640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 0x7fe4e8040a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0000c00 tx=0x7fe4f00078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.232 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.234+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fe4f804ed60 con 0x7fe50412f2d0 2024-09-14T10:54:59.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.345+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fed00073fe0 con 0x7fed0006efc0 2024-09-14T10:54:59.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.346+0000 7fecfd7fa640 1 -- 172.21.15.116:0/3376302339 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fecf403c380 con 0x7fed0006efc0 2024-09-14T10:54:59.344 INFO:teuthology.orchestra.run.smithi116.stdout:47244640261 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 msgr2=0x7fece4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 0x7fece4040a30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fecec001630 tx=0x7fecec007a20 comp rx=0 tx=0).stop 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 msgr2=0x7fed000903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fecf4035040 tx=0x7fecf40046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 shutdown_connections 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fece403e570 0x7fece4040a30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 --2- 172.21.15.116:0/3376302339 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed0006efc0 0x7fed000903f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 >> 172.21.15.116:0/3376302339 conn(0x7fed000a2460 msgr2=0x7fed0009cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 shutdown_connections 2024-09-14T10:54:59.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.348+0000 7fed06fbb640 1 -- 172.21.15.116:0/3376302339 wait complete. 2024-09-14T10:54:59.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.355+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f23c0073fe0 con 0x7f23c006efc0 2024-09-14T10:54:59.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.356+0000 7f23a7fff640 1 -- 172.21.15.116:0/392345024 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23b004b030 con 0x7f23c006efc0 2024-09-14T10:54:59.356 INFO:teuthology.orchestra.run.smithi116.stdout:38654705670 2024-09-14T10:54:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 msgr2=0x7f23ac040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 0x7f23ac040a30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23b4007fd0 tx=0x7f23b4007aa0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 msgr2=0x7f23c00903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009840 tx=0x7f23b00046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 shutdown_connections 2024-09-14T10:54:59.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f23ac03e570 0x7f23ac040a30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 --2- 172.21.15.116:0/392345024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f23c006efc0 0x7f23c00903f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 >> 172.21.15.116:0/392345024 conn(0x7f23c00a2460 msgr2=0x7f23c009cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 shutdown_connections 2024-09-14T10:54:59.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.358+0000 7f23c5982640 1 -- 172.21.15.116:0/392345024 wait complete. 2024-09-14T10:54:59.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.2 2024-09-14T10:54:59.359 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:59.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-09-14T10:54:59.367 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:59.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.384+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f02a8050ee0 con 0x7f02a809b4a0 2024-09-14T10:54:59.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.384+0000 7f02a4ff9640 1 -- 172.21.15.116:0/167353232 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02980104c0 con 0x7f02a809b4a0 2024-09-14T10:54:59.383 INFO:teuthology.orchestra.run.smithi116.stdout:47244640263 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 msgr2=0x7f0294040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 0x7f0294040a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f029c034000 tx=0x7f029c02e000 comp rx=0 tx=0).stop 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 msgr2=0x7f02a81c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f029800c3d0 tx=0x7f029800c890 comp rx=0 tx=0).stop 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 shutdown_connections 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.386+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f029403e570 0x7f0294040a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.387+0000 7f02ae9ca640 1 --2- 172.21.15.116:0/167353232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02a809b4a0 0x7f02a81c43f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.387+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 >> 172.21.15.116:0/167353232 conn(0x7f02a80a25b0 msgr2=0x7f02a812a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.387+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 shutdown_connections 2024-09-14T10:54:59.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.387+0000 7f02ae9ca640 1 -- 172.21.15.116:0/167353232 wait complete. 2024-09-14T10:54:59.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.3 2024-09-14T10:54:59.395 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:59.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.421+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe50409c260 con 0x7fe50412f2d0 2024-09-14T10:54:59.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.421+0000 7fe5017fa640 1 -- 172.21.15.116:0/4162460027 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4f803d3f0 con 0x7fe50412f2d0 2024-09-14T10:54:59.421 INFO:teuthology.orchestra.run.smithi116.stdout:47244640262 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 msgr2=0x7fe4e8040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 0x7fe4e8040a60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0000c00 tx=0x7fe4f00078f0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 msgr2=0x7fe5040903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8035040 tx=0x7fe4f80046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 shutdown_connections 2024-09-14T10:54:59.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe4e803e5a0 0x7fe4e8040a60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 --2- 172.21.15.116:0/4162460027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe50412f2d0 0x7fe5040903f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 >> 172.21.15.116:0/4162460027 conn(0x7fe50409c8a0 msgr2=0x7fe50412e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 shutdown_connections 2024-09-14T10:54:59.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.424+0000 7fe509b9f640 1 -- 172.21.15.116:0/4162460027 wait complete. 2024-09-14T10:54:59.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.1 2024-09-14T10:54:59.432 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:59.433 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:54:59.433 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:54:59.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f640e80c640 1 Processor -- start 2024-09-14T10:54:59.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f640e80c640 1 -- start start 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f640e80c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6408099bb0 0x7f640812be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f640e80c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640806f9f0 con 0x7f6408099f90 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f640e80c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f640806f580 con 0x7f6408099bb0 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f6407fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6408099bb0 0x7f640812be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f64077fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6408099f90 0x7f640812c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51160/0 (socket says 172.21.15.116:51160) 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.573+0000 7f64077fe640 1 -- 172.21.15.116:0/2632560141 learned_addr learned my addr 172.21.15.116:0/2632560141 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6407fff640 1 -- 172.21.15.116:0/2632560141 >> v1:172.21.15.116:6789/0 conn(0x7f6408099f90 legacy=0x7f640812c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6407fff640 1 -- 172.21.15.116:0/2632560141 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6408070f50 con 0x7f6408099bb0 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6406ffd640 1 -- 172.21.15.116:0/2632560141 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2748416974 0 0) 0x7f640806f9f0 con 0x7f6408099f90 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6407fff640 1 --2- 172.21.15.116:0/2632560141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f640812be50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009720 tx=0x7f63f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1599bda1ed7804 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6406ffd640 1 -- 172.21.15.116:0/2632560141 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8037070 con 0x7f6408099bb0 2024-09-14T10:54:59.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6406ffd640 1 -- 172.21.15.116:0/2632560141 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f802ae20 con 0x7f6408099bb0 2024-09-14T10:54:59.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.574+0000 7f6406ffd640 1 -- 172.21.15.116:0/2632560141 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8032590 con 0x7f6408099bb0 2024-09-14T10:54:59.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 -- 172.21.15.116:0/2632560141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 msgr2=0x7f640812be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 --2- 172.21.15.116:0/2632560141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f640812be50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009720 tx=0x7f63f802a1a0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 -- 172.21.15.116:0/2632560141 shutdown_connections 2024-09-14T10:54:59.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 --2- 172.21.15.116:0/2632560141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f640812be50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.576 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 -- 172.21.15.116:0/2632560141 >> 172.21.15.116:0/2632560141 conn(0x7f640809abc0 msgr2=0x7f6408098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 -- 172.21.15.116:0/2632560141 shutdown_connections 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.575+0000 7f640e80c640 1 -- 172.21.15.116:0/2632560141 wait complete. 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f640e80c640 1 Processor -- start 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f640e80c640 1 -- start start 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f640e80c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f640e80c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6408131e30 con 0x7f6408099bb0 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f6407fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f6407fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34530/0 (socket says 172.21.15.116:34530) 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.576+0000 7f6407fff640 1 -- 172.21.15.116:0/2681927580 learned_addr learned my addr 172.21.15.116:0/2681927580 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f6407fff640 1 -- 172.21.15.116:0/2681927580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640812b9f0 con 0x7f6408099bb0 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f6407fff640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f63f802a1e0 tx=0x7f63f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8042070 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f803e590 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640806e220 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63f8037040 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.577+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6408127f30 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.578+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f63f8045070 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.578+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6408128a40 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.578+0000 7f6404ff9640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 0x7f63f4040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.578+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f63f80733d0 con 0x7f6408099bb0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.579+0000 7f64077fe640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 0x7f63f4040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.579+0000 7f64077fe640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 0x7f63f4040a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63fc000c00 tx=0x7f63fc0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.583+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f63f8045d30 con 0x7f6408099bb0 2024-09-14T10:54:59.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.753+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f640806e810 con 0x7f63f403e5a0 2024-09-14T10:54:59.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.754+0000 7f6404ff9640 1 -- 172.21.15.116:0/2681927580 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32179 (secure 0 0 0) 0x7f63fc0058d0 con 0x7f63f403e5a0 2024-09-14T10:54:59.753 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:54:59.753 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:54:59.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 msgr2=0x7f63f4040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 0x7f63f4040a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63fc000c00 tx=0x7f63fc0078f0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 msgr2=0x7f6408097460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f63f802a1e0 tx=0x7f63f80046c0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 shutdown_connections 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f63f403e5a0 0x7f63f4040a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 --2- 172.21.15.116:0/2681927580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6408099bb0 0x7f6408097460 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 >> 172.21.15.116:0/2681927580 conn(0x7f640809abc0 msgr2=0x7f6408071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 shutdown_connections 2024-09-14T10:54:59.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.756+0000 7f640e80c640 1 -- 172.21.15.116:0/2681927580 wait complete. 2024-09-14T10:54:59.765 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:54:58.058844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109924,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377436,"statfs":{"total":386547056640,"available":386434494464,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.165071"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903753+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:54:54.903753+0000","last_peered":"2024-09-14T10:54:54.903753+0000","last_clean":"2024-09-14T10:54:54.903753+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:54:54.903753+0000","last_undegraded":"2024-09-14T10:54:54.903753+0000","last_fullsized":"2024-09-14T10:54:54.903753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.905650+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:54:54.905650+0000","last_peered":"2024-09-14T10:54:54.905650+0000","last_clean":"2024-09-14T10:54:54.905650+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:54:54.905650+0000","last_undegraded":"2024-09-14T10:54:54.905650+0000","last_fullsized":"2024-09-14T10:54:54.905650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903419+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:54:54.903419+0000","last_peered":"2024-09-14T10:54:54.903419+0000","last_clean":"2024-09-14T10:54:54.903419+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:54:54.903419+0000","last_undegraded":"2024-09-14T10:54:54.903419+0000","last_fullsized":"2024-09-14T10:54:54.903419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.905697+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:54:54.905697+0000","last_peered":"2024-09-14T10:54:54.905697+0000","last_clean":"2024-09-14T10:54:54.905697+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:54:54.905697+0000","last_undegraded":"2024-09-14T10:54:54.905697+0000","last_fullsized":"2024-09-14T10:54:54.905697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903726+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:54:54.903726+0000","last_peered":"2024-09-14T10:54:54.903726+0000","last_clean":"2024-09-14T10:54:54.903726+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:54:54.903726+0000","last_undegraded":"2024-09-14T10:54:54.903726+0000","last_fullsized":"2024-09-14T10:54:54.903726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.900597+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:54:54.900597+0000","last_peered":"2024-09-14T10:54:54.900597+0000","last_clean":"2024-09-14T10:54:54.900597+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:54:54.900597+0000","last_undegraded":"2024-09-14T10:54:54.900597+0000","last_fullsized":"2024-09-14T10:54:54.900597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.902942+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:54:54.902942+0000","last_peered":"2024-09-14T10:54:54.902942+0000","last_clean":"2024-09-14T10:54:54.902942+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:54:54.902942+0000","last_undegraded":"2024-09-14T10:54:54.902942+0000","last_fullsized":"2024-09-14T10:54:54.902942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903150+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:54:54.903150+0000","last_peered":"2024-09-14T10:54:54.903150+0000","last_clean":"2024-09-14T10:54:54.903150+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:54:54.903150+0000","last_undegraded":"2024-09-14T10:54:54.903150+0000","last_fullsized":"2024-09-14T10:54:54.903150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:55.142428+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:54:55.142428+0000","last_peered":"2024-09-14T10:54:55.142428+0000","last_clean":"2024-09-14T10:54:55.142428+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:54:55.142428+0000","last_undegraded":"2024-09-14T10:54:55.142428+0000","last_fullsized":"2024-09-14T10:54:55.142428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:54:59.766 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.864+0000 7fbd54b73640 1 Processor -- start 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.864+0000 7fbd54b73640 1 -- start start 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.864+0000 7fbd54b73640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd5006dfb0 0x7fbd5006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.864+0000 7fbd54b73640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd50071660 con 0x7fbd5006e8d0 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.864+0000 7fbd54b73640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fbd50072550 con 0x7fbd5006dfb0 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4dd9b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbd5006e8d0 0x7fbd50097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51166/0 (socket says 172.21.15.116:51166) 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4e59c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd5006dfb0 0x7fbd5006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4dd9b640 1 -- 172.21.15.116:0/3138535234 learned_addr learned my addr 172.21.15.116:0/3138535234 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4e59c640 1 -- 172.21.15.116:0/3138535234 >> v1:172.21.15.116:6789/0 conn(0x7fbd5006e8d0 legacy=0x7fbd50097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4e59c640 1 -- 172.21.15.116:0/3138535234 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50099e20 con 0x7fbd5006dfb0 2024-09-14T10:54:59.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.865+0000 7fbd4e59c640 1 --2- 172.21.15.116:0/3138535234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd5006e390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009720 tx=0x7fbd4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5451b5652f72bcee server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd4d59a640 1 -- 172.21.15.116:0/3138535234 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40037070 con 0x7fbd5006dfb0 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd4d59a640 1 -- 172.21.15.116:0/3138535234 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4002ae20 con 0x7fbd5006dfb0 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd4d59a640 1 -- 172.21.15.116:0/3138535234 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40032590 con 0x7fbd5006dfb0 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 -- 172.21.15.116:0/3138535234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 msgr2=0x7fbd5006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 --2- 172.21.15.116:0/3138535234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd5006e390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009720 tx=0x7fbd4002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 -- 172.21.15.116:0/3138535234 shutdown_connections 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 --2- 172.21.15.116:0/3138535234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd5006e390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 -- 172.21.15.116:0/3138535234 >> 172.21.15.116:0/3138535234 conn(0x7fbd5009abc0 msgr2=0x7fbd50098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 -- 172.21.15.116:0/3138535234 shutdown_connections 2024-09-14T10:54:59.865 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.866+0000 7fbd54b73640 1 -- 172.21.15.116:0/3138535234 wait complete. 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.867+0000 7fbd54b73640 1 Processor -- start 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.867+0000 7fbd54b73640 1 -- start start 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd54b73640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd54b73640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5006ece0 con 0x7fbd5006dfb0 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd4e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd4e59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34548/0 (socket says 172.21.15.116:34548) 2024-09-14T10:54:59.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd4e59c640 1 -- 172.21.15.116:0/945361049 learned_addr learned my addr 172.21.15.116:0/945361049 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd4e59c640 1 -- 172.21.15.116:0/945361049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50096e80 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd4e59c640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a1e0 tx=0x7fbd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40042070 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4003e590 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5008bfe0 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40037040 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.868+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5008d880 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.869+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbd40045070 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.869+0000 7fbd3effd640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 0x7fbd30040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.869+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fbd400731f0 con 0x7fbd5006dfb0 2024-09-14T10:54:59.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.869+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd5006e390 con 0x7fbd5006dfb0 2024-09-14T10:54:59.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.870+0000 7fbd4dd9b640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 0x7fbd30040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:54:59.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.870+0000 7fbd4dd9b640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 0x7fbd30040a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007fd0 tx=0x7fbd44007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:54:59.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:54:59.874+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fbd4002ae20 con 0x7fbd5006dfb0 2024-09-14T10:55:00.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.044+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd50074110 con 0x7fbd3003e570 2024-09-14T10:55:00.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.045+0000 7fbd3effd640 1 -- 172.21.15.116:0/945361049 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32179 (secure 0 0 0) 0x7fbd440058b0 con 0x7fbd3003e570 2024-09-14T10:55:00.044 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:55:00.044 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 msgr2=0x7fbd30040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 0x7fbd30040a30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd44007fd0 tx=0x7fbd44007aa0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 msgr2=0x7fbd50129290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002a1e0 tx=0x7fbd400046c0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 shutdown_connections 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd3003e570 0x7fbd30040a30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 --2- 172.21.15.116:0/945361049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5006dfb0 0x7fbd50129290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.047+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 >> 172.21.15.116:0/945361049 conn(0x7fbd5009abc0 msgr2=0x7fbd5009c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:00.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.048+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 shutdown_connections 2024-09-14T10:55:00.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.048+0000 7fbd54b73640 1 -- 172.21.15.116:0/945361049 wait complete. 2024-09-14T10:55:00.056 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-14T10:54:58.058844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109924,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377436,"statfs":{"total":386547056640,"available":386434494464,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.165071"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903753+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:54:54.903753+0000","last_peered":"2024-09-14T10:54:54.903753+0000","last_clean":"2024-09-14T10:54:54.903753+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:54:54.903753+0000","last_undegraded":"2024-09-14T10:54:54.903753+0000","last_fullsized":"2024-09-14T10:54:54.903753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.905650+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:54:54.905650+0000","last_peered":"2024-09-14T10:54:54.905650+0000","last_clean":"2024-09-14T10:54:54.905650+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:54:54.905650+0000","last_undegraded":"2024-09-14T10:54:54.905650+0000","last_fullsized":"2024-09-14T10:54:54.905650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903419+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:54:54.903419+0000","last_peered":"2024-09-14T10:54:54.903419+0000","last_clean":"2024-09-14T10:54:54.903419+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:54:54.903419+0000","last_undegraded":"2024-09-14T10:54:54.903419+0000","last_fullsized":"2024-09-14T10:54:54.903419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.905697+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:54:54.905697+0000","last_peered":"2024-09-14T10:54:54.905697+0000","last_clean":"2024-09-14T10:54:54.905697+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:54:54.905697+0000","last_undegraded":"2024-09-14T10:54:54.905697+0000","last_fullsized":"2024-09-14T10:54:54.905697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903726+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:54:54.903726+0000","last_peered":"2024-09-14T10:54:54.903726+0000","last_clean":"2024-09-14T10:54:54.903726+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:54:54.903726+0000","last_undegraded":"2024-09-14T10:54:54.903726+0000","last_fullsized":"2024-09-14T10:54:54.903726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.900597+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:54:54.900597+0000","last_peered":"2024-09-14T10:54:54.900597+0000","last_clean":"2024-09-14T10:54:54.900597+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:54:54.900597+0000","last_undegraded":"2024-09-14T10:54:54.900597+0000","last_fullsized":"2024-09-14T10:54:54.900597+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.902942+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:54:54.902942+0000","last_peered":"2024-09-14T10:54:54.902942+0000","last_clean":"2024-09-14T10:54:54.902942+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:54:54.902942+0000","last_undegraded":"2024-09-14T10:54:54.902942+0000","last_fullsized":"2024-09-14T10:54:54.902942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:54.903150+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:54:54.903150+0000","last_peered":"2024-09-14T10:54:54.903150+0000","last_clean":"2024-09-14T10:54:54.903150+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:54:54.903150+0000","last_undegraded":"2024-09-14T10:54:54.903150+0000","last_fullsized":"2024-09-14T10:54:54.903150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-14T10:54:55.142428+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:54:55.142428+0000","last_peered":"2024-09-14T10:54:55.142428+0000","last_clean":"2024-09-14T10:54:55.142428+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:54:55.142428+0000","last_undegraded":"2024-09-14T10:54:55.142428+0000","last_fullsized":"2024-09-14T10:54:55.142428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:55:00.057 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:55:00.057 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:55:00.057 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:55:00.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa08d46e640 1 Processor -- start 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa08d46e640 1 -- start start 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa08d46e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa08812c0b0 0x7fa08812c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa08d46e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08809a290 con 0x7fa08812c9d0 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa08d46e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fa088071860 con 0x7fa08812c0b0 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.155+0000 7fa086ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa08812c0b0 0x7fa08812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa086ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa08812c0b0 0x7fa08812c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34550/0 (socket says 172.21.15.116:34550) 2024-09-14T10:55:00.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa07e7fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa08812c9d0 0x7fa088097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51168/0 (socket says 172.21.15.116:51168) 2024-09-14T10:55:00.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa086ffd640 1 -- 172.21.15.116:0/3351489007 learned_addr learned my addr 172.21.15.116:0/3351489007 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:55:00.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa086ffd640 1 -- 172.21.15.116:0/3351489007 >> v1:172.21.15.116:6789/0 conn(0x7fa08812c9d0 legacy=0x7fa088097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa086ffd640 1 -- 172.21.15.116:0/3351489007 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa088099e20 con 0x7fa08812c0b0 2024-09-14T10:55:00.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa086ffd640 1 --2- 172.21.15.116:0/3351489007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa08812c490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa078009820 tx=0x7fa07802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586271326c62f15b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.156+0000 7fa0867fc640 1 -- 172.21.15.116:0/3351489007 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa078037070 con 0x7fa08812c0b0 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa0867fc640 1 -- 172.21.15.116:0/3351489007 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07802ae50 con 0x7fa08812c0b0 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa0867fc640 1 -- 172.21.15.116:0/3351489007 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa078032590 con 0x7fa08812c0b0 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 -- 172.21.15.116:0/3351489007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 msgr2=0x7fa08812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3351489007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa08812c490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa078009820 tx=0x7fa07802a210 comp rx=0 tx=0).stop 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 -- 172.21.15.116:0/3351489007 shutdown_connections 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3351489007 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa08812c490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 -- 172.21.15.116:0/3351489007 >> 172.21.15.116:0/3351489007 conn(0x7fa08809abc0 msgr2=0x7fa088098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 -- 172.21.15.116:0/3351489007 shutdown_connections 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.157+0000 7fa08d46e640 1 -- 172.21.15.116:0/3351489007 wait complete. 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.158+0000 7fa08d46e640 1 Processor -- start 2024-09-14T10:55:00.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.158+0000 7fa08d46e640 1 -- start start 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.158+0000 7fa08d46e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.158+0000 7fa08d46e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa08812ce00 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa086ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa086ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34558/0 (socket says 172.21.15.116:34558) 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa086ffd640 1 -- 172.21.15.116:0/3651862537 learned_addr learned my addr 172.21.15.116:0/3651862537 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa086ffd640 1 -- 172.21.15.116:0/3651862537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa088097f40 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa086ffd640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa078035040 tx=0x7fa0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa078042070 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07803e590 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa078037040 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08808c820 con 0x7fa08812c0b0 2024-09-14T10:55:00.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.159+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08808d200 con 0x7fa08812c0b0 2024-09-14T10:55:00.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.160+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa078045070 con 0x7fa08812c0b0 2024-09-14T10:55:00.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.160+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08808d540 con 0x7fa08812c0b0 2024-09-14T10:55:00.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.160+0000 7fa07ffff640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 0x7fa068040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.161+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fa0780733e0 con 0x7fa08812c0b0 2024-09-14T10:55:00.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.161+0000 7fa07e7fc640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 0x7fa068040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.161+0000 7fa07e7fc640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 0x7fa068040a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa070001630 tx=0x7fa070007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.165+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fa08808d540 con 0x7fa08812c0b0 2024-09-14T10:55:00.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.376+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa08812c490 con 0x7fa08812c0b0 2024-09-14T10:55:00.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.376+0000 7fa07ffff640 1 -- 172.21.15.116:0/3651862537 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa078045d70 con 0x7fa08812c0b0 2024-09-14T10:55:00.374 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:55:00.374 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:55:00.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 msgr2=0x7fa068040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 0x7fa068040a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa070001630 tx=0x7fa070007a20 comp rx=0 tx=0).stop 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 msgr2=0x7fa088128700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa078035040 tx=0x7fa0780046c0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 shutdown_connections 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa06803e570 0x7fa068040a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 --2- 172.21.15.116:0/3651862537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa08812c0b0 0x7fa088128700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 >> 172.21.15.116:0/3651862537 conn(0x7fa08809abc0 msgr2=0x7fa0880722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:00.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 shutdown_connections 2024-09-14T10:55:00.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:55:00.378+0000 7fa08d46e640 1 -- 172.21.15.116:0/3651862537 wait complete. 2024-09-14T10:55:00.386 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:55:00.387 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:55:00.401 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-14T10:55:00.402 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:55:00.402 INFO:tasks.rgw:Creating data pools 2024-09-14T10:55:00.402 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:55:00.402 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-14T10:55:00.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.515+0000 7fc4f8fe8640 1 Processor -- start 2024-09-14T10:55:00.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.515+0000 7fc4f8fe8640 1 -- start start 2024-09-14T10:55:00.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f8fe8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc4f40749e0 0x7fc4f411c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f8fe8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f4074e70 con 0x7fc4f4110900 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f8fe8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f4075040 con 0x7fc4f40749e0 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f1d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc4f40749e0 0x7fc4f411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f259c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc4f4110900 0x7fc4f40742d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58582/0 (socket says 172.21.15.164:58582) 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f259c640 1 -- 172.21.15.164:0/4258766260 learned_addr learned my addr 172.21.15.164:0/4258766260 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f1d9b640 1 -- 172.21.15.164:0/4258766260 >> v1:172.21.15.116:6789/0 conn(0x7fc4f4110900 legacy=0x7fc4f40742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f159a640 1 -- 172.21.15.164:0/4258766260 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192053635 0 0) 0x7fc4f4074e70 con 0x7fc4f4110900 2024-09-14T10:55:00.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.516+0000 7fc4f1d9b640 1 -- 172.21.15.164:0/4258766260 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f411d680 con 0x7fc4f40749e0 2024-09-14T10:55:00.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.517+0000 7fc4f1d9b640 1 --2- 172.21.15.164:0/4258766260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f411c130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009720 tx=0x7fc4e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f43b489ef18f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.517+0000 7fc4f159a640 1 -- 172.21.15.164:0/4258766260 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e8037070 con 0x7fc4f40749e0 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.517+0000 7fc4f159a640 1 -- 172.21.15.164:0/4258766260 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e802ad90 con 0x7fc4f40749e0 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.517+0000 7fc4f159a640 1 -- 172.21.15.164:0/4258766260 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e8032590 con 0x7fc4f40749e0 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/4258766260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 msgr2=0x7fc4f411c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/4258766260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f411c130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8009720 tx=0x7fc4e802a110 comp rx=0 tx=0).stop 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/4258766260 shutdown_connections 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/4258766260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f411c130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/4258766260 >> 172.21.15.164:0/4258766260 conn(0x7fc4f40702f0 msgr2=0x7fc4f4072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/4258766260 shutdown_connections 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.518+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/4258766260 wait complete. 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f8fe8640 1 Processor -- start 2024-09-14T10:55:00.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f8fe8640 1 -- start start 2024-09-14T10:55:00.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f8fe8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f8fe8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f411cb20 con 0x7fc4f40749e0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60268/0 (socket says 172.21.15.164:60268) 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.519+0000 7fc4f259c640 1 -- 172.21.15.164:0/3712952218 learned_addr learned my addr 172.21.15.164:0/3712952218 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4f259c640 1 -- 172.21.15.164:0/3712952218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f41a5a30 con 0x7fc4f40749e0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4f259c640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c3e0 tx=0x7fc4e400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e4017070 con 0x7fc4f40749e0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4005c10 con 0x7fc4f40749e0 2024-09-14T10:55:00.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f41a5d20 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4e40070d0 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.520+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41aaef0 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.521+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f41a6060 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.521+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc4e401a070 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.521+0000 7fc4e2ffd640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 0x7fc4d4040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.521+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fc4e4051ff0 con 0x7fc4f40749e0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.521+0000 7fc4f1d9b640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 0x7fc4d4040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:00.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.522+0000 7fc4f1d9b640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 0x7fc4d4040a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8034000 tx=0x7fc4e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:00.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.526+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fc4e4010300 con 0x7fc4f40749e0 2024-09-14T10:55:00.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:00.709+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fc4f411d150 con 0x7fc4f40749e0 2024-09-14T10:55:01.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.655+0000 7fc4e2ffd640 1 -- 172.21.15.164:0/3712952218 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v21) ==== 151+0+0 (secure 0 0 0) 0x7fc4e4010e20 con 0x7fc4f40749e0 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 msgr2=0x7fc4d4040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 0x7fc4d4040a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8034000 tx=0x7fc4e802e000 comp rx=0 tx=0).stop 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 msgr2=0x7fc4f41a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e400c3e0 tx=0x7fc4e400c8a0 comp rx=0 tx=0).stop 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 shutdown_connections 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc4d403e5a0 0x7fc4d4040a60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:01.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 --2- 172.21.15.164:0/3712952218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc4f40749e0 0x7fc4f41a5460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:01.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 >> 172.21.15.164:0/3712952218 conn(0x7fc4f40702f0 msgr2=0x7fc4f4115f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:01.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 shutdown_connections 2024-09-14T10:55:01.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.658+0000 7fc4f8fe8640 1 -- 172.21.15.164:0/3712952218 wait complete. 2024-09-14T10:55:01.668 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T10:55:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.777+0000 7f97a253d640 1 Processor -- start 2024-09-14T10:55:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.777+0000 7f97a253d640 1 -- start start 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f97a253d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f979c113030 0x7f979c113410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f97a253d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979c113b30 con 0x7f979c1189e0 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f97a253d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f979c119560 con 0x7f979c113030 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f979bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f979c113030 0x7f979c113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f979bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f979c113030 0x7f979c113410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60282/0 (socket says 172.21.15.164:60282) 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f979bfff640 1 -- 172.21.15.164:0/89403895 learned_addr learned my addr 172.21.15.164:0/89403895 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f979bfff640 1 -- 172.21.15.164:0/89403895 >> v1:172.21.15.116:6789/0 conn(0x7f979c1189e0 legacy=0x7f979c118e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:01.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.778+0000 7f979bfff640 1 -- 172.21.15.164:0/89403895 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c119710 con 0x7f979c113030 2024-09-14T10:55:01.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.779+0000 7f979bfff640 1 --2- 172.21.15.164:0/89403895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c113410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097f0 tx=0x7f978c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7564f115968d7160 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:01.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.779+0000 7f979b7fe640 1 -- 172.21.15.164:0/89403895 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978c037070 con 0x7f979c113030 2024-09-14T10:55:01.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.779+0000 7f979b7fe640 1 -- 172.21.15.164:0/89403895 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c032440 con 0x7f979c113030 2024-09-14T10:55:01.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.779+0000 7f979b7fe640 1 -- 172.21.15.164:0/89403895 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978c02ae60 con 0x7f979c113030 2024-09-14T10:55:01.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 -- 172.21.15.164:0/89403895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 msgr2=0x7f979c113410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 --2- 172.21.15.164:0/89403895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c113410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097f0 tx=0x7f978c02a1e0 comp rx=0 tx=0).stop 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 -- 172.21.15.164:0/89403895 shutdown_connections 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 --2- 172.21.15.164:0/89403895 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c113410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 -- 172.21.15.164:0/89403895 >> 172.21.15.164:0/89403895 conn(0x7f979c06f760 msgr2=0x7f979c06fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 -- 172.21.15.164:0/89403895 shutdown_connections 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.780+0000 7f97a253d640 1 -- 172.21.15.164:0/89403895 wait complete. 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f97a253d640 1 Processor -- start 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f97a253d640 1 -- start start 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f97a253d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f97a253d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f979c11ef70 con 0x7f979c113030 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f979bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f979bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60286/0 (socket says 172.21.15.164:60286) 2024-09-14T10:55:01.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f979bfff640 1 -- 172.21.15.164:0/2333279687 learned_addr learned my addr 172.21.15.164:0/2333279687 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.781+0000 7f979bfff640 1 -- 172.21.15.164:0/2333279687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c1a7ee0 con 0x7f979c113030 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f979bfff640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f978c02a220 tx=0x7f978c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978c041070 con 0x7f979c113030 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c03c7a0 con 0x7f979c113030 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f978c037040 con 0x7f979c113030 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c1a8170 con 0x7f979c113030 2024-09-14T10:55:01.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.782+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c1ad140 con 0x7f979c113030 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.783+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979c113410 con 0x7f979c113030 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.783+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f978c044070 con 0x7f979c113030 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.783+0000 7f97997fa640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 0x7f977c040a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.783+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3774+0+0 (secure 0 0 0) 0x7f978c073830 con 0x7f979c113030 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.783+0000 7f9793fff640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 0x7f977c040a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:01.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.784+0000 7f9793fff640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 0x7f977c040a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97840015a0 tx=0x7f9784007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:01.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.788+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f978c03ad70 con 0x7f979c113030 2024-09-14T10:55:01.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:01.963+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f979c1189e0 con 0x7f979c113030 2024-09-14T10:55:03.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.662+0000 7f97997fa640 1 -- 172.21.15.164:0/2333279687 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v23) ==== 227+0+0 (secure 0 0 0) 0x7f978c03d3f0 con 0x7f979c113030 2024-09-14T10:55:03.661 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.668+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 msgr2=0x7f977c040a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.668+0000 7f97a253d640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 0x7f977c040a10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f97840015a0 tx=0x7f9784007a30 comp rx=0 tx=0).stop 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.668+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 msgr2=0x7f979c1a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.668+0000 7f97a253d640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f978c02a220 tx=0x7f978c0046c0 comp rx=0 tx=0).stop 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 shutdown_connections 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f977c03e550 0x7f977c040a10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 --2- 172.21.15.164:0/2333279687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f979c113030 0x7f979c1a7910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 >> 172.21.15.164:0/2333279687 conn(0x7f979c06f760 msgr2=0x7f979c111e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:03.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 shutdown_connections 2024-09-14T10:55:03.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.670+0000 7f97a253d640 1 -- 172.21.15.164:0/2333279687 wait complete. 2024-09-14T10:55:03.686 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.791+0000 7f64d1789640 1 Processor -- start 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.791+0000 7f64d1789640 1 -- start start 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.791+0000 7f64d1789640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f64cc11bb10 0x7f64cc11df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.791+0000 7f64d1789640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64cc11e4d0 con 0x7f64cc117be0 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64d1789640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f64cc11f6b0 con 0x7f64cc11bb10 2024-09-14T10:55:03.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64ca7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f64cc11bb10 0x7f64cc11df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:03.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64ca7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f64cc11bb10 0x7f64cc11df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60296/0 (socket says 172.21.15.164:60296) 2024-09-14T10:55:03.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64ca7fc640 1 -- 172.21.15.164:0/236666073 learned_addr learned my addr 172.21.15.164:0/236666073 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:03.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64ca7fc640 1 -- 172.21.15.164:0/236666073 >> v1:172.21.15.116:6789/0 conn(0x7f64cc117be0 legacy=0x7f64cc117fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:03.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.792+0000 7f64ca7fc640 1 -- 172.21.15.164:0/236666073 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc11f830 con 0x7f64cc11bb10 2024-09-14T10:55:03.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.793+0000 7f64ca7fc640 1 --2- 172.21.15.164:0/236666073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc11bb10 0x7f64cc11df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097f0 tx=0x7f64b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f7664946dbea74 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.793+0000 7f64c9ffb640 1 -- 172.21.15.164:0/236666073 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b4037070 con 0x7f64cc11bb10 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.793+0000 7f64c9ffb640 1 -- 172.21.15.164:0/236666073 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b4032440 con 0x7f64cc11bb10 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.793+0000 7f64c9ffb640 1 -- 172.21.15.164:0/236666073 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b402ae60 con 0x7f64cc11bb10 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 -- 172.21.15.164:0/236666073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc11bb10 msgr2=0x7f64cc11df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 --2- 172.21.15.164:0/236666073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc11bb10 0x7f64cc11df00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097f0 tx=0x7f64b402a1e0 comp rx=0 tx=0).stop 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 -- 172.21.15.164:0/236666073 shutdown_connections 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 --2- 172.21.15.164:0/236666073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc11bb10 0x7f64cc11df00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 -- 172.21.15.164:0/236666073 >> 172.21.15.164:0/236666073 conn(0x7f64cc06f790 msgr2=0x7f64cc06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 -- 172.21.15.164:0/236666073 shutdown_connections 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 -- 172.21.15.164:0/236666073 wait complete. 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.794+0000 7f64d1789640 1 Processor -- start 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64d1789640 1 -- start start 2024-09-14T10:55:03.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64d1789640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:03.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64d1789640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc11eb80 con 0x7f64cc117be0 2024-09-14T10:55:03.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64caffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:03.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64caffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60300/0 (socket says 172.21.15.164:60300) 2024-09-14T10:55:03.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64caffd640 1 -- 172.21.15.164:0/1968490741 learned_addr learned my addr 172.21.15.164:0/1968490741 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:03.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64caffd640 1 -- 172.21.15.164:0/1968490741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc1a7ea0 con 0x7f64cc117be0 2024-09-14T10:55:03.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64caffd640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c7f0 tx=0x7f64bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:03.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.795+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64bc003970 con 0x7f64cc117be0 2024-09-14T10:55:03.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.796+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc003b30 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.796+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64bc003e50 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.796+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64cc1a8190 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.796+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64cc1ad360 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.796+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64cc1a84d0 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.797+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f64bc00a820 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.797+0000 7f64c37fe640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 0x7f64ac040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.797+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4249+0+0 (secure 0 0 0) 0x7f64bc052d80 con 0x7f64cc117be0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.797+0000 7f64ca7fc640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 0x7f64ac040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:03.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.797+0000 7f64ca7fc640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 0x7f64ac040c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64b4034000 tx=0x7f64b402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:03.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.802+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f64bc0055f0 con 0x7f64cc117be0 2024-09-14T10:55:03.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:03.976+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f64cc11f160 con 0x7f64cc117be0 2024-09-14T10:55:04.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.668+0000 7f64c37fe640 1 -- 172.21.15.164:0/1968490741 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v24) ==== 185+0+0 (secure 0 0 0) 0x7f64bc0102e0 con 0x7f64cc117be0 2024-09-14T10:55:04.666 INFO:teuthology.orchestra.run.smithi164.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:55:04.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 msgr2=0x7f64ac040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 0x7f64ac040c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f64b4034000 tx=0x7f64b402e000 comp rx=0 tx=0).stop 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 msgr2=0x7f64cc1a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c7f0 tx=0x7f64bc00ccb0 comp rx=0 tx=0).stop 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 shutdown_connections 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f64ac03e740 0x7f64ac040c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 --2- 172.21.15.164:0/1968490741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64cc117be0 0x7f64cc1a78d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 >> 172.21.15.164:0/1968490741 conn(0x7f64cc06f790 msgr2=0x7f64cc11bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 shutdown_connections 2024-09-14T10:55:04.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.670+0000 7f64d1789640 1 -- 172.21.15.164:0/1968490741 wait complete. 2024-09-14T10:55:04.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:55:04.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d7895640 1 Processor -- start 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d7895640 1 -- start start 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d7895640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f25d0074db0 0x7f25d010fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d7895640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d0110770 con 0x7f25d01102e0 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d7895640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f25d0110940 con 0x7f25d0074db0 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d5631640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f25d0074db0 0x7f25d010fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d4e30640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f25d01102e0 0x7f25d011b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58612/0 (socket says 172.21.15.164:58612) 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.800+0000 7f25d4e30640 1 -- 172.21.15.164:0/3926857691 learned_addr learned my addr 172.21.15.164:0/3926857691 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.801+0000 7f25d5631640 1 -- 172.21.15.164:0/3926857691 >> v1:172.21.15.116:6789/0 conn(0x7f25d01102e0 legacy=0x7f25d011b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:04.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.801+0000 7f25d5631640 1 -- 172.21.15.164:0/3926857691 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d0110af0 con 0x7f25d0074db0 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.801+0000 7f25d5631640 1 --2- 172.21.15.164:0/3926857691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d010fda0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009720 tx=0x7f25cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b7030e9b79ffbc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25c7fff640 1 -- 172.21.15.164:0/3926857691 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc037070 con 0x7f25d0074db0 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25c7fff640 1 -- 172.21.15.164:0/3926857691 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc02ad90 con 0x7f25d0074db0 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25c7fff640 1 -- 172.21.15.164:0/3926857691 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc032590 con 0x7f25d0074db0 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 -- 172.21.15.164:0/3926857691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 msgr2=0x7f25d010fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:04.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 --2- 172.21.15.164:0/3926857691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d010fda0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009720 tx=0x7f25cc02a110 comp rx=0 tx=0).stop 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 -- 172.21.15.164:0/3926857691 shutdown_connections 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 --2- 172.21.15.164:0/3926857691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d010fda0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 -- 172.21.15.164:0/3926857691 >> 172.21.15.164:0/3926857691 conn(0x7f25d00702f0 msgr2=0x7f25d0072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 -- 172.21.15.164:0/3926857691 shutdown_connections 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.802+0000 7f25d7895640 1 -- 172.21.15.164:0/3926857691 wait complete. 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d7895640 1 Processor -- start 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d7895640 1 -- start start 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d7895640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d7895640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f25d011ccc0 con 0x7f25d0074db0 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d5631640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d5631640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60318/0 (socket says 172.21.15.164:60318) 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.803+0000 7f25d5631640 1 -- 172.21.15.164:0/3339945382 learned_addr learned my addr 172.21.15.164:0/3339945382 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:04.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25d5631640 1 -- 172.21.15.164:0/3339945382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d01a5c60 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25d5631640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f25cc02a150 tx=0x7f25cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc041070 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc032e30 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d01a5ef0 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc037040 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.804+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d01aaec0 con 0x7f25d0074db0 2024-09-14T10:55:04.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.805+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d010fe20 con 0x7f25d0074db0 2024-09-14T10:55:04.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.805+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f25cc044070 con 0x7f25d0074db0 2024-09-14T10:55:04.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.805+0000 7f25c5ffb640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 0x7f25b4040a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:04.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.806+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4260+0+0 (secure 0 0 0) 0x7f25cc073840 con 0x7f25d0074db0 2024-09-14T10:55:04.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.806+0000 7f25d4e30640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 0x7f25b4040a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:04.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.806+0000 7f25d4e30640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 0x7f25b4040a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:04.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.811+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f25cc03cdf0 con 0x7f25d0074db0 2024-09-14T10:55:04.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:04.986+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f25d01102e0 con 0x7f25d0074db0 2024-09-14T10:55:05.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.669+0000 7f25c5ffb640 1 -- 172.21.15.164:0/3339945382 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v25) ==== 169+0+0 (secure 0 0 0) 0x7f25cc04ed60 con 0x7f25d0074db0 2024-09-14T10:55:05.667 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:55:05.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 msgr2=0x7f25b4040a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:05.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 0x7f25b4040a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007fd0 tx=0x7f25c0007aa0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 msgr2=0x7f25d01a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f25cc02a150 tx=0x7f25cc0046c0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 shutdown_connections 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f25b403e550 0x7f25b4040a10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 --2- 172.21.15.164:0/3339945382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d0074db0 0x7f25d01a5690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 >> 172.21.15.164:0/3339945382 conn(0x7f25d00702f0 msgr2=0x7f25d01186a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 shutdown_connections 2024-09-14T10:55:05.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.671+0000 7f25d7895640 1 -- 172.21.15.164:0/3339945382 wait complete. 2024-09-14T10:55:05.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:55:05.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.787+0000 7f98cd3ad640 1 Processor -- start 2024-09-14T10:55:05.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.787+0000 7f98cd3ad640 1 -- start start 2024-09-14T10:55:05.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.787+0000 7f98cd3ad640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98c8119910 0x7f98c811bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:05.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.787+0000 7f98cd3ad640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c811c240 con 0x7f98c8111080 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.787+0000 7f98cd3ad640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f98c811d440 con 0x7f98c8119910 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c67fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98c8119910 0x7f98c811bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c67fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f98c8119910 0x7f98c811bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60322/0 (socket says 172.21.15.164:60322) 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c67fc640 1 -- 172.21.15.164:0/1978696091 learned_addr learned my addr 172.21.15.164:0/1978696091 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c6ffd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f98c8111080 0x7f98c8111460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58616/0 (socket says 172.21.15.164:58616) 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c67fc640 1 -- 172.21.15.164:0/1978696091 >> v1:172.21.15.116:6789/0 conn(0x7f98c8111080 legacy=0x7f98c8111460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c67fc640 1 -- 172.21.15.164:0/1978696091 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c811d5f0 con 0x7f98c8119910 2024-09-14T10:55:05.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.788+0000 7f98c5ffb640 1 -- 172.21.15.164:0/1978696091 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825944620 0 0) 0x7f98c811c240 con 0x7f98c8111080 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.789+0000 7f98c67fc640 1 --2- 172.21.15.164:0/1978696091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8119910 0x7f98c811bd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0097f0 tx=0x7f98bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc279403643205d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.789+0000 7f98c5ffb640 1 -- 172.21.15.164:0/1978696091 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc037070 con 0x7f98c8119910 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.789+0000 7f98c5ffb640 1 -- 172.21.15.164:0/1978696091 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc032440 con 0x7f98c8119910 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.789+0000 7f98c5ffb640 1 -- 172.21.15.164:0/1978696091 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc02ae60 con 0x7f98c8119910 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- 172.21.15.164:0/1978696091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8119910 msgr2=0x7f98c811bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/1978696091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8119910 0x7f98c811bd00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f98bc0097f0 tx=0x7f98bc02a1e0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- 172.21.15.164:0/1978696091 shutdown_connections 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/1978696091 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8119910 0x7f98c811bd00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- 172.21.15.164:0/1978696091 >> 172.21.15.164:0/1978696091 conn(0x7f98c8072170 msgr2=0x7f98c8074590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- 172.21.15.164:0/1978696091 shutdown_connections 2024-09-14T10:55:05.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- 172.21.15.164:0/1978696091 wait complete. 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 Processor -- start 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.790+0000 7f98cd3ad640 1 -- start start 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98cd3ad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98cd3ad640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f98c811c8f0 con 0x7f98c8111080 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60338/0 (socket says 172.21.15.164:60338) 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98c6ffd640 1 -- 172.21.15.164:0/4045268146 learned_addr learned my addr 172.21.15.164:0/4045268146 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98c6ffd640 1 -- 172.21.15.164:0/4045268146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c8070530 con 0x7f98c8111080 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98c6ffd640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c7c0 tx=0x7f98b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.791+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b8018070 con 0x7f98c8111080 2024-09-14T10:55:05.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.792+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b8004d70 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.792+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c806ebd0 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.792+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b800a710 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.792+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c806f0f0 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.792+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c811cef0 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.793+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f98b801b070 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.793+0000 7f98af7fe640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 0x7f98b40409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.793+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4624+0+0 (secure 0 0 0) 0x7f98b80525e0 con 0x7f98c8111080 2024-09-14T10:55:05.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.793+0000 7f98c67fc640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 0x7f98b40409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:05.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.793+0000 7f98c67fc640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 0x7f98b40409e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98bc034000 tx=0x7f98bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:05.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.798+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f98b8011e10 con 0x7f98c8111080 2024-09-14T10:55:05.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:05.972+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f98c806f460 con 0x7f98c8111080 2024-09-14T10:55:06.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.677+0000 7f98af7fe640 1 -- 172.21.15.164:0/4045268146 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v26) ==== 187+0+0 (secure 0 0 0) 0x7f98b8010300 con 0x7f98c8111080 2024-09-14T10:55:06.675 INFO:teuthology.orchestra.run.smithi164.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:55:06.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.680+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 msgr2=0x7f98b40409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:06.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.680+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 0x7f98b40409e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98bc034000 tx=0x7f98bc02e000 comp rx=0 tx=0).stop 2024-09-14T10:55:06.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.680+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 msgr2=0x7f98c806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:06.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.680+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c7c0 tx=0x7f98b800cc80 comp rx=0 tx=0).stop 2024-09-14T10:55:06.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.685+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 shutdown_connections 2024-09-14T10:55:06.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.685+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f98b403e520 0x7f98b40409e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:06.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.685+0000 7f98cd3ad640 1 --2- 172.21.15.164:0/4045268146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f98c8111080 0x7f98c806e630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:06.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.685+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 >> 172.21.15.164:0/4045268146 conn(0x7f98c8072170 msgr2=0x7f98c8115be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:06.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.688+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 shutdown_connections 2024-09-14T10:55:06.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:06.688+0000 7f98cd3ad640 1 -- 172.21.15.164:0/4045268146 wait complete. 2024-09-14T10:55:06.705 DEBUG:tasks.rgw:Pools created 2024-09-14T10:55:06.706 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:55:06.706 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-14T10:55:06.706 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:55:06.706 DEBUG:teuthology.orchestra.run.smithi164:> sudo echo -n http://smithi164.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:55:06.733 INFO:teuthology.orchestra.run.smithi164.stdout:http://smithi164.front.sepia.ceph.com:80 2024-09-14T10:55:06.733 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:55:06.798 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:55:06.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:55:06.840 INFO:tasks.rgw.client.0:Started 2024-09-14T10:55:06.840 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:06.840 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:06.876 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:55:06.876 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:55:06.877 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:55:06.878 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:55:06.878 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:55:07.879 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:07.906 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:55:07.906 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:55:07.907 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:55:07.907 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:55:07.907 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:55:09.908 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:09.933 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:55:09.934 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:55:09.934 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:55:09.934 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:55:09.934 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:55:13.935 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:13.959 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:55:13.959 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:55:13.959 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:55:13.960 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:55:13.960 INFO:teuthology.orchestra.run.smithi164.stderr:curl: (7) Failed to connect to smithi164.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:55:21.962 DEBUG:teuthology.orchestra.run.smithi164:> curl http://smithi164.front.sepia.ceph.com:80/ 2024-09-14T10:55:21.985 INFO:teuthology.orchestra.run.smithi164.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:55:21.985 INFO:teuthology.orchestra.run.smithi164.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:55:21.988 INFO:teuthology.orchestra.run.smithi164.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-14T10:55:21.988 INFO:teuthology.orchestra.run.smithi164.stdout:anonymous 2024-09-14T10:55:21.988 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-14T10:55:22.069 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-14T10:55:22.069 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-14T10:55:22.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-14T10:55:22.070 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-14T10:55:22.118 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.118 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.121+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.121+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.121+0000 7f760f125800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d043cc0d60 0x55d043cc3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.121+0000 7f760f125800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d043cc3720 con 0x55d043cbacc0 2024-09-14T10:55:22.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.121+0000 7f760f125800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55d043b477d0 con 0x55d043cc0d60 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760a532640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d043cc0d60 0x55d043cc3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760ad33640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55d043cbacc0 0x55d043cbb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38474/0 (socket says 172.21.15.164:38474) 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760ad33640 1 -- 172.21.15.164:0/2470569994 learned_addr learned my addr 172.21.15.164:0/2470569994 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760a532640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d043cc0d60 0x55d043cc3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60042/0 (socket says 172.21.15.164:60042) 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760a532640 1 -- 172.21.15.164:0/2470569994 >> v1:172.21.15.116:6789/0 conn(0x55d043cbacc0 legacy=0x55d043cbb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.122+0000 7f760a532640 1 -- 172.21.15.164:0/2470569994 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043cc4900 con 0x55d043cc0d60 2024-09-14T10:55:22.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760a532640 1 --2- 172.21.15.164:0/2470569994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cc0d60 0x55d043cc3150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00a470 tx=0x7f75fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231c55fa26306f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f7609d31640 1 -- 172.21.15.164:0/2470569994 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc053570 con 0x55d043cc0d60 2024-09-14T10:55:22.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f7609d31640 1 -- 172.21.15.164:0/2470569994 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc058070 con 0x55d043cc0d60 2024-09-14T10:55:22.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f7609d31640 1 -- 172.21.15.164:0/2470569994 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75fc053880 con 0x55d043cc0d60 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760f125800 1 -- 172.21.15.164:0/2470569994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cc0d60 msgr2=0x55d043cc3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760f125800 1 --2- 172.21.15.164:0/2470569994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cc0d60 0x55d043cc3150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00a470 tx=0x7f75fc045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760f125800 1 -- 172.21.15.164:0/2470569994 shutdown_connections 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760f125800 1 --2- 172.21.15.164:0/2470569994 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cc0d60 0x55d043cc3150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.124+0000 7f760f125800 1 -- 172.21.15.164:0/2470569994 >> 172.21.15.164:0/2470569994 conn(0x55d043cb66d0 msgr2=0x55d043cb8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.125+0000 7f760f125800 1 -- 172.21.15.164:0/2470569994 shutdown_connections 2024-09-14T10:55:22.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.125+0000 7f760f125800 1 -- 172.21.15.164:0/2470569994 wait complete. 2024-09-14T10:55:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760f125800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760f125800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d043b54dd0 con 0x55d043cbacc0 2024-09-14T10:55:22.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760ad33640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760ad33640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60050/0 (socket says 172.21.15.164:60050) 2024-09-14T10:55:22.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.140+0000 7f760ad33640 1 -- 172.21.15.164:0/642806332 learned_addr learned my addr 172.21.15.164:0/642806332 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.141+0000 7f760ad33640 1 -- 172.21.15.164:0/642806332 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043dacda0 con 0x55d043cbacc0 2024-09-14T10:55:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.141+0000 7f760ad33640 1 --2- 172.21.15.164:0/642806332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f75f4001e40 tx=0x7f75f4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79039b85d3de8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.141+0000 7f74f8e09640 1 -- 172.21.15.164:0/642806332 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75f4012020 con 0x55d043cbacc0 2024-09-14T10:55:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.141+0000 7f74f8e09640 1 -- 172.21.15.164:0/642806332 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f400e5a0 con 0x55d043cbacc0 2024-09-14T10:55:22.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.141+0000 7f74f8e09640 1 -- 172.21.15.164:0/642806332 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75f400e8a0 con 0x55d043cbacc0 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- 172.21.15.164:0/642806332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 msgr2=0x55d043dac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 --2- 172.21.15.164:0/642806332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f75f4001e40 tx=0x7f75f4001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- 172.21.15.164:0/642806332 shutdown_connections 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 --2- 172.21.15.164:0/642806332 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043dac7b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- 172.21.15.164:0/642806332 >> 172.21.15.164:0/642806332 conn(0x55d043cb66d0 msgr2=0x55d043da8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- 172.21.15.164:0/642806332 shutdown_connections 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- 172.21.15.164:0/642806332 wait complete. 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.142+0000 7f760f125800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d043cc3bf0 con 0x55d043cbacc0 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760ad33640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760ad33640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60056/0 (socket says 172.21.15.164:60056) 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760ad33640 1 -- 172.21.15.164:0/3816074813 learned_addr learned my addr 172.21.15.164:0/3816074813 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760ad33640 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043db4880 con 0x55d043cbacc0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760ad33640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c010 tx=0x7f75f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f74f7606640 1 -- 172.21.15.164:0/3816074813 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75f4012030 con 0x55d043cbacc0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f74f7606640 1 -- 172.21.15.164:0/3816074813 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f40014a0 con 0x55d043cbacc0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d043db4b10 con 0x55d043cbacc0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f74f7606640 1 -- 172.21.15.164:0/3816074813 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75f401a7a0 con 0x55d043cbacc0 2024-09-14T10:55:22.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.143+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d043db5510 con 0x55d043cbacc0 2024-09-14T10:55:22.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f74f7606640 1 -- 172.21.15.164:0/3816074813 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f75f4015020 con 0x55d043cbacc0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f74f7606640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 0x7f74f003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f74f7606640 1 -- 172.21.15.164:0/3816074813 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f75f4020030 con 0x55d043cbacc0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f760a532640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 0x7f74f003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 0x55d043dbb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.145+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043db60a0 con 0x55d043cc0d60 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760b534640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 0x55d043dbb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760a532640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 0x7f74f003f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00a470 tx=0x7f75fc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760b534640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 0x55d043dbb970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760b534640 1 -- 172.21.15.164:0/3816074813 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f760400a4d0 con 0x55d043cc0d60 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043db59a0 con 0x55d043cc0d60 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760b534640 1 -- 172.21.15.164:0/3816074813 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f760400a4d0 con 0x55d043cc0d60 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 0x55d043dc01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.146+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dc08a0 con 0x55d043dbdde0 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760ad33640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 0x55d043dc01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760ad33640 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 0x55d043dc01d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760ad33640 1 -- 172.21.15.164:0/3816074813 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75f40187b0 con 0x55d043dbdde0 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dbcc80 con 0x55d043cc0d60 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760b534640 1 -- 172.21.15.164:0/3816074813 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f760400a4d0 con 0x55d043cc0d60 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.147+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dbd120 con 0x55d043cc0d60 2024-09-14T10:55:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.148+0000 7f760b534640 1 -- 172.21.15.164:0/3816074813 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f760400a4d0 con 0x55d043cc0d60 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.148+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.148+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.148+0000 7f760f125800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.148+0000 7f760f125800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d043bb34a0 con 0x55d043dcf280 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60072/0 (socket says 172.21.15.164:60072) 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760b534640 1 -- 172.21.15.164:0/3381846263 learned_addr learned my addr 172.21.15.164:0/3381846263 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760b534640 1 -- 172.21.15.164:0/3381846263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043dcfce0 con 0x55d043dcf280 2024-09-14T10:55:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760b534640 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55d043dbbeb0 tx=0x7f7604018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f74f4e01640 1 -- 172.21.15.164:0/3381846263 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7604014450 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f74f4e01640 1 -- 172.21.15.164:0/3381846263 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76040145f0 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f74f4e01640 1 -- 172.21.15.164:0/3381846263 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7604014910 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.149+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d043dd0510 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.150+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d043dd0ab0 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.150+0000 7f74f4e01640 1 -- 172.21.15.164:0/3381846263 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7604011040 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f74f4e01640 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 0x7f74e403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f74f4e01640 1 -- 172.21.15.164:0/3381846263 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f760401e070 con 0x55d043dcf280 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760ad33640 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 0x7f74e403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760ad33640 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 0x7f74e403f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55d043dbbf50 tx=0x7f75f4052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760f125800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760f125800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d043dad1d0 con 0x55d043cbbd40 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.151+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60074/0 (socket says 172.21.15.164:60074) 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f760b534640 1 -- 172.21.15.164:0/1632322345 learned_addr learned my addr 172.21.15.164:0/1632322345 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f760b534640 1 -- 172.21.15.164:0/1632322345 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043cbc710 con 0x55d043cbbd40 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f760b534640 1 --2- 172.21.15.164:0/1632322345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7604016620 tx=0x7f7604011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e6798b50f5d22 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f74ee7fc640 1 -- 172.21.15.164:0/1632322345 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7604028070 con 0x55d043cbbd40 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f74ee7fc640 1 -- 172.21.15.164:0/1632322345 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604022de0 con 0x55d043cbbd40 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.152+0000 7f74ee7fc640 1 -- 172.21.15.164:0/1632322345 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f760402b350 con 0x55d043cbbd40 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- 172.21.15.164:0/1632322345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 msgr2=0x55d043cbc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 --2- 172.21.15.164:0/1632322345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7604016620 tx=0x7f7604011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- 172.21.15.164:0/1632322345 shutdown_connections 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 --2- 172.21.15.164:0/1632322345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043cbc120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- 172.21.15.164:0/1632322345 >> 172.21.15.164:0/1632322345 conn(0x55d043dd80b0 msgr2=0x55d043dd62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- 172.21.15.164:0/1632322345 shutdown_connections 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- 172.21.15.164:0/1632322345 wait complete. 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 Processor -- start 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- start start 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043de5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760f125800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d043cbcda0 con 0x55d043cbbd40 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043de5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760b534640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043de5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60076/0 (socket says 172.21.15.164:60076) 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.153+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 learned_addr learned my addr 172.21.15.164:0/3116780862 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d043de5970 con 0x55d043cbbd40 2024-09-14T10:55:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f760b534640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043de5410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7604022f90 tx=0x7f7604054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f74ecff9640 1 -- 172.21.15.164:0/3116780862 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7604044070 con 0x55d043cbbd40 2024-09-14T10:55:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f74ecff9640 1 -- 172.21.15.164:0/3116780862 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7604032070 con 0x55d043cbbd40 2024-09-14T10:55:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f74ecff9640 1 -- 172.21.15.164:0/3116780862 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7604054cd0 con 0x55d043cbbd40 2024-09-14T10:55:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d043de5c00 con 0x55d043cbbd40 2024-09-14T10:55:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.154+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d043de6580 con 0x55d043cbbd40 2024-09-14T10:55:22.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f74ecff9640 1 -- 172.21.15.164:0/3116780862 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7604001770 con 0x55d043cbbd40 2024-09-14T10:55:22.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f74ecff9640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74d403ce10 0x7f74d403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f74ecff9640 1 -- 172.21.15.164:0/3116780862 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f760400e040 con 0x55d043cbbd40 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f760ad33640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74d403ce10 0x7f74d403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043df11e0 0x55d043df3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.155+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df3dc0 con 0x55d043df11e0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760a532640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043df11e0 0x55d043df3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760ad33640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74d403ce10 0x7f74d403f2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75f4018ac0 tx=0x7f75f4048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760a532640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043df11e0 0x55d043df3670 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760f125800 20 realm 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df41f0 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.156+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df4ac0 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df4e60 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043df5bc0 0x55d043df7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df84f0 con 0x55d043df5bc0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760b534640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043df5bc0 0x55d043df7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.157+0000 7f760b534640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043df5bc0 0x55d043df7fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f760402a070 con 0x55d043df5bc0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760f125800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760f125800 20 searching for the correct realm 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f760402a070 con 0x55d043df5bc0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760b534640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7604014070 0x7f7604037970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760ad33640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7604014070 0x7f7604037970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.158+0000 7f760ad33640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7604014070 0x7f7604037970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.159+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.159+0000 7f760ad33640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f75f4017050 0x7f75f404b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.159+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.159+0000 7f760a532640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f75f4017050 0x7f75f404b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.159+0000 7f760a532640 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f75f4017050 0x7f75f404b640 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.160+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760402a070 con 0x55d043df5bc0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.161+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.162+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760402a070 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f760402a070 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.163+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.164+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.165+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.166+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df5bc0 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f75f4017050 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x55d043df11e0 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.167+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9e70 con 0x7f7604014070 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df8f90 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043df9830 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 zone default found 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 4 Realm: () 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 zonegroup default 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.168+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa6c0 con 0x7f75f4017050 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfc1e0 con 0x55d043df5bc0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfc6d0 con 0x55d043df5bc0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 started sync module instance, tier type = 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.169+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfb550 con 0x7f7604014070 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.170+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.170+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94352980293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfcfe0 con 0x7f7604014070 2024-09-14T10:55:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.170+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfd830 con 0x55d043df11e0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.172+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94352980293952] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.172+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.172+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94352980298544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfd910 con 0x55d043df11e0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.172+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfe410 con 0x55d043df5bc0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.174+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94352980298544] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.174+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.174+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94352980303616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfe3d0 con 0x55d043df5bc0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.174+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfee80 con 0x7f7604014070 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.177+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94352980303616] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.177+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.177+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94352980300672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.177+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dffcd0 con 0x55d043df11e0 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.180+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.180+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94352980309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e005a0 con 0x55d043df11e0 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.180+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e01090 con 0x7f75f4017050 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.182+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94352980300672] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.183+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.183+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94352980314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e01050 con 0x7f75f4017050 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.183+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e01aa0 con 0x7f75f4017050 2024-09-14T10:55:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.185+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94352980309984] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.185+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.185+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94352980312304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e01aa0 con 0x7f75f4017050 2024-09-14T10:55:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.185+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e02460 con 0x7f75f4017050 2024-09-14T10:55:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.185+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94352980314976] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94352980312304] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94352980306320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e01fb0 con 0x7f75f4017050 2024-09-14T10:55:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=0 2024-09-14T10:55:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=1 2024-09-14T10:55:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=2 2024-09-14T10:55:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=3 2024-09-14T10:55:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=4 2024-09-14T10:55:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=5 2024-09-14T10:55:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.188+0000 7f760f125800 20 add_watcher() i=6 2024-09-14T10:55:22.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.191+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94352980306320] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.191+0000 7f760f125800 20 add_watcher() i=7 2024-09-14T10:55:22.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.191+0000 7f760f125800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:22.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.191+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d043e02410 con 0x55d043df11e0 2024-09-14T10:55:22.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.192+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.192+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94352980317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043e02410 con 0x55d043df11e0 2024-09-14T10:55:22.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94352980317680] v35'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f74c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760f125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760f125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760f125800 5 note: GC not initialized 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f743bfff640 20 reqs_thread_entry: start 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760f125800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.194+0000 7f760f125800 20 Filter name: none 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f7439ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:22.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043e37dc0 con 0x55d043df5bc0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfc6d0 con 0x55d043df5bc0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfc6d0 con 0x55d043df11e0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.195+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x55d043df11e0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x7f7604014070 2024-09-14T10:55:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(67 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.196+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.197+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.198+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(80 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.199+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.200+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.201+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f75f4017050 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df11e0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x55d043df5bc0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.202+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d043dff2a0 con 0x7f7604014070 2024-09-14T10:55:22.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.203+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.203+0000 7f74c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.203+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94352980317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfc6d0 con 0x55d043df11e0 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.205+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94352980317680] v35'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.205+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94352980293952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x7f7604014070 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.207+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94352980293952] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.207+0000 7f760f125800 20 remove_watcher() i=0 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.207+0000 7f760f125800 2 removed watcher, disabling cache 2024-09-14T10:55:22.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.208+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94352980298544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x55d043df11e0 2024-09-14T10:55:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.209+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94352980298544] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.209+0000 7f760f125800 20 remove_watcher() i=1 2024-09-14T10:55:22.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.209+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94352980303616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfa320 con 0x55d043df5bc0 2024-09-14T10:55:22.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.211+0000 7f760b534640 1 -- 172.21.15.164:0/3116780862 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94352980303616] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7604068040 con 0x55d043df5bc0 2024-09-14T10:55:22.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.211+0000 7f760f125800 20 remove_watcher() i=2 2024-09-14T10:55:22.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.211+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94352980300672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfb940 con 0x7f7604014070 2024-09-14T10:55:22.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.212+0000 7f760ad33640 1 -- 172.21.15.164:0/3116780862 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94352980300672] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75f40187b0 con 0x7f7604014070 2024-09-14T10:55:22.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.212+0000 7f760f125800 20 remove_watcher() i=3 2024-09-14T10:55:22.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.212+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94352980309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfcb30 con 0x55d043df11e0 2024-09-14T10:55:22.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.214+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94352980309984] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x55d043df11e0 2024-09-14T10:55:22.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.214+0000 7f760f125800 20 remove_watcher() i=4 2024-09-14T10:55:22.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.214+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94352980314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfd380 con 0x7f75f4017050 2024-09-14T10:55:22.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.215+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94352980314976] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.215+0000 7f760f125800 20 remove_watcher() i=5 2024-09-14T10:55:22.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.215+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94352980312304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfd380 con 0x7f75f4017050 2024-09-14T10:55:22.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.216+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94352980312304] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.216+0000 7f760f125800 20 remove_watcher() i=6 2024-09-14T10:55:22.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.216+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94352980306320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d043dfd380 con 0x7f75f4017050 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94352980306320] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75fc051070 con 0x7f75f4017050 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 20 remove_watcher() i=7 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f75f4017050 msgr2=0x7f75f404b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f75f4017050 0x7f75f404b640 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043df11e0 msgr2=0x55d043df3670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043df11e0 0x55d043df3670 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7604014070 msgr2=0x7f7604037970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7604014070 0x7f7604037970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043df5bc0 msgr2=0x55d043df7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043df5bc0 0x55d043df7fb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74d403ce10 msgr2=0x7f74d403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74d403ce10 0x7f74d403f2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75f4018ac0 tx=0x7f75f4048000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 msgr2=0x55d043de5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 --2- 172.21.15.164:0/3116780862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbbd40 0x55d043de5410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7604022f90 tx=0x7f7604054510 comp rx=0 tx=0).stop 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760a532640 1 -- 172.21.15.164:0/3116780862 reap_dead start 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 shutdown_connections 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.217+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 >> 172.21.15.164:0/3116780862 conn(0x55d043dd80b0 msgr2=0x55d043dd62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 shutdown_connections 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3116780862 wait complete. 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 msgr2=0x7f74e403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 0x7f74e403f320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x55d043dbbf50 tx=0x7f75f4052770 comp rx=0 tx=0).stop 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 msgr2=0x55d043dcf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55d043dbbeb0 tx=0x7f7604018830 comp rx=0 tx=0).stop 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 shutdown_connections 2024-09-14T10:55:22.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74e403ce60 0x7f74e403f320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3381846263 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043dcf280 0x55d043dcf6a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 >> 172.21.15.164:0/3381846263 conn(0x55d043dc3630 msgr2=0x55d043dc3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 shutdown_connections 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3381846263 wait complete. 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 msgr2=0x55d043dbb970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 0x55d043dbb970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 msgr2=0x55d043dc01d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 0x55d043dc01d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 msgr2=0x7f74f003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 0x7f74f003f320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00a470 tx=0x7f75fc052000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 msgr2=0x55d043db4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75f400c010 tx=0x7f75f4000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 shutdown_connections 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d043dbdde0 0x55d043dc01d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d043cc0d60 0x55d043dbb970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f74f003ce60 0x7f74f003f320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.218+0000 7f760f125800 1 --2- 172.21.15.164:0/3816074813 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d043cbacc0 0x55d043db4320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.219+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 >> 172.21.15.164:0/3816074813 conn(0x55d043cb66d0 msgr2=0x55d043dadca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.219+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 shutdown_connections 2024-09-14T10:55:22.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.219+0000 7f760f125800 1 -- 172.21.15.164:0/3816074813 wait complete. 2024-09-14T10:55:22.236 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-14T10:55:22.237 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:55:22.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-14T10:55:22.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-14T10:55:22.237 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-14T10:55:22.281 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.281 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f744b887800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56446e2f2790 0x56446e2f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f744b887800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56446e2f4470 con 0x56446e2f38b0 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f744b887800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x56446e17e7d0 con 0x56446e2f2790 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f7449371640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56446e2f2790 0x56446e2f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f7448b70640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x56446e2f38b0 0x56446e2f3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38482/0 (socket says 172.21.15.164:38482) 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f7449371640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56446e2f2790 0x56446e2f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60090/0 (socket says 172.21.15.164:60090) 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.284+0000 7f7448b70640 1 -- 172.21.15.164:0/3456445471 learned_addr learned my addr 172.21.15.164:0/3456445471 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.285+0000 7f7449371640 1 -- 172.21.15.164:0/3456445471 >> v1:172.21.15.116:6789/0 conn(0x56446e2f38b0 legacy=0x56446e2f3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.285+0000 7f743bfff640 1 -- 172.21.15.164:0/3456445471 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059810627 0 0) 0x56446e2f4470 con 0x56446e2f38b0 2024-09-14T10:55:22.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.285+0000 7f7449371640 1 -- 172.21.15.164:0/3456445471 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e2f4640 con 0x56446e2f2790 2024-09-14T10:55:22.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f7449371640 1 --2- 172.21.15.164:0/3456445471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e2f2b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f743c00a600 tx=0x7f743c047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557b1c3db50b4234 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f743bfff640 1 -- 172.21.15.164:0/3456445471 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c056070 con 0x56446e2f2790 2024-09-14T10:55:22.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f743bfff640 1 -- 172.21.15.164:0/3456445471 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c00a200 con 0x56446e2f2790 2024-09-14T10:55:22.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f743bfff640 1 -- 172.21.15.164:0/3456445471 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c008590 con 0x56446e2f2790 2024-09-14T10:55:22.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 -- 172.21.15.164:0/3456445471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 msgr2=0x56446e2f2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 --2- 172.21.15.164:0/3456445471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e2f2b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f743c00a600 tx=0x7f743c047cb0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 -- 172.21.15.164:0/3456445471 shutdown_connections 2024-09-14T10:55:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 --2- 172.21.15.164:0/3456445471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e2f2b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 -- 172.21.15.164:0/3456445471 >> 172.21.15.164:0/3456445471 conn(0x56446e2edf80 msgr2=0x56446e2f03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 -- 172.21.15.164:0/3456445471 shutdown_connections 2024-09-14T10:55:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.287+0000 7f744b887800 1 -- 172.21.15.164:0/3456445471 wait complete. 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f744b887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f744b887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56446e18bdd0 con 0x56446e2f2790 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f7449371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f7449371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60104/0 (socket says 172.21.15.164:60104) 2024-09-14T10:55:22.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.301+0000 7f7449371640 1 -- 172.21.15.164:0/2845217143 learned_addr learned my addr 172.21.15.164:0/2845217143 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.302+0000 7f7449371640 1 -- 172.21.15.164:0/2845217143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e3e5dc0 con 0x56446e2f2790 2024-09-14T10:55:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.302+0000 7f7449371640 1 --2- 172.21.15.164:0/2845217143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f743c027ae0 tx=0x7f743c053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e7c1f22d40b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.302+0000 7f7337606640 1 -- 172.21.15.164:0/2845217143 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c008780 con 0x56446e2f2790 2024-09-14T10:55:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.302+0000 7f7337606640 1 -- 172.21.15.164:0/2845217143 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c008920 con 0x56446e2f2790 2024-09-14T10:55:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.302+0000 7f7337606640 1 -- 172.21.15.164:0/2845217143 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c008c00 con 0x56446e2f2790 2024-09-14T10:55:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- 172.21.15.164:0/2845217143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 msgr2=0x56446e3e57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 --2- 172.21.15.164:0/2845217143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f743c027ae0 tx=0x7f743c053000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- 172.21.15.164:0/2845217143 shutdown_connections 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 --2- 172.21.15.164:0/2845217143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3e57d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- 172.21.15.164:0/2845217143 >> 172.21.15.164:0/2845217143 conn(0x56446e2edf80 msgr2=0x56446e3dcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- 172.21.15.164:0/2845217143 shutdown_connections 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- 172.21.15.164:0/2845217143 wait complete. 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f744b887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56446e266610 con 0x56446e2f2790 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f7449371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f7449371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60114/0 (socket says 172.21.15.164:60114) 2024-09-14T10:55:22.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.303+0000 7f7449371640 1 -- 172.21.15.164:0/3687803018 learned_addr learned my addr 172.21.15.164:0/3687803018 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f7449371640 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e3ed7c0 con 0x56446e2f2790 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f7449371640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f743c027ae0 tx=0x7f743c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f7335e03640 1 -- 172.21.15.164:0/3687803018 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c008cc0 con 0x56446e2f2790 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f7335e03640 1 -- 172.21.15.164:0/3687803018 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c051470 con 0x56446e2f2790 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f7335e03640 1 -- 172.21.15.164:0/3687803018 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743c008e60 con 0x56446e2f2790 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446e3eda50 con 0x56446e2f2790 2024-09-14T10:55:22.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.304+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446e3ee660 con 0x56446e2f2790 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f7335e03640 1 -- 172.21.15.164:0/3687803018 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f743c06e030 con 0x56446e2f2790 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f7335e03640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 0x7f733003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f7335e03640 1 -- 172.21.15.164:0/3687803018 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f743c06c070 con 0x56446e2f2790 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f7448b70640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 0x7f733003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 0x56446e3f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.305+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e3f4df0 con 0x56446e2f38b0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f7449b72640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 0x56446e3f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f7448b70640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 0x7f733003f2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7440000c00 tx=0x7f74400013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f7449b72640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 0x56446e3f48b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f7449b72640 1 -- 172.21.15.164:0/3687803018 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744400a4d0 con 0x56446e2f38b0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e3f5190 con 0x56446e2f38b0 2024-09-14T10:55:22.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f7449b72640 1 -- 172.21.15.164:0/3687803018 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f744400a4d0 con 0x56446e2f38b0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 0x56446e3f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.306+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e3f9850 con 0x56446e3f6c50 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f7449371640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 0x56446e3f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f7449371640 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 0x56446e3f90c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f7449371640 1 -- 172.21.15.164:0/3687803018 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f743c077070 con 0x56446e3f6c50 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e3f59e0 con 0x56446e2f38b0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f7449b72640 1 -- 172.21.15.164:0/3687803018 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f744400a4d0 con 0x56446e2f38b0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.307+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e3f5d80 con 0x56446e2f38b0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f7449b72640 1 -- 172.21.15.164:0/3687803018 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f744400a4d0 con 0x56446e2f38b0 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f744b887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f744b887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56446e1ea4a0 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.308+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60128/0 (socket says 172.21.15.164:60128) 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f7449b72640 1 -- 172.21.15.164:0/587607548 learned_addr learned my addr 172.21.15.164:0/587607548 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f7449b72640 1 -- 172.21.15.164:0/587607548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e408be0 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f7449b72640 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56446e3ee0f0 tx=0x7f7444018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f732effd640 1 -- 172.21.15.164:0/587607548 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444014450 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f732effd640 1 -- 172.21.15.164:0/587607548 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444014610 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446e409410 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f732effd640 1 -- 172.21.15.164:0/587607548 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444014930 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.309+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446e4099b0 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.310+0000 7f732effd640 1 -- 172.21.15.164:0/587607548 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7444011040 con 0x56446e408180 2024-09-14T10:55:22.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.310+0000 7f732effd640 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.310+0000 7f732effd640 1 -- 172.21.15.164:0/587607548 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f744401e070 con 0x56446e408180 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.310+0000 7f7449371640 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f7449371640 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f743c0647d0 tx=0x7f743c0959b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f744b887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f744b887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56446e3e6130 con 0x56446e414c20 2024-09-14T10:55:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60140/0 (socket says 172.21.15.164:60140) 2024-09-14T10:55:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f7449b72640 1 -- 172.21.15.164:0/4026892906 learned_addr learned my addr 172.21.15.164:0/4026892906 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.311+0000 7f7449b72640 1 -- 172.21.15.164:0/4026892906 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e415610 con 0x56446e414c20 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f7449b72640 1 --2- 172.21.15.164:0/4026892906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7444016fd0 tx=0x7f7444011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51142c2fc272afa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f732cff9640 1 -- 172.21.15.164:0/4026892906 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744404b070 con 0x56446e414c20 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f732cff9640 1 -- 172.21.15.164:0/4026892906 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444051070 con 0x56446e414c20 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f732cff9640 1 -- 172.21.15.164:0/4026892906 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444016440 con 0x56446e414c20 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 -- 172.21.15.164:0/4026892906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 msgr2=0x56446e415020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 --2- 172.21.15.164:0/4026892906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7444016fd0 tx=0x7f7444011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 -- 172.21.15.164:0/4026892906 shutdown_connections 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 --2- 172.21.15.164:0/4026892906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e415020 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 -- 172.21.15.164:0/4026892906 >> 172.21.15.164:0/4026892906 conn(0x56446e411020 msgr2=0x56446e40f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 -- 172.21.15.164:0/4026892906 shutdown_connections 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.312+0000 7f744b887800 1 -- 172.21.15.164:0/4026892906 wait complete. 2024-09-14T10:55:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f744b887800 1 Processor -- start 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f744b887800 1 -- start start 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f744b887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e41c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f744b887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56446e415c30 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e41c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f7449b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e41c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60148/0 (socket says 172.21.15.164:60148) 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 learned_addr learned my addr 172.21.15.164:0/2944984147 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.313+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56446e41c7c0 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f7449b72640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e41c260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7444053420 tx=0x7f7444054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f731affd640 1 -- 172.21.15.164:0/2944984147 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744404b040 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f731affd640 1 -- 172.21.15.164:0/2944984147 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444016440 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f731affd640 1 -- 172.21.15.164:0/2944984147 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7444011330 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56446e41ca50 con 0x56446e414c20 2024-09-14T10:55:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.314+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56446e41d3d0 con 0x56446e414c20 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f731affd640 1 -- 172.21.15.164:0/2944984147 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7444014ad0 con 0x56446e414c20 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f731affd640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f731403ce10 0x7f731403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f731affd640 1 -- 172.21.15.164:0/2944984147 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f744400e040 con 0x56446e414c20 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f7449371640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f731403ce10 0x7f731403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f7449371640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f731403ce10 0x7f731403f2d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f743c06ffd0 tx=0x7f743c088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e427fb0 0x56446e42a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.315+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e42abc0 con 0x56446e427fb0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f7448b70640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e427fb0 0x56446e42a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f7448b70640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e427fb0 0x56446e42a470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744000f5f0 con 0x56446e427fb0 2024-09-14T10:55:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 20 realm 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e427300 con 0x56446e427fb0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744000f5f0 con 0x56446e427fb0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.316+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e42b6b0 con 0x56446e427fb0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744000f5f0 con 0x56446e427fb0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e42bf80 con 0x56446e427fb0 2024-09-14T10:55:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f744000f5f0 con 0x56446e427fb0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e42c9a0 0x56446e42ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e42f500 con 0x56446e42c9a0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f7449b72640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e42c9a0 0x56446e42ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.317+0000 7f7449b72640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e42c9a0 0x56446e42ed90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f744b887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f744b887800 20 searching for the correct realm 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449b72640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7444014070 0x7f744404f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449371640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7444014070 0x7f744404f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449371640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7444014070 0x7f744404f0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.318+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7449371640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f743c08d040 0x7f743c064840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7448b70640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f743c08d040 0x7f743c064840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7448b70640 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f743c08d040 0x7f743c064840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744000f5f0 con 0x7f743c08d040 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.319+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744000f5f0 con 0x56446e427fb0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.320+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x7f743c08d040 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.321+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x7f743c08d040 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.322+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.323+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x7f743c08d040 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744002b040 con 0x56446e427fb0 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.324+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.325+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e42c9a0 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f743c08d040 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x56446e427fb0 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.326+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56446e430df0 con 0x7f7444014070 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:22.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e42fec0 con 0x56446e427fb0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e430760 con 0x56446e427fb0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e431270 con 0x56446e427fb0 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 zone default found 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 4 Realm: () 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 zonegroup default 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.327+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e431270 con 0x7f743c08d040 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e433110 con 0x56446e42c9a0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e4334b0 con 0x56446e42c9a0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 started sync module instance, tier type = 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.328+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4325a0 con 0x7f7444014070 2024-09-14T10:55:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.329+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.330+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851907660176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e433d50 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.330+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4345a0 con 0x56446e427fb0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.332+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.332+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851907666160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e434b80 con 0x56446e427fb0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.332+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435680 con 0x56446e42c9a0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.332+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851907660176] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.334+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.334+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851907666160] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.334+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851907670384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435640 con 0x56446e42c9a0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.335+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435f50 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.337+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851907670384] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.337+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.337+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851907672736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435640 con 0x7f7444014070 2024-09-14T10:55:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.337+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e436a10 con 0x56446e427fb0 2024-09-14T10:55:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.340+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.340+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851907675360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4372b0 con 0x56446e427fb0 2024-09-14T10:55:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.340+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e437db0 con 0x7f743c08d040 2024-09-14T10:55:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.341+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.341+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851907680416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e437d70 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.341+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e438d20 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.342+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.342+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851907684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4391d0 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.342+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e439c70 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.343+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851907672736] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.343+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851907680416] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.344+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851907684432] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.345+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851907675360] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851907677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4338a0 con 0x7f743c08d040 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=0 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=1 2024-09-14T10:55:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=2 2024-09-14T10:55:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=3 2024-09-14T10:55:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=4 2024-09-14T10:55:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=5 2024-09-14T10:55:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.346+0000 7f744b887800 20 add_watcher() i=6 2024-09-14T10:55:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.348+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851907677696] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.348+0000 7f744b887800 20 add_watcher() i=7 2024-09-14T10:55:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.348+0000 7f744b887800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.348+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e438180 con 0x56446e427fb0 2024-09-14T10:55:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.349+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.349+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851907688256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e438180 con 0x56446e427fb0 2024-09-14T10:55:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.350+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851907688256] v35'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.350+0000 7f72fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.350+0000 7f744b887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.350+0000 7f744b887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.350+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4449f0 con 0x56446e427fb0 2024-09-14T10:55:22.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.352+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.352+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e4449f0 con 0x7f743c08d040 2024-09-14T10:55:22.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.354+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.354+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e445530 con 0x56446e42c9a0 2024-09-14T10:55:22.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.355+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.355+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e445530 con 0x56446e427fb0 2024-09-14T10:55:22.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.356+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.356+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e445ae0 con 0x7f7444014070 2024-09-14T10:55:22.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.359+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.359+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446350 con 0x56446e42c9a0 2024-09-14T10:55:22.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.360+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.360+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e427fb0 2024-09-14T10:55:22.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.362+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.362+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.363+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.363+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.364+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.364+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.365+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.365+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.366+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.366+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.367+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.367+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.368+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.368+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.370+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.370+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e427fb0 2024-09-14T10:55:22.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.371+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.371+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.372+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.372+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.373+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.373+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.374+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.374+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e427fb0 2024-09-14T10:55:22.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.375+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.375+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e427fb0 2024-09-14T10:55:22.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.376+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.376+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.377+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.377+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.378+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.378+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.379+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.379+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.381+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.381+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.382+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.382+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.383+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.383+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.384+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.384+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.385+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.385+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.386+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.386+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x56446e42c9a0 2024-09-14T10:55:22.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.387+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.387+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f743c08d040 2024-09-14T10:55:22.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.388+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.388+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e446330 con 0x7f7444014070 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.389+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.389+0000 7f72fefe5640 20 reqs_thread_entry: start 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.389+0000 7f744b887800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.389+0000 7f744b887800 20 Filter name: none 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f72fcfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56446e4716a0 con 0x7f7444014070 2024-09-14T10:55:22.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-14T10:55:22.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.390+0000 7f744b887800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:55:22.389 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:55:22.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.391+0000 7f72fffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.391+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851907688256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e443c60 con 0x56446e427fb0 2024-09-14T10:55:22.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.392+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94851907688256] v35'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.392+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851907660176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e443c60 con 0x7f7444014070 2024-09-14T10:55:22.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.393+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94851907660176] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.393+0000 7f744b887800 20 remove_watcher() i=0 2024-09-14T10:55:22.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.393+0000 7f744b887800 2 removed watcher, disabling cache 2024-09-14T10:55:22.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.393+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851907666160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e432990 con 0x56446e427fb0 2024-09-14T10:55:22.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.394+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94851907666160] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.394+0000 7f744b887800 20 remove_watcher() i=1 2024-09-14T10:55:22.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.394+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851907670384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e432990 con 0x56446e42c9a0 2024-09-14T10:55:22.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.395+0000 7f7449b72640 1 -- 172.21.15.164:0/2944984147 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94851907670384] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744402a070 con 0x56446e42c9a0 2024-09-14T10:55:22.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.395+0000 7f744b887800 20 remove_watcher() i=2 2024-09-14T10:55:22.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.395+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851907672736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e432990 con 0x7f7444014070 2024-09-14T10:55:22.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.396+0000 7f7449371640 1 -- 172.21.15.164:0/2944984147 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94851907672736] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c077070 con 0x7f7444014070 2024-09-14T10:55:22.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.396+0000 7f744b887800 20 remove_watcher() i=3 2024-09-14T10:55:22.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.396+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851907675360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435aa0 con 0x56446e427fb0 2024-09-14T10:55:22.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.397+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94851907675360] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x56446e427fb0 2024-09-14T10:55:22.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.397+0000 7f744b887800 20 remove_watcher() i=4 2024-09-14T10:55:22.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.397+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851907680416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e432990 con 0x7f743c08d040 2024-09-14T10:55:22.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.399+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94851907680416] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.399+0000 7f744b887800 20 remove_watcher() i=5 2024-09-14T10:55:22.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.399+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851907684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e435aa0 con 0x7f743c08d040 2024-09-14T10:55:22.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.400+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94851907684432] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.400+0000 7f744b887800 20 remove_watcher() i=6 2024-09-14T10:55:22.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.400+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851907677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56446e432990 con 0x7f743c08d040 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.400+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94851907677696] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744003b040 con 0x7f743c08d040 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 20 remove_watcher() i=7 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f743c08d040 msgr2=0x7f743c064840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f743c08d040 0x7f743c064840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e427fb0 msgr2=0x56446e42a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e427fb0 0x56446e42a470 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7444014070 msgr2=0x7f744404f0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7444014070 0x7f744404f0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e42c9a0 msgr2=0x56446e42ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e42c9a0 0x56446e42ed90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f731403ce10 msgr2=0x7f731403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f731403ce10 0x7f731403f2d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f743c06ffd0 tx=0x7f743c088000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 msgr2=0x56446e41c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/2944984147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e414c20 0x56446e41c260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7444053420 tx=0x7f7444054530 comp rx=0 tx=0).stop 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 reap_dead start 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f7448b70640 1 -- 172.21.15.164:0/2944984147 reap_dead start 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 shutdown_connections 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 >> 172.21.15.164:0/2944984147 conn(0x56446e411020 msgr2=0x56446e40f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 shutdown_connections 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/2944984147 wait complete. 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 msgr2=0x7f732403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f743c0647d0 tx=0x7f743c0959b0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 msgr2=0x56446e4085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56446e3ee0f0 tx=0x7f7444018830 comp rx=0 tx=0).stop 2024-09-14T10:55:22.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 shutdown_connections 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 --2- 172.21.15.164:0/587607548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e408180 0x56446e4085a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 >> 172.21.15.164:0/587607548 conn(0x56446e3fc530 msgr2=0x56446e3fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 shutdown_connections 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.401+0000 7f744b887800 1 -- 172.21.15.164:0/587607548 wait complete. 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 msgr2=0x56446e3f48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 0x56446e3f48b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 msgr2=0x56446e3f90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 0x56446e3f90c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 msgr2=0x7f733003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 0x7f733003f2d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7440000c00 tx=0x7f74400013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 msgr2=0x56446e3ed260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f743c027ae0 tx=0x7f743c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 shutdown_connections 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56446e3f6c50 0x56446e3f90c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56446e2f38b0 0x56446e3f48b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733003ce10 0x7f733003f2d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 --2- 172.21.15.164:0/3687803018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56446e2f2790 0x56446e3ed260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 >> 172.21.15.164:0/3687803018 conn(0x56446e2edf80 msgr2=0x56446e3db530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 shutdown_connections 2024-09-14T10:55:22.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.402+0000 7f744b887800 1 -- 172.21.15.164:0/3687803018 wait complete. 2024-09-14T10:55:22.408 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:55:22.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-14T10:55:22.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-14T10:55:22.409 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-14T10:55:22.453 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.453 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f222612c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5574b01ff790 0x5574b01ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f222612c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574b0201470 con 0x5574b02008b0 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f222612c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5574b008b7d0 con 0x5574b01ff790 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f2221d61640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5574b01ff790 0x5574b01ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f2221560640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5574b02008b0 0x5574b0200d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38492/0 (socket says 172.21.15.164:38492) 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.456+0000 7f2221560640 1 -- 172.21.15.164:0/318461999 learned_addr learned my addr 172.21.15.164:0/318461999 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.457+0000 7f2221d61640 1 -- 172.21.15.164:0/318461999 >> v1:172.21.15.116:6789/0 conn(0x5574b02008b0 legacy=0x5574b0200d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.457+0000 7f2221d61640 1 -- 172.21.15.164:0/318461999 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b0201640 con 0x5574b01ff790 2024-09-14T10:55:22.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.458+0000 7f2221d61640 1 --2- 172.21.15.164:0/318461999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b01ffb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f221400a470 tx=0x7f2214045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe81d6d4027a6c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f2220d5f640 1 -- 172.21.15.164:0/318461999 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214053570 con 0x5574b01ff790 2024-09-14T10:55:22.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f2220d5f640 1 -- 172.21.15.164:0/318461999 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2214058070 con 0x5574b01ff790 2024-09-14T10:55:22.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f2220d5f640 1 -- 172.21.15.164:0/318461999 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214053880 con 0x5574b01ff790 2024-09-14T10:55:22.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 -- 172.21.15.164:0/318461999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 msgr2=0x5574b01ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 --2- 172.21.15.164:0/318461999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b01ffb90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f221400a470 tx=0x7f2214045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 -- 172.21.15.164:0/318461999 shutdown_connections 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 --2- 172.21.15.164:0/318461999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b01ffb90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 -- 172.21.15.164:0/318461999 >> 172.21.15.164:0/318461999 conn(0x5574b01faf80 msgr2=0x5574b01fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 -- 172.21.15.164:0/318461999 shutdown_connections 2024-09-14T10:55:22.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.459+0000 7f222612c800 1 -- 172.21.15.164:0/318461999 wait complete. 2024-09-14T10:55:22.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f222612c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f222612c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574b0098dd0 con 0x5574b01ff790 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f2221d61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f2221d61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60180/0 (socket says 172.21.15.164:60180) 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.473+0000 7f2221d61640 1 -- 172.21.15.164:0/3351838545 learned_addr learned my addr 172.21.15.164:0/3351838545 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.474+0000 7f2221d61640 1 -- 172.21.15.164:0/3351838545 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b02f33e0 con 0x5574b01ff790 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.474+0000 7f2221d61640 1 --2- 172.21.15.164:0/3351838545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2214025c20 tx=0x7f2214051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b6f5ccb2ad0543 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.474+0000 7f210fe07640 1 -- 172.21.15.164:0/3351838545 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214053570 con 0x5574b01ff790 2024-09-14T10:55:22.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.474+0000 7f210fe07640 1 -- 172.21.15.164:0/3351838545 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2214063070 con 0x5574b01ff790 2024-09-14T10:55:22.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.474+0000 7f210fe07640 1 -- 172.21.15.164:0/3351838545 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214053840 con 0x5574b01ff790 2024-09-14T10:55:22.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- 172.21.15.164:0/3351838545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 msgr2=0x5574b0173d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 --2- 172.21.15.164:0/3351838545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2214025c20 tx=0x7f2214051000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- 172.21.15.164:0/3351838545 shutdown_connections 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 --2- 172.21.15.164:0/3351838545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b0173d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- 172.21.15.164:0/3351838545 >> 172.21.15.164:0/3351838545 conn(0x5574b01faf80 msgr2=0x5574b02eb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- 172.21.15.164:0/3351838545 shutdown_connections 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- 172.21.15.164:0/3351838545 wait complete. 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.475+0000 7f222612c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574b0206da0 con 0x5574b01ff790 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f2221d61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f2221d61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60196/0 (socket says 172.21.15.164:60196) 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f2221d61640 1 -- 172.21.15.164:0/444152129 learned_addr learned my addr 172.21.15.164:0/444152129 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f2221d61640 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b02f8800 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f2221d61640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2214025c20 tx=0x7f2214002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f210e604640 1 -- 172.21.15.164:0/444152129 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214074480 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f210e604640 1 -- 172.21.15.164:0/444152129 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2214074620 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574b02f8a90 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f210e604640 1 -- 172.21.15.164:0/444152129 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2214074900 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.476+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b02f96a0 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.477+0000 7f210e604640 1 -- 172.21.15.164:0/444152129 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2214074aa0 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.477+0000 7f210e604640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 0x7f210803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.477+0000 7f210e604640 1 -- 172.21.15.164:0/444152129 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f22140989d0 con 0x5574b01ff790 2024-09-14T10:55:22.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.477+0000 7f2221560640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 0x7f210803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.477+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 0x5574b02ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b02ffe30 con 0x5574b02008b0 2024-09-14T10:55:22.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f2222562640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 0x5574b02ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f2221560640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 0x7f210803f2d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2218001d70 tx=0x7f22180012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f2222562640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 0x5574b02ff8f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f2222562640 1 -- 172.21.15.164:0/444152129 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f221c00a4d0 con 0x5574b02008b0 2024-09-14T10:55:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b03001d0 con 0x5574b02008b0 2024-09-14T10:55:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.478+0000 7f2222562640 1 -- 172.21.15.164:0/444152129 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f221c00a4d0 con 0x5574b02008b0 2024-09-14T10:55:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 0x5574b03040f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0304880 con 0x5574b0301c50 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f2221d61640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 0x5574b03040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f2221d61640 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 0x5574b03040f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f2221d61640 1 -- 172.21.15.164:0/444152129 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2214051070 con 0x5574b0301c50 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0300a20 con 0x5574b02008b0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f2222562640 1 -- 172.21.15.164:0/444152129 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f221c00a4d0 con 0x5574b02008b0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.479+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0300dc0 con 0x5574b02008b0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f2222562640 1 -- 172.21.15.164:0/444152129 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f221c00a4d0 con 0x5574b02008b0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f222612c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f222612c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574b00f74a0 con 0x5574b03131b0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60198/0 (socket says 172.21.15.164:60198) 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.480+0000 7f2222562640 1 -- 172.21.15.164:0/435026780 learned_addr learned my addr 172.21.15.164:0/435026780 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f2222562640 1 -- 172.21.15.164:0/435026780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b0313c10 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f2222562640 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5574b02f92a0 tx=0x7f221c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f21077fe640 1 -- 172.21.15.164:0/435026780 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c014450 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f21077fe640 1 -- 172.21.15.164:0/435026780 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c014610 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574b0314440 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f21077fe640 1 -- 172.21.15.164:0/435026780 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c014930 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.481+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b03149e0 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.482+0000 7f21077fe640 1 -- 172.21.15.164:0/435026780 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f221c011040 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.482+0000 7f21077fe640 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 0x7f20fc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.482+0000 7f21077fe640 1 -- 172.21.15.164:0/435026780 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f221c01e070 con 0x5574b03131b0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.482+0000 7f2221d61640 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 0x7f20fc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.482+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2221d61640 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 0x7f20fc03f2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f221405db40 tx=0x7f2214096f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f222612c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f222612c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574b02f3660 con 0x5574b031fc30 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60212/0 (socket says 172.21.15.164:60212) 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2222562640 1 -- 172.21.15.164:0/3194040967 learned_addr learned my addr 172.21.15.164:0/3194040967 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2222562640 1 -- 172.21.15.164:0/3194040967 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b0320620 con 0x5574b031fc30 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.483+0000 7f2222562640 1 --2- 172.21.15.164:0/3194040967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f221c016fd0 tx=0x7f221c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1affd6de38e8552a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f21057fa640 1 -- 172.21.15.164:0/3194040967 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c04b070 con 0x5574b031fc30 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f21057fa640 1 -- 172.21.15.164:0/3194040967 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c051070 con 0x5574b031fc30 2024-09-14T10:55:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f21057fa640 1 -- 172.21.15.164:0/3194040967 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c016440 con 0x5574b031fc30 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- 172.21.15.164:0/3194040967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 msgr2=0x5574b0320030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 --2- 172.21.15.164:0/3194040967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f221c016fd0 tx=0x7f221c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- 172.21.15.164:0/3194040967 shutdown_connections 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 --2- 172.21.15.164:0/3194040967 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0320030 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- 172.21.15.164:0/3194040967 >> 172.21.15.164:0/3194040967 conn(0x5574b031c050 msgr2=0x5574b031a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- 172.21.15.164:0/3194040967 shutdown_connections 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- 172.21.15.164:0/3194040967 wait complete. 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 Processor -- start 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.484+0000 7f222612c800 1 -- start start 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f222612c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f222612c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574b0320c40 con 0x5574b031fc30 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f2222562640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60222/0 (socket says 172.21.15.164:60222) 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 learned_addr learned my addr 172.21.15.164:0/945994240 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b03277b0 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f2222562640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f221c053420 tx=0x7f221c054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f20f37fe640 1 -- 172.21.15.164:0/945994240 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c04b040 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f20f37fe640 1 -- 172.21.15.164:0/945994240 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221c016440 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574b0327a40 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f20f37fe640 1 -- 172.21.15.164:0/945994240 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f221c011330 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.485+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b03283c0 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.486+0000 7f20f37fe640 1 -- 172.21.15.164:0/945994240 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f221c014ad0 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.486+0000 7f20f37fe640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20ec03ce10 0x7f20ec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.486+0000 7f20f37fe640 1 -- 172.21.15.164:0/945994240 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f221c00e040 con 0x5574b031fc30 2024-09-14T10:55:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.486+0000 7f2221d61640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20ec03ce10 0x7f20ec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f2221d61640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20ec03ce10 0x7f20ec03f2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f221405c580 tx=0x7f221408c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b0332f80 0x5574b0335440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0335b90 con 0x5574b0332f80 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f2221560640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b0332f80 0x5574b0335440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.487+0000 7f2221560640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b0332f80 0x5574b0335440 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2218009050 con 0x5574b0332f80 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 realm 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b03322d0 con 0x5574b0332f80 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2218009050 con 0x5574b0332f80 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0336680 con 0x5574b0332f80 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2218009050 con 0x5574b0332f80 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b0336f50 con 0x5574b0332f80 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2218009050 con 0x5574b0332f80 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0337970 0x5574b0339d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.488+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033a4a0 con 0x5574b0337970 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0337970 0x5574b0339d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0337970 0x5574b0339d60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f222612c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f222612c800 20 searching for the correct realm 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f221c014070 0x7f221c02c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.489+0000 7f2221d61640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f221c014070 0x7f221c02c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.490+0000 7f2221d61640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f221c014070 0x7f221c02c3e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.490+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.490+0000 7f2221d61640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f22140a5040 0x7f221405e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.490+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.490+0000 7f2221560640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f22140a5040 0x7f221405e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f22140a5040 0x7f221405e870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218009050 con 0x7f22140a5040 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218009050 con 0x5574b0332f80 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.491+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.492+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.493+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.494+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.495+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.496+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.497+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0337970 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x5574b0332f80 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574b033bd90 con 0x7f221c014070 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.498+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033ae60 con 0x5574b0332f80 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033b6b0 con 0x5574b0332f80 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033c210 con 0x5574b0332f80 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 zone default found 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 4 Realm: () 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:22.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 zonegroup default 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033c5b0 con 0x7f22140a5040 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.499+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033e3c0 con 0x5574b0337970 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b033ea30 con 0x5574b0337970 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 20 started sync module instance, tier type = 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.500+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033d830 con 0x7f221c014070 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.501+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.501+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93959660753792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033ee90 con 0x7f221c014070 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.501+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033f760 con 0x5574b0332f80 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.502+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93959660753792] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.502+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.502+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93959660761648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033fb50 con 0x5574b0332f80 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.502+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03405d0 con 0x5574b0337970 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.503+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93959660761648] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.504+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.504+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93959660765376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0340590 con 0x5574b0337970 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.504+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0341050 con 0x7f221c014070 2024-09-14T10:55:22.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.505+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93959660765376] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.505+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.505+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93959660756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0341440 con 0x7f221c014070 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.505+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0341ec0 con 0x5574b0332f80 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.506+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.506+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93959660771760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0341ec0 con 0x5574b0332f80 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.506+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0342eb0 con 0x7f22140a5040 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.507+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93959660756000] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.507+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93959660771760] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.507+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.507+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93959660775808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03420a0 con 0x7f22140a5040 2024-09-14T10:55:22.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.507+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0343750 con 0x7f22140a5040 2024-09-14T10:55:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.508+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93959660775808] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.509+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.509+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93959660768096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03420a0 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.509+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0343d70 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93959660768096] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93959660778144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0343d70 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=0 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=1 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=2 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=3 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=4 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=5 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.510+0000 7f222612c800 20 add_watcher() i=6 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93959660778144] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f222612c800 20 add_watcher() i=7 2024-09-14T10:55:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f222612c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b03470d0 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.511+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93959660792528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0343ee0 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.512+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93959660792528] v35'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.512+0000 7f20d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.512+0000 7f222612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.512+0000 7f222612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.512+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0345cd0 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.513+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.513+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0350190 con 0x7f22140a5040 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.514+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.514+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0350190 con 0x5574b0337970 2024-09-14T10:55:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.515+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.515+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0350640 con 0x5574b0332f80 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.516+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.516+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0350bb0 con 0x7f221c014070 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.517+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.517+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351120 con 0x5574b0337970 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.518+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.519+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351500 con 0x5574b0332f80 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.520+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.520+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351390 con 0x7f22140a5040 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.521+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.521+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351790 con 0x7f221c014070 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.522+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.522+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03514c0 con 0x5574b0337970 2024-09-14T10:55:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.522+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.522+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03514a0 con 0x7f221c014070 2024-09-14T10:55:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.523+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.523+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351530 con 0x7f22140a5040 2024-09-14T10:55:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.524+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.525+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351530 con 0x7f221c014070 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.525+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.525+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351530 con 0x7f22140a5040 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.526+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.527+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351560 con 0x5574b0332f80 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.527+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.528+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03515a0 con 0x5574b0337970 2024-09-14T10:55:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.529+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.529+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03515d0 con 0x7f221c014070 2024-09-14T10:55:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.530+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.530+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351610 con 0x5574b0337970 2024-09-14T10:55:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.531+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.531+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351650 con 0x5574b0332f80 2024-09-14T10:55:22.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.532+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.532+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351650 con 0x5574b0332f80 2024-09-14T10:55:22.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.533+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.533+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351650 con 0x5574b0337970 2024-09-14T10:55:22.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.534+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.534+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351690 con 0x7f221c014070 2024-09-14T10:55:22.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.535+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.535+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03516d0 con 0x5574b0337970 2024-09-14T10:55:22.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.538+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.538+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351710 con 0x5574b0337970 2024-09-14T10:55:22.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.539+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.539+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351750 con 0x5574b0337970 2024-09-14T10:55:22.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.540+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.540+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351750 con 0x5574b0337970 2024-09-14T10:55:22.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.541+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.541+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351790 con 0x7f22140a5040 2024-09-14T10:55:22.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.543+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.543+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03517d0 con 0x5574b0337970 2024-09-14T10:55:22.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.544+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.544+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03517d0 con 0x7f22140a5040 2024-09-14T10:55:22.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.545+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.545+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03517d0 con 0x5574b0337970 2024-09-14T10:55:22.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.546+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.546+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b03517d0 con 0x7f22140a5040 2024-09-14T10:55:22.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.547+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.547+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b0351810 con 0x7f221c014070 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.548+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.548+0000 7f20d27fc640 20 reqs_thread_entry: start 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.548+0000 7f222612c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.548+0000 7f222612c800 20 Filter name: none 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.548+0000 7f2043fff640 20 reqs_thread_entry: start 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574b037c730 con 0x7f22140a5040 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-14T10:55:22.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.549+0000 7f222612c800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:55:22.548 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:55:22.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.550+0000 7f20d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.550+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93959660792528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b034e220 con 0x5574b0332f80 2024-09-14T10:55:22.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.551+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93959660792528] v35'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.551+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93959660753792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b034e220 con 0x7f221c014070 2024-09-14T10:55:22.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.552+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93959660753792] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.552+0000 7f222612c800 20 remove_watcher() i=0 2024-09-14T10:55:22.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.552+0000 7f222612c800 2 removed watcher, disabling cache 2024-09-14T10:55:22.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.552+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93959660761648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033d380 con 0x5574b0332f80 2024-09-14T10:55:22.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.553+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93959660761648] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.553+0000 7f222612c800 20 remove_watcher() i=1 2024-09-14T10:55:22.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.553+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93959660765376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033f230 con 0x5574b0337970 2024-09-14T10:55:22.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.554+0000 7f2222562640 1 -- 172.21.15.164:0/945994240 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93959660765376] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f221c02a070 con 0x5574b0337970 2024-09-14T10:55:22.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.554+0000 7f222612c800 20 remove_watcher() i=2 2024-09-14T10:55:22.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.554+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93959660756000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033f230 con 0x7f221c014070 2024-09-14T10:55:22.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.555+0000 7f2221d61640 1 -- 172.21.15.164:0/945994240 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93959660756000] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22140a2070 con 0x7f221c014070 2024-09-14T10:55:22.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.555+0000 7f222612c800 20 remove_watcher() i=3 2024-09-14T10:55:22.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.555+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93959660771760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033dc20 con 0x5574b0332f80 2024-09-14T10:55:22.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.556+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93959660771760] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x5574b0332f80 2024-09-14T10:55:22.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.556+0000 7f222612c800 20 remove_watcher() i=4 2024-09-14T10:55:22.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.556+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93959660775808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033f230 con 0x7f22140a5040 2024-09-14T10:55:22.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.557+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93959660775808] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.557+0000 7f222612c800 20 remove_watcher() i=5 2024-09-14T10:55:22.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.557+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93959660768096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033dc20 con 0x7f22140a5040 2024-09-14T10:55:22.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.558+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93959660768096] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.558+0000 7f222612c800 20 remove_watcher() i=6 2024-09-14T10:55:22.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.558+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93959660778144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574b033f230 con 0x7f22140a5040 2024-09-14T10:55:22.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93959660778144] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2218029040 con 0x7f22140a5040 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 20 remove_watcher() i=7 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f22140a5040 msgr2=0x7f221405e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f22140a5040 0x7f221405e870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b0332f80 msgr2=0x5574b0335440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b0332f80 0x5574b0335440 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f221c014070 msgr2=0x7f221c02c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f221c014070 0x7f221c02c3e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0337970 msgr2=0x5574b0339d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0337970 0x5574b0339d60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20ec03ce10 msgr2=0x7f20ec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20ec03ce10 0x7f20ec03f2d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f221405c580 tx=0x7f221408c000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 msgr2=0x5574b0327250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f2221560640 1 -- 172.21.15.164:0/945994240 reap_dead start 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f221c053420 tx=0x7f221c054530 comp rx=0 tx=0).stop 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 shutdown_connections 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/945994240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b031fc30 0x5574b0327250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 >> 172.21.15.164:0/945994240 conn(0x5574b031c050 msgr2=0x5574b031a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 shutdown_connections 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/945994240 wait complete. 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 msgr2=0x7f20fc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 0x7f20fc03f2d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f221405db40 tx=0x7f2214096f80 comp rx=0 tx=0).stop 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 msgr2=0x5574b03135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5574b02f92a0 tx=0x7f221c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 shutdown_connections 2024-09-14T10:55:22.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f20fc03ce10 0x7f20fc03f2d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 --2- 172.21.15.164:0/435026780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b03131b0 0x5574b03135d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.559+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 >> 172.21.15.164:0/435026780 conn(0x5574b0307560 msgr2=0x5574b0307940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 shutdown_connections 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/435026780 wait complete. 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 msgr2=0x5574b02ff8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 0x5574b02ff8f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 msgr2=0x5574b03040f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 0x5574b03040f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 msgr2=0x7f210803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 0x7f210803f2d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2218001d70 tx=0x7f22180012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 msgr2=0x5574b02f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2214025c20 tx=0x7f2214002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 shutdown_connections 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574b0301c50 0x5574b03040f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574b02008b0 0x5574b02ff8f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f210803ce10 0x7f210803f2d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 --2- 172.21.15.164:0/444152129 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574b01ff790 0x5574b02f82a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 >> 172.21.15.164:0/444152129 conn(0x5574b01faf80 msgr2=0x5574b02e9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 shutdown_connections 2024-09-14T10:55:22.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.560+0000 7f222612c800 1 -- 172.21.15.164:0/444152129 wait complete. 2024-09-14T10:55:22.566 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:55:22.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:22.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:22.567 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:55:22.611 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.611 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.614+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.614+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.614+0000 7f8b5cb36800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559e2c0a3b90 0x559e2c0a6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.614+0000 7f8b5cb36800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e2c0a6700 con 0x559e2c0137b0 2024-09-14T10:55:22.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.614+0000 7f8b5cb36800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x559e2bf2a7d0 con 0x559e2c0a3b90 2024-09-14T10:55:22.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b580b6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559e2c0a3b90 0x559e2c0a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b588b7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x559e2c0137b0 0x559e2c0a2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38494/0 (socket says 172.21.15.164:38494) 2024-09-14T10:55:22.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b580b6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559e2c0a3b90 0x559e2c0a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60224/0 (socket says 172.21.15.164:60224) 2024-09-14T10:55:22.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b588b7640 1 -- 172.21.15.164:0/3908070168 learned_addr learned my addr 172.21.15.164:0/3908070168 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b580b6640 1 -- 172.21.15.164:0/3908070168 >> v1:172.21.15.116:6789/0 conn(0x559e2c0137b0 legacy=0x559e2c0a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b578b5640 1 -- 172.21.15.164:0/3908070168 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106161792 0 0) 0x559e2c0a6700 con 0x559e2c0137b0 2024-09-14T10:55:22.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.615+0000 7f8b580b6640 1 -- 172.21.15.164:0/3908070168 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c0a7930 con 0x559e2c0a3b90 2024-09-14T10:55:22.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b580b6640 1 --2- 172.21.15.164:0/3908070168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0a3b90 0x559e2c0a6050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000a470 tx=0x7f8b40045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d96af76a97f331 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b578b5640 1 -- 172.21.15.164:0/3908070168 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b40053570 con 0x559e2c0a3b90 2024-09-14T10:55:22.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b578b5640 1 -- 172.21.15.164:0/3908070168 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b40058070 con 0x559e2c0a3b90 2024-09-14T10:55:22.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b578b5640 1 -- 172.21.15.164:0/3908070168 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b40053880 con 0x559e2c0a3b90 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3908070168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0a3b90 msgr2=0x559e2c0a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3908070168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0a3b90 0x559e2c0a6050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000a470 tx=0x7f8b40045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3908070168 shutdown_connections 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3908070168 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0a3b90 0x559e2c0a6050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3908070168 >> 172.21.15.164:0/3908070168 conn(0x559e2c099f70 msgr2=0x559e2c09c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.617+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3908070168 shutdown_connections 2024-09-14T10:55:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.618+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3908070168 wait complete. 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.631+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.631+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.631+0000 7f8b5cb36800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.631+0000 7f8b5cb36800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559e2bf37dd0 con 0x559e2c0137b0 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.631+0000 7f8b588b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8b588b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60228/0 (socket says 172.21.15.164:60228) 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8b588b7640 1 -- 172.21.15.164:0/398619495 learned_addr learned my addr 172.21.15.164:0/398619495 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8b588b7640 1 -- 172.21.15.164:0/398619495 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c0a01b0 con 0x559e2c0137b0 2024-09-14T10:55:22.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8b588b7640 1 --2- 172.21.15.164:0/398619495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8b48006fa0 tx=0x7f8b48001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa6c7f66c8b4a85 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8a46e0d640 1 -- 172.21.15.164:0/398619495 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48003450 con 0x559e2c0137b0 2024-09-14T10:55:22.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8a46e0d640 1 -- 172.21.15.164:0/398619495 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48003610 con 0x559e2c0137b0 2024-09-14T10:55:22.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.632+0000 7f8a46e0d640 1 -- 172.21.15.164:0/398619495 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48003970 con 0x559e2c0137b0 2024-09-14T10:55:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- 172.21.15.164:0/398619495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 msgr2=0x559e2c09fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/398619495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8b48006fa0 tx=0x7f8b48001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- 172.21.15.164:0/398619495 shutdown_connections 2024-09-14T10:55:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/398619495 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c09fbc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- 172.21.15.164:0/398619495 >> 172.21.15.164:0/398619495 conn(0x559e2c099f70 msgr2=0x559e2c18afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- 172.21.15.164:0/398619495 shutdown_connections 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- 172.21.15.164:0/398619495 wait complete. 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.633+0000 7f8b5cb36800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559e2c0a6bd0 con 0x559e2c0137b0 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b588b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b588b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60230/0 (socket says 172.21.15.164:60230) 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b588b7640 1 -- 172.21.15.164:0/3095567172 learned_addr learned my addr 172.21.15.164:0/3095567172 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b588b7640 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c199860 con 0x559e2c0137b0 2024-09-14T10:55:22.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b588b7640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b48001330 tx=0x7f8b48001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8a4560a640 1 -- 172.21.15.164:0/3095567172 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48014a10 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2c199af0 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8a4560a640 1 -- 172.21.15.164:0/3095567172 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48014bb0 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2c19a4f0 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.634+0000 7f8a4560a640 1 -- 172.21.15.164:0/3095567172 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b48029470 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.635+0000 7f8a4560a640 1 -- 172.21.15.164:0/3095567172 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8b48010070 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.635+0000 7f8a4560a640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 0x7f8a4003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.635+0000 7f8a4560a640 1 -- 172.21.15.164:0/3095567172 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8b48018070 con 0x559e2c0137b0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b580b6640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 0x7f8a4003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 0x559e2c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1a0e90 con 0x559e2c0a3b90 2024-09-14T10:55:22.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b590b8640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 0x559e2c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b580b6640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 0x7f8a4003f2d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b40057000 tx=0x7f8b40052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b590b8640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 0x559e2c1a0950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b590b8640 1 -- 172.21.15.164:0/3095567172 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c0a3b90 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.636+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1a1230 con 0x559e2c0a3b90 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b590b8640 1 -- 172.21.15.164:0/3095567172 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c0a3b90 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 0x559e2c1a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1a58f0 con 0x559e2c1a2cf0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b588b7640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 0x559e2c1a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b588b7640 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 0x559e2c1a5160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b588b7640 1 -- 172.21.15.164:0/3095567172 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b4801b070 con 0x559e2c1a2cf0 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.637+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1a1a80 con 0x559e2c0a3b90 2024-09-14T10:55:22.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.638+0000 7f8b590b8640 1 -- 172.21.15.164:0/3095567172 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c0a3b90 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.638+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1a1e60 con 0x559e2c0a3b90 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.638+0000 7f8b590b8640 1 -- 172.21.15.164:0/3095567172 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c0a3b90 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.638+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.638+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b5cb36800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b5cb36800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559e2bf964a0 con 0x559e2c1b4330 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60242/0 (socket says 172.21.15.164:60242) 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b590b8640 1 -- 172.21.15.164:0/1807742945 learned_addr learned my addr 172.21.15.164:0/1807742945 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b590b8640 1 -- 172.21.15.164:0/1807742945 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c1b4d90 con 0x559e2c1b4330 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x559e2c19b1e0 tx=0x7f8b5000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8a3e7fc640 1 -- 172.21.15.164:0/1807742945 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50007d60 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8a3e7fc640 1 -- 172.21.15.164:0/1807742945 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5001e020 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8a3e7fc640 1 -- 172.21.15.164:0/1807742945 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50019590 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2c1b55c0 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.639+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2c1b5b60 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.640+0000 7f8a3e7fc640 1 -- 172.21.15.164:0/1807742945 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8b50016040 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.640+0000 7f8a3e7fc640 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 0x7f8a3003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8a3e7fc640 1 -- 172.21.15.164:0/1807742945 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8b5001f030 con 0x559e2c1b4330 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 0x7f8a3003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 0x7f8a3003f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559e2c19b3a0 tx=0x7f8b48003510 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b5cb36800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b5cb36800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559e2c09e610 con 0x559e2c1c0df0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60246/0 (socket says 172.21.15.164:60246) 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.641+0000 7f8b590b8640 1 -- 172.21.15.164:0/1914079210 learned_addr learned my addr 172.21.15.164:0/1914079210 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b590b8640 1 -- 172.21.15.164:0/1914079210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c1c17e0 con 0x559e2c1c0df0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1914079210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8b500543d0 tx=0x7f8b50045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c4a35e6c719e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8a2ffff640 1 -- 172.21.15.164:0/1914079210 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5001d040 con 0x559e2c1c0df0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8a2ffff640 1 -- 172.21.15.164:0/1914079210 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5004b070 con 0x559e2c1c0df0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8a2ffff640 1 -- 172.21.15.164:0/1914079210 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50017ac0 con 0x559e2c1c0df0 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1914079210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 msgr2=0x559e2c1c11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1914079210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8b500543d0 tx=0x7f8b50045490 comp rx=0 tx=0).stop 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1914079210 shutdown_connections 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1914079210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c11f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1914079210 >> 172.21.15.164:0/1914079210 conn(0x559e2c1bd1f0 msgr2=0x559e2c1bb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1914079210 shutdown_connections 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.642+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1914079210 wait complete. 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b5cb36800 1 Processor -- start 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b5cb36800 1 -- start start 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b5cb36800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b5cb36800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559e2c1c1e00 con 0x559e2c1c0df0 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b590b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60254/0 (socket says 172.21.15.164:60254) 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.643+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 learned_addr learned my addr 172.21.15.164:0/1910460318 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2c1c8960 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b500186c0 tx=0x7f8b50054360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8a2e7fc640 1 -- 172.21.15.164:0/1910460318 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b5001d070 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8a2e7fc640 1 -- 172.21.15.164:0/1910460318 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b500174e0 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8a2e7fc640 1 -- 172.21.15.164:0/1910460318 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50017800 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e2c1c8bf0 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.644+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2c1c9780 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8a2e7fc640 1 -- 172.21.15.164:0/1910460318 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8b50019730 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8a2e7fc640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a2403ce60 0x7f8a2403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8a2e7fc640 1 -- 172.21.15.164:0/1910460318 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8b50033030 con 0x559e2c1c0df0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a2403ce60 0x7f8a2403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a2403ce60 0x7f8a2403f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b48010f90 tx=0x7f8b48035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c1d3fc0 0x559e2c1d6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.645+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1d6bd0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b580b6640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c1d3fc0 0x559e2c1d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b580b6640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c1d3fc0 0x559e2c1d6480 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 20 realm 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1d7000 con 0x559e2c1d3fc0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.646+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1d78d0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1d7c70 con 0x559e2c1d3fc0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1d89d0 0x559e2c1dadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1db3d0 con 0x559e2c1d89d0 2024-09-14T10:55:22.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1d89d0 0x559e2c1dadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.647+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1d89d0 0x559e2c1dadc0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b5cb36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b5cb36800 20 searching for the correct realm 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b590b8640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8b50019040 0x7f8b5002ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8b50019040 0x7f8b5002ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8b50019040 0x7f8b5002ea70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.648+0000 7f8b588b7640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8b4804b150 0x7f8b480123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.649+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.649+0000 7f8b580b6640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8b4804b150 0x7f8b480123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.649+0000 7f8b580b6640 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8b4804b150 0x7f8b480123c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.649+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.649+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.650+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.651+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.652+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.653+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x559e2c1d3fc0 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.654+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40051070 con 0x7f8b4804b150 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d89d0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.655+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b4804b150 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dccc0 con 0x7f8b50019040 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.656+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dbd90 con 0x559e2c1d3fc0 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dc5e0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dd140 con 0x559e2c1d3fc0 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 zone default found 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 4 Realm: () 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 zonegroup default 2024-09-14T10:55:22.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dd4e0 con 0x7f8b4804b150 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.657+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1df2c0 con 0x559e2c1d89d0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1df7a0 con 0x559e2c1d89d0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 20 started sync module instance, tier type = 2024-09-14T10:55:22.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:22.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.658+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1de760 con 0x7f8b50019040 2024-09-14T10:55:22.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.659+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.659+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94137833349808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dfc00 con 0x7f8b50019040 2024-09-14T10:55:22.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.659+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e0450 con 0x559e2c1d3fc0 2024-09-14T10:55:22.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.660+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94137833349808] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.660+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.660+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94137833357216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e0870 con 0x559e2c1d3fc0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.660+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e1120 con 0x559e2c1d89d0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.661+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.662+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94137833359472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e0cd0 con 0x559e2c1d89d0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.662+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e20f0 con 0x7f8b50019040 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.662+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94137833357216] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.663+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94137833359472] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.663+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.663+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94137833362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e03c0 con 0x7f8b50019040 2024-09-14T10:55:22.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.663+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e29f0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.664+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.664+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94137833366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e29b0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.664+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e39d0 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.666+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94137833362704] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.666+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.666+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137833370848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e39d0 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.667+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e43e0 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.669+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94137833366752] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.669+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94137833370848] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.669+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.669+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94137833364448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e3f30 con 0x7f8b4804b150 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.669+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e48f0 con 0x7f8b4804b150 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94137833364448] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94137833374784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e4860 con 0x7f8b4804b150 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=0 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=1 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=2 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=3 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=4 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=5 2024-09-14T10:55:22.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.670+0000 7f8b5cb36800 20 add_watcher() i=6 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.673+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94137833374784] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.673+0000 7f8b5cb36800 20 add_watcher() i=7 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.673+0000 7f8b5cb36800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.673+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e7c60 con 0x559e2c1d3fc0 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.674+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.674+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94137833368944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e5150 con 0x559e2c1d3fc0 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.675+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94137833368944] v35'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.675+0000 7f8a0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.675+0000 7f8b5cb36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.675+0000 7f8b5cb36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.675+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f0590 con 0x559e2c1d3fc0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.676+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.676+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f0c20 con 0x7f8b4804b150 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.677+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.677+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1190 con 0x559e2c1d89d0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.678+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.678+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1190 con 0x559e2c1d3fc0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.680+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.680+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1610 con 0x7f8b50019040 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.681+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.681+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1b80 con 0x559e2c1d89d0 2024-09-14T10:55:22.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.682+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.682+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1b80 con 0x559e2c1d3fc0 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.684+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.684+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1fc0 con 0x7f8b4804b150 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.685+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.685+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1d50 con 0x7f8b50019040 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.686+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.686+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1d50 con 0x559e2c1d89d0 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.687+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.687+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1d50 con 0x7f8b50019040 2024-09-14T10:55:22.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.688+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.688+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1d70 con 0x7f8b4804b150 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.689+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.689+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1e70 con 0x7f8b50019040 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.690+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.690+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1e70 con 0x7f8b4804b150 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.691+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.691+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1e70 con 0x559e2c1d3fc0 2024-09-14T10:55:22.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.694+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.694+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1eb0 con 0x559e2c1d89d0 2024-09-14T10:55:22.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.695+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.695+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1eb0 con 0x7f8b50019040 2024-09-14T10:55:22.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.696+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.696+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1ed0 con 0x559e2c1d89d0 2024-09-14T10:55:22.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.697+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.697+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1f20 con 0x559e2c1d3fc0 2024-09-14T10:55:22.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.700+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.700+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1f20 con 0x559e2c1d3fc0 2024-09-14T10:55:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.701+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.701+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1f20 con 0x559e2c1d89d0 2024-09-14T10:55:22.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.702+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.702+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1f60 con 0x7f8b50019040 2024-09-14T10:55:22.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.703+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.703+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1fa0 con 0x559e2c1d89d0 2024-09-14T10:55:22.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.704+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.704+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f1fe0 con 0x559e2c1d89d0 2024-09-14T10:55:22.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.705+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.705+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2010 con 0x559e2c1d89d0 2024-09-14T10:55:22.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.706+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.706+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2050 con 0x559e2c1d89d0 2024-09-14T10:55:22.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.707+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.707+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2070 con 0x7f8b4804b150 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.708+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.708+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2070 con 0x559e2c1d89d0 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.709+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.709+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2030 con 0x7f8b4804b150 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.710+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.710+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2070 con 0x559e2c1d89d0 2024-09-14T10:55:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.712+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.712+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2030 con 0x7f8b4804b150 2024-09-14T10:55:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.713+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.713+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1f2070 con 0x7f8b50019040 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8a0dfe3640 20 reqs_thread_entry: start 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b5cb36800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b5cb36800 20 Filter name: none 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f897f7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b5cb36800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b5cb36800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.714+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559e2c21d040 con 0x7f8b4804b150 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.715+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.715+0000 7f8b5cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.715+0000 7f8b5cb36800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.715+0000 7f8b5cb36800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.716+0000 7f8a0efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.716+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94137833368944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1ede50 con 0x559e2c1d3fc0 2024-09-14T10:55:22.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.717+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94137833368944] v35'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.717+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94137833349808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e2d70 con 0x7f8b50019040 2024-09-14T10:55:22.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.718+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94137833349808] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.718+0000 7f8b5cb36800 20 remove_watcher() i=0 2024-09-14T10:55:22.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.718+0000 7f8b5cb36800 2 removed watcher, disabling cache 2024-09-14T10:55:22.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.718+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94137833357216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e2d70 con 0x559e2c1d3fc0 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.719+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94137833357216] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.719+0000 7f8b5cb36800 20 remove_watcher() i=1 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.719+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94137833359472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dffa0 con 0x559e2c1d89d0 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.720+0000 7f8b590b8640 1 -- 172.21.15.164:0/1910460318 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94137833359472] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b500083e0 con 0x559e2c1d89d0 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.720+0000 7f8b5cb36800 20 remove_watcher() i=2 2024-09-14T10:55:22.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.720+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94137833362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e0870 con 0x7f8b50019040 2024-09-14T10:55:22.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.721+0000 7f8b588b7640 1 -- 172.21.15.164:0/1910460318 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94137833362704] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4801b070 con 0x7f8b50019040 2024-09-14T10:55:22.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.721+0000 7f8b5cb36800 20 remove_watcher() i=3 2024-09-14T10:55:22.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.721+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94137833366752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dffa0 con 0x559e2c1d3fc0 2024-09-14T10:55:22.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.722+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94137833366752] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x559e2c1d3fc0 2024-09-14T10:55:22.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.722+0000 7f8b5cb36800 20 remove_watcher() i=4 2024-09-14T10:55:22.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.722+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94137833370848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e1510 con 0x7f8b4804b150 2024-09-14T10:55:22.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.723+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94137833370848] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.723+0000 7f8b5cb36800 20 remove_watcher() i=5 2024-09-14T10:55:22.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.723+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94137833364448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1e0870 con 0x7f8b4804b150 2024-09-14T10:55:22.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.724+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94137833364448] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.724+0000 7f8b5cb36800 20 remove_watcher() i=6 2024-09-14T10:55:22.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.724+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94137833374784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559e2c1dffa0 con 0x7f8b4804b150 2024-09-14T10:55:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94137833374784] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b40080040 con 0x7f8b4804b150 2024-09-14T10:55:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 20 remove_watcher() i=7 2024-09-14T10:55:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8b4804b150 msgr2=0x7f8b480123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8b4804b150 0x7f8b480123c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c1d3fc0 msgr2=0x559e2c1d6480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c1d3fc0 0x559e2c1d6480 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8b50019040 msgr2=0x7f8b5002ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8b50019040 0x7f8b5002ea70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1d89d0 msgr2=0x559e2c1dadc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1d89d0 0x559e2c1dadc0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a2403ce60 msgr2=0x7f8a2403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a2403ce60 0x7f8a2403f320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b48010f90 tx=0x7f8b48035000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 msgr2=0x559e2c1c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b580b6640 1 -- 172.21.15.164:0/1910460318 reap_dead start 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8b500186c0 tx=0x7f8b50054360 comp rx=0 tx=0).stop 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 shutdown_connections 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1910460318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1c0df0 0x559e2c1c8400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 >> 172.21.15.164:0/1910460318 conn(0x559e2c1bd1f0 msgr2=0x559e2c1bb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 shutdown_connections 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1910460318 wait complete. 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.725+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 msgr2=0x7f8a3003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 0x7f8a3003f320 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559e2c19b3a0 tx=0x7f8b48003510 comp rx=0 tx=0).stop 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 msgr2=0x559e2c1b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x559e2c19b1e0 tx=0x7f8b5000af20 comp rx=0 tx=0).stop 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 shutdown_connections 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a3003ce60 0x7f8a3003f320 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/1807742945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c1b4330 0x559e2c1b4750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 >> 172.21.15.164:0/1807742945 conn(0x559e2c1a86e0 msgr2=0x559e2c1a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 shutdown_connections 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/1807742945 wait complete. 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 msgr2=0x559e2c1a0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 0x559e2c1a0950 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 msgr2=0x559e2c1a5160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 0x559e2c1a5160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 msgr2=0x7f8a4003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 0x7f8a4003f2d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8b40057000 tx=0x7f8b40052000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 msgr2=0x559e2c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8b48001330 tx=0x7f8b48001250 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 shutdown_connections 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559e2c1a2cf0 0x559e2c1a5160 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559e2c0a3b90 0x559e2c1a0950 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8a4003ce10 0x7f8a4003f2d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 --2- 172.21.15.164:0/3095567172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559e2c0137b0 0x559e2c199300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 >> 172.21.15.164:0/3095567172 conn(0x559e2c099f70 msgr2=0x559e2c18ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 shutdown_connections 2024-09-14T10:55:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.726+0000 7f8b5cb36800 1 -- 172.21.15.164:0/3095567172 wait complete. 2024-09-14T10:55:22.733 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:55:22.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:22.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:22.734 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:55:22.778 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.779 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.781+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.781+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28bbb3b800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5574df1b3b40 0x5574df1b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28bbb3b800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574df1b65d0 con 0x5574df1af790 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28bbb3b800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5574df03b7d0 con 0x5574df1b3b40 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7024640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5574df1b3b40 0x5574df1b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7825640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5574df1af790 0x5574df1afb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38500/0 (socket says 172.21.15.164:38500) 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7825640 1 -- 172.21.15.164:0/805532557 learned_addr learned my addr 172.21.15.164:0/805532557 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7024640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5574df1b3b40 0x5574df1b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60270/0 (socket says 172.21.15.164:60270) 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7024640 1 -- 172.21.15.164:0/805532557 >> v1:172.21.15.116:6789/0 conn(0x5574df1af790 legacy=0x5574df1afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.782+0000 7f28b7024640 1 -- 172.21.15.164:0/805532557 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df1b7800 con 0x5574df1b3b40 2024-09-14T10:55:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.784+0000 7f28b7024640 1 --2- 172.21.15.164:0/805532557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df1b5f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00a470 tx=0x7f28ac045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a53ad5e0de7e5e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.784+0000 7f28b6823640 1 -- 172.21.15.164:0/805532557 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28ac059070 con 0x5574df1b3b40 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.784+0000 7f28b6823640 1 -- 172.21.15.164:0/805532557 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ac054570 con 0x5574df1b3b40 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.784+0000 7f28b6823640 1 -- 172.21.15.164:0/805532557 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28ac054870 con 0x5574df1b3b40 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 -- 172.21.15.164:0/805532557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 msgr2=0x5574df1b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/805532557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df1b5f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00a470 tx=0x7f28ac045880 comp rx=0 tx=0).stop 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 -- 172.21.15.164:0/805532557 shutdown_connections 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/805532557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df1b5f50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 -- 172.21.15.164:0/805532557 >> 172.21.15.164:0/805532557 conn(0x5574df1aaf80 msgr2=0x5574df1ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 -- 172.21.15.164:0/805532557 shutdown_connections 2024-09-14T10:55:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.785+0000 7f28bbb3b800 1 -- 172.21.15.164:0/805532557 wait complete. 2024-09-14T10:55:22.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.798+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.798+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.798+0000 7f28bbb3b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.798+0000 7f28bbb3b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574df048dd0 con 0x5574df1af790 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f28b7825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f28b7825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60288/0 (socket says 172.21.15.164:60288) 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f28b7825640 1 -- 172.21.15.164:0/961438700 learned_addr learned my addr 172.21.15.164:0/961438700 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f28b7825640 1 -- 172.21.15.164:0/961438700 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df2a33d0 con 0x5574df1af790 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f28b7825640 1 --2- 172.21.15.164:0/961438700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28a800b510 tx=0x7f28a800b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e5db409ba40002 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f27a5e0b640 1 -- 172.21.15.164:0/961438700 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a8008070 con 0x5574df1af790 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f27a5e0b640 1 -- 172.21.15.164:0/961438700 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a800d5c0 con 0x5574df1af790 2024-09-14T10:55:22.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.799+0000 7f27a5e0b640 1 -- 172.21.15.164:0/961438700 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a800d8e0 con 0x5574df1af790 2024-09-14T10:55:22.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- 172.21.15.164:0/961438700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 msgr2=0x5574df123d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/961438700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f28a800b510 tx=0x7f28a800b9d0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- 172.21.15.164:0/961438700 shutdown_connections 2024-09-14T10:55:22.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/961438700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1af790 0x5574df123d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- 172.21.15.164:0/961438700 >> 172.21.15.164:0/961438700 conn(0x5574df1aaf80 msgr2=0x5574df29b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- 172.21.15.164:0/961438700 shutdown_connections 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- 172.21.15.164:0/961438700 wait complete. 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.800+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28bbb3b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28bbb3b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574df1b6aa0 con 0x5574df1b3b40 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28b7825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28b7825640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60292/0 (socket says 172.21.15.164:60292) 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28b7825640 1 -- 172.21.15.164:0/699955447 learned_addr learned my addr 172.21.15.164:0/699955447 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28b7825640 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df2a8a90 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28b7825640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5574df1238b0 tx=0x7f28a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f279ffff640 1 -- 172.21.15.164:0/699955447 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a800f8f0 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f279ffff640 1 -- 172.21.15.164:0/699955447 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a8020030 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f279ffff640 1 -- 172.21.15.164:0/699955447 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28a800fc20 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574df2a8d20 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.801+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574df2a9930 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.802+0000 7f279ffff640 1 -- 172.21.15.164:0/699955447 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f28a801b430 con 0x5574df1b3b40 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.802+0000 7f279ffff640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 0x7f27a003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.802+0000 7f279ffff640 1 -- 172.21.15.164:0/699955447 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28a8054990 con 0x5574df1b3b40 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.802+0000 7f28b7024640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 0x7f27a003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 0x5574df2aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2b04a0 con 0x5574df2adb70 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28b8026640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 0x5574df2aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28b7024640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 0x7f27a003f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28ac056000 tx=0x7f28ac050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28b8026640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 0x5574df2aff60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28b8026640 1 -- 172.21.15.164:0/699955447 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28b000a4d0 con 0x5574df2adb70 2024-09-14T10:55:22.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.803+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2b0840 con 0x5574df2adb70 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28b8026640 1 -- 172.21.15.164:0/699955447 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28b000a4d0 con 0x5574df2adb70 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 0x5574df2b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2b4f10 con 0x5574df2b2300 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28b7825640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 0x5574df2b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28b7825640 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 0x5574df2b4780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28b7825640 1 -- 172.21.15.164:0/699955447 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f28a802c070 con 0x5574df2b2300 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2b1090 con 0x5574df2adb70 2024-09-14T10:55:22.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.804+0000 7f28b8026640 1 -- 172.21.15.164:0/699955447 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28b000a4d0 con 0x5574df2adb70 2024-09-14T10:55:22.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2b1430 con 0x5574df2adb70 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28b8026640 1 -- 172.21.15.164:0/699955447 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f28b000a4d0 con 0x5574df2adb70 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28bbb3b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.805+0000 7f28bbb3b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574df0a74a0 con 0x5574df2a0b60 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60302/0 (socket says 172.21.15.164:60302) 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28b8026640 1 -- 172.21.15.164:0/493350698 learned_addr learned my addr 172.21.15.164:0/493350698 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28b8026640 1 -- 172.21.15.164:0/493350698 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df2a1080 con 0x5574df2a0b60 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28b8026640 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5574df2a9530 tx=0x7f28b0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f279d7fa640 1 -- 172.21.15.164:0/493350698 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b0014450 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f279d7fa640 1 -- 172.21.15.164:0/493350698 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b0014610 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574df29f910 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f279d7fa640 1 -- 172.21.15.164:0/493350698 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b0014930 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.806+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574df29fe60 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.807+0000 7f279d7fa640 1 -- 172.21.15.164:0/493350698 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f28b0011040 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.807+0000 7f279d7fa640 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 0x7f279003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.807+0000 7f279d7fa640 1 -- 172.21.15.164:0/493350698 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28b001e070 con 0x5574df2a0b60 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.807+0000 7f28b7825640 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 0x7f279003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b7825640 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 0x7f279003f2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28a8052da0 tx=0x7f28a801c430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28bbb3b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28bbb3b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574df2a36b0 con 0x5574df2d2570 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60316/0 (socket says 172.21.15.164:60316) 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b8026640 1 -- 172.21.15.164:0/3270298304 learned_addr learned my addr 172.21.15.164:0/3270298304 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b8026640 1 -- 172.21.15.164:0/3270298304 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df2d2f60 con 0x5574df2d2570 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f28b8026640 1 --2- 172.21.15.164:0/3270298304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28b0016fd0 tx=0x7f28b0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed0e9b0effada14 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f2796ffd640 1 -- 172.21.15.164:0/3270298304 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b004b070 con 0x5574df2d2570 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f2796ffd640 1 -- 172.21.15.164:0/3270298304 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b0051070 con 0x5574df2d2570 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.808+0000 7f2796ffd640 1 -- 172.21.15.164:0/3270298304 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b0016440 con 0x5574df2d2570 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3270298304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 msgr2=0x5574df2d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3270298304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28b0016fd0 tx=0x7f28b0011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:22.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3270298304 shutdown_connections 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3270298304 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d2970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3270298304 >> 172.21.15.164:0/3270298304 conn(0x5574df2ce990 msgr2=0x5574df2ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3270298304 shutdown_connections 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3270298304 wait complete. 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 Processor -- start 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- start start 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.809+0000 7f28bbb3b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574df2d3580 con 0x5574df2d2570 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28b8026640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60320/0 (socket says 172.21.15.164:60320) 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 learned_addr learned my addr 172.21.15.164:0/3171921467 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574df2da100 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28b8026640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28b0053420 tx=0x7f28b0054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f27957fa640 1 -- 172.21.15.164:0/3171921467 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b004b040 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f27957fa640 1 -- 172.21.15.164:0/3171921467 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b0016440 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574df2da390 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f27957fa640 1 -- 172.21.15.164:0/3171921467 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28b0011330 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.810+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574df2dad10 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.811+0000 7f27957fa640 1 -- 172.21.15.164:0/3171921467 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f28b0014ad0 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.811+0000 7f27957fa640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f278003ce60 0x7f278003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.811+0000 7f27957fa640 1 -- 172.21.15.164:0/3171921467 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f28b000e040 con 0x5574df2d2570 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.811+0000 7f28b7825640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f278003ce60 0x7f278003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28b7825640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f278003ce60 0x7f278003f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28a800eab0 tx=0x7f28a802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2e5890 0x5574df2e7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2e84a0 con 0x5574df2e5890 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28b7024640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2e5890 0x5574df2e7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.812+0000 7f28b7024640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2e5890 0x5574df2e7d50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 realm 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2e88d0 con 0x5574df2e5890 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2e91a0 con 0x5574df2e5890 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2e9540 con 0x5574df2e5890 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2ea2a0 0x5574df2ec690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ecce0 con 0x5574df2ea2a0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.813+0000 7f28b8026640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2ea2a0 0x5574df2ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b8026640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2ea2a0 0x5574df2ec690 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28bbb3b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28bbb3b800 20 searching for the correct realm 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2ea2a0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b8026640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f28b0014070 0x7f28b002c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28b0014070 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.814+0000 7f28b7825640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f28b0014070 0x7f28b002c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7825640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f28b0014070 0x7f28b002c3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7825640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f28a801b050 0x7f28a8019610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28a801b050 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7024640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f28a801b050 0x7f28a8019610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.815+0000 7f28b7024640 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f28a801b050 0x7f28a8019610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2e5890 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2e5890 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28a801b050 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.816+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28a801b050 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28b0014070 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2ea2a0 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2e5890 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.817+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28a801b050 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x5574df2e5890 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ee5d0 con 0x7f28b0014070 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.818+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28a801b050 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2e5890 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.819+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2e5890 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28a801b050 2024-09-14T10:55:22.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28b0014070 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.820+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2e5890 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x5574df2e5890 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28a801b050 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28a801b050 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac05c040 con 0x7f28a801b050 2024-09-14T10:55:22.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.821+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28b0014070 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2ea2a0 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28a801b050 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x5574df2e5890 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f28a8060060 con 0x7f28b0014070 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:22.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.822+0000 7f28bbb3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ed6a0 con 0x5574df2e5890 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2edef0 con 0x5574df2e5890 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ed2e0 con 0x5574df2e5890 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 zone default found 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 4 Realm: () 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 zonegroup default 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.823+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2eef00 con 0x7f28a801b050 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f0b10 con 0x5574df2ea2a0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f1020 con 0x5574df2ea2a0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 started sync module instance, tier type = 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.824+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ef8e0 con 0x7f28b0014070 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.825+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.825+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93960448965840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ef540 con 0x7f28b0014070 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.825+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f1f50 con 0x5574df2e5890 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.826+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93960448965840] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.826+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.826+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93960448973472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f2370 con 0x5574df2e5890 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.826+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f2d30 con 0x5574df2ea2a0 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.827+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93960448973472] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.828+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.828+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93960448975008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f2d30 con 0x5574df2ea2a0 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.828+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f3770 con 0x7f28b0014070 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.829+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93960448975008] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.829+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.829+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93960448977024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f2ca0 con 0x7f28b0014070 2024-09-14T10:55:22.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.829+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f4630 con 0x5574df2e5890 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.830+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93960448977024] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.830+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.830+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93960448983424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f45a0 con 0x5574df2e5890 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.830+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f54f0 con 0x7f28a801b050 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.831+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.831+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93960448987200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f5910 con 0x7f28a801b050 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.831+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f6350 con 0x7f28a801b050 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.832+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93960448983424] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.832+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93960448987200] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.833+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.833+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93960448985632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f5e50 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.833+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f6800 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93960448985632] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93960448992080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f6770 con 0x7f28a801b050 2024-09-14T10:55:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=0 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=1 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=2 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=3 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=4 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=5 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.834+0000 7f28bbb3b800 20 add_watcher() i=6 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.835+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93960448992080] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.835+0000 7f28bbb3b800 20 add_watcher() i=7 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.835+0000 7f28bbb3b800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.835+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f9c00 con 0x5574df2e5890 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.836+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.836+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93960448988256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f7080 con 0x5574df2e5890 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.837+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93960448988256] v35'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.837+0000 7f276dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.837+0000 7f28bbb3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.837+0000 7f28bbb3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.837+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df302490 con 0x5574df2e5890 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.838+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.838+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df302b60 con 0x7f28a801b050 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.840+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.840+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df302f80 con 0x5574df2ea2a0 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.841+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.841+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df302eb0 con 0x5574df2e5890 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.842+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.842+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df3032d0 con 0x7f28b0014070 2024-09-14T10:55:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.843+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.843+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df3037d0 con 0x5574df2ea2a0 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.844+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.844+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df3037d0 con 0x5574df2e5890 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.845+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.845+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303900 con 0x7f28a801b050 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.846+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.846+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303900 con 0x7f28b0014070 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.847+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.847+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f10 con 0x5574df2ea2a0 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.848+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.848+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303ef0 con 0x7f28b0014070 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.849+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.849+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303e90 con 0x7f28a801b050 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.850+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.850+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303e90 con 0x7f28b0014070 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.851+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.851+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303eb0 con 0x7f28a801b050 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.852+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.852+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303eb0 con 0x5574df2e5890 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.853+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.853+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303ed0 con 0x5574df2ea2a0 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.854+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.854+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303ed0 con 0x7f28b0014070 2024-09-14T10:55:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.855+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.855+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f50 con 0x5574df2ea2a0 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.856+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.856+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f50 con 0x5574df2e5890 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.857+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.857+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f50 con 0x5574df2e5890 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.858+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.858+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f50 con 0x5574df2ea2a0 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.859+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.859+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303f90 con 0x7f28b0014070 2024-09-14T10:55:22.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.860+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.861+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fb0 con 0x5574df2ea2a0 2024-09-14T10:55:22.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.861+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.862+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x5574df2ea2a0 2024-09-14T10:55:22.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.862+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.863+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x5574df2ea2a0 2024-09-14T10:55:22.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.863+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.864+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x5574df2ea2a0 2024-09-14T10:55:22.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.864+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.865+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x7f28a801b050 2024-09-14T10:55:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.866+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.866+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df304000 con 0x5574df2ea2a0 2024-09-14T10:55:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.867+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.867+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df304000 con 0x7f28a801b050 2024-09-14T10:55:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.868+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.868+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x5574df2ea2a0 2024-09-14T10:55:22.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.869+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.869+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x7f28a801b050 2024-09-14T10:55:22.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.870+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.870+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df303fd0 con 0x7f28b0014070 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.871+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.871+0000 7f276cfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 20 Filter name: none 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f26e67fc640 20 reqs_thread_entry: start 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5574df32efd0 con 0x5574df2e5890 2024-09-14T10:55:22.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.872+0000 7f28bbb3b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, user does not exist 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.873+0000 7f276dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:22.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.873+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93960448988256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2ffdf0 con 0x5574df2e5890 2024-09-14T10:55:22.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.874+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93960448988256] v35'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.874+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93960448965840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f5460 con 0x7f28b0014070 2024-09-14T10:55:22.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.875+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93960448965840] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.875+0000 7f28bbb3b800 20 remove_watcher() i=0 2024-09-14T10:55:22.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.875+0000 7f28bbb3b800 2 removed watcher, disabling cache 2024-09-14T10:55:22.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.875+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93960448973472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f5460 con 0x5574df2e5890 2024-09-14T10:55:22.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.876+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93960448973472] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.876+0000 7f28bbb3b800 20 remove_watcher() i=1 2024-09-14T10:55:22.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.876+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93960448975008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f1aa0 con 0x5574df2ea2a0 2024-09-14T10:55:22.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.877+0000 7f28b8026640 1 -- 172.21.15.164:0/3171921467 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93960448975008] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28b002a070 con 0x5574df2ea2a0 2024-09-14T10:55:22.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.877+0000 7f28bbb3b800 20 remove_watcher() i=2 2024-09-14T10:55:22.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.877+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93960448977024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f5460 con 0x7f28b0014070 2024-09-14T10:55:22.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.878+0000 7f28b7825640 1 -- 172.21.15.164:0/3171921467 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93960448977024] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28a802c070 con 0x7f28b0014070 2024-09-14T10:55:22.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.878+0000 7f28bbb3b800 20 remove_watcher() i=3 2024-09-14T10:55:22.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.878+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93960448983424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f20a0 con 0x5574df2e5890 2024-09-14T10:55:22.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.879+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93960448983424] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x5574df2e5890 2024-09-14T10:55:22.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.879+0000 7f28bbb3b800 20 remove_watcher() i=4 2024-09-14T10:55:22.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.879+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93960448987200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f1aa0 con 0x7f28a801b050 2024-09-14T10:55:22.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.881+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93960448987200] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.881+0000 7f28bbb3b800 20 remove_watcher() i=5 2024-09-14T10:55:22.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.881+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93960448985632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f2880 con 0x7f28a801b050 2024-09-14T10:55:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.884+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93960448985632] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.884+0000 7f28bbb3b800 20 remove_watcher() i=6 2024-09-14T10:55:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.884+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93960448992080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5574df2f4180 con 0x7f28a801b050 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93960448992080] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28ac07e040 con 0x7f28a801b050 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 20 remove_watcher() i=7 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f28a801b050 msgr2=0x7f28a8019610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f28a801b050 0x7f28a8019610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2e5890 msgr2=0x5574df2e7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2e5890 0x5574df2e7d50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f28b0014070 msgr2=0x7f28b002c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f28b0014070 0x7f28b002c3e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2ea2a0 msgr2=0x5574df2ec690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2ea2a0 0x5574df2ec690 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f278003ce60 msgr2=0x7f278003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f278003ce60 0x7f278003f320 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28a800eab0 tx=0x7f28a802f000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28b7024640 1 -- 172.21.15.164:0/3171921467 reap_dead start 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 msgr2=0x5574df2d9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f28b0053420 tx=0x7f28b0054530 comp rx=0 tx=0).stop 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 shutdown_connections 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/3171921467 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2d2570 0x5574df2d9ba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 >> 172.21.15.164:0/3171921467 conn(0x5574df2ce990 msgr2=0x5574df2ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 shutdown_connections 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/3171921467 wait complete. 2024-09-14T10:55:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.885+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 msgr2=0x7f279003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 0x7f279003f2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28a8052da0 tx=0x7f28a801c430 comp rx=0 tx=0).stop 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 msgr2=0x5574df29f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5574df2a9530 tx=0x7f28b0018830 comp rx=0 tx=0).stop 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 shutdown_connections 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f279003ce10 0x7f279003f2d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/493350698 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df2a0b60 0x5574df29f3d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 >> 172.21.15.164:0/493350698 conn(0x5574df2b7cb0 msgr2=0x5574df2b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 shutdown_connections 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/493350698 wait complete. 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 msgr2=0x5574df2aff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 0x5574df2aff60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 msgr2=0x5574df2b4780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 0x5574df2b4780 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 msgr2=0x7f27a003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 0x7f27a003f320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f28ac056000 tx=0x7f28ac050000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 msgr2=0x5574df2a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5574df1238b0 tx=0x7f28a8000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 shutdown_connections 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5574df2b2300 0x5574df2b4780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5574df2adb70 0x5574df2aff60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f27a003ce60 0x7f27a003f320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 --2- 172.21.15.164:0/699955447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5574df1b3b40 0x5574df2a8530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 >> 172.21.15.164:0/699955447 conn(0x5574df1aaf80 msgr2=0x5574df299880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 shutdown_connections 2024-09-14T10:55:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.886+0000 7f28bbb3b800 1 -- 172.21.15.164:0/699955447 wait complete. 2024-09-14T10:55:22.892 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-14T10:55:22.892 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:55:22.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:55:22.893 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-14T10:55:22.939 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:22.939 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.942+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.942+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.942+0000 7f12abd42800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55fef55d0820 0x55fef565f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.942+0000 7f12abd42800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fef56637c0 con 0x55fef565fb10 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.942+0000 7f12abd42800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55fef54e77d0 con 0x55fef55d0820 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f12a7a86640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55fef55d0820 0x55fef565f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f129f285640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55fef565fb10 0x55fef5661f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38510/0 (socket says 172.21.15.164:38510) 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f129f285640 1 -- 172.21.15.164:0/1042491275 learned_addr learned my addr 172.21.15.164:0/1042491275 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f12a7a86640 1 -- 172.21.15.164:0/1042491275 >> v1:172.21.15.116:6789/0 conn(0x55fef565fb10 legacy=0x55fef5661f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f12a7a86640 1 -- 172.21.15.164:0/1042491275 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef56649f0 con 0x55fef55d0820 2024-09-14T10:55:22.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.943+0000 7f12a7285640 1 -- 172.21.15.164:0/1042491275 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384778784 0 0) 0x55fef56637c0 con 0x55fef565fb10 2024-09-14T10:55:22.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12a7a86640 1 --2- 172.21.15.164:0/1042491275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef565f5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564c4b49fc960082 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12a7285640 1 -- 172.21.15.164:0/1042491275 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298053570 con 0x55fef55d0820 2024-09-14T10:55:22.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12a7285640 1 -- 172.21.15.164:0/1042491275 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298058070 con 0x55fef55d0820 2024-09-14T10:55:22.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12a7285640 1 -- 172.21.15.164:0/1042491275 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298053880 con 0x55fef55d0820 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 -- 172.21.15.164:0/1042491275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 msgr2=0x55fef565f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 --2- 172.21.15.164:0/1042491275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef565f5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 -- 172.21.15.164:0/1042491275 shutdown_connections 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 --2- 172.21.15.164:0/1042491275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef565f5d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 -- 172.21.15.164:0/1042491275 >> 172.21.15.164:0/1042491275 conn(0x55fef5657080 msgr2=0x55fef56594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 -- 172.21.15.164:0/1042491275 shutdown_connections 2024-09-14T10:55:22.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.945+0000 7f12abd42800 1 -- 172.21.15.164:0/1042491275 wait complete. 2024-09-14T10:55:22.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12abd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12abd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fef54f4dd0 con 0x55fef55d0820 2024-09-14T10:55:22.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60342/0 (socket says 172.21.15.164:60342) 2024-09-14T10:55:22.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.959+0000 7f12a7a86640 1 -- 172.21.15.164:0/602800146 learned_addr learned my addr 172.21.15.164:0/602800146 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.960+0000 7f12a7a86640 1 -- 172.21.15.164:0/602800146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef574cce0 con 0x55fef55d0820 2024-09-14T10:55:22.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.960+0000 7f12a7a86640 1 --2- 172.21.15.164:0/602800146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a66dae8a3c29a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.960+0000 7f1195e0b640 1 -- 172.21.15.164:0/602800146 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298053570 con 0x55fef55d0820 2024-09-14T10:55:22.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.960+0000 7f1195e0b640 1 -- 172.21.15.164:0/602800146 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298063030 con 0x55fef55d0820 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.960+0000 7f1195e0b640 1 -- 172.21.15.164:0/602800146 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298053840 con 0x55fef55d0820 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- 172.21.15.164:0/602800146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 msgr2=0x55fef574c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 --2- 172.21.15.164:0/602800146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298051000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- 172.21.15.164:0/602800146 shutdown_connections 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 --2- 172.21.15.164:0/602800146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef574c6f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- 172.21.15.164:0/602800146 >> 172.21.15.164:0/602800146 conn(0x55fef5657080 msgr2=0x55fef5748070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- 172.21.15.164:0/602800146 shutdown_connections 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- 172.21.15.164:0/602800146 wait complete. 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.961+0000 7f12abd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fef5663c90 con 0x55fef55d0820 2024-09-14T10:55:22.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60350/0 (socket says 172.21.15.164:60350) 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12a7a86640 1 -- 172.21.15.164:0/3730383487 learned_addr learned my addr 172.21.15.164:0/3730383487 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12a7a86640 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef57546f0 con 0x55fef55d0820 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12a7a86640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f118ffff640 1 -- 172.21.15.164:0/3730383487 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298078070 con 0x55fef55d0820 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f118ffff640 1 -- 172.21.15.164:0/3730383487 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298068420 con 0x55fef55d0820 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f118ffff640 1 -- 172.21.15.164:0/3730383487 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298068700 con 0x55fef55d0820 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef5754980 con 0x55fef55d0820 2024-09-14T10:55:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.962+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef5755590 con 0x55fef55d0820 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12abd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12abd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fef55534a0 con 0x55fef5761790 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f118ffff640 1 -- 172.21.15.164:0/3730383487 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f129807b070 con 0x55fef55d0820 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12a8287640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12a8287640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60362/0 (socket says 172.21.15.164:60362) 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f12a8287640 1 -- 172.21.15.164:0/3255545257 learned_addr learned my addr 172.21.15.164:0/3255545257 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.963+0000 7f118ffff640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 0x7f119003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f118ffff640 1 -- 172.21.15.164:0/3730383487 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f12980981a0 con 0x55fef55d0820 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12a8287640 1 -- 172.21.15.164:0/3255545257 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef5764150 con 0x55fef5761790 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12a7a86640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 0x7f119003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12a8287640 1 --2- 172.21.15.164:0/3255545257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12a000a3e0 tx=0x7f12a000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b2a2ddccfc7239 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f118dffb640 1 -- 172.21.15.164:0/3255545257 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a0015070 con 0x55fef5761790 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f118dffb640 1 -- 172.21.15.164:0/3255545257 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0001670 con 0x55fef5761790 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f118dffb640 1 -- 172.21.15.164:0/3255545257 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a0001990 con 0x55fef5761790 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 -- 172.21.15.164:0/3255545257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 msgr2=0x55fef5763b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 --2- 172.21.15.164:0/3255545257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12a000a3e0 tx=0x7f12a000a8a0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12a7a86640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 0x7f119003f2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1298000c00 tx=0x7f129805efd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 -- 172.21.15.164:0/3255545257 shutdown_connections 2024-09-14T10:55:22.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 --2- 172.21.15.164:0/3255545257 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef5763b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 -- 172.21.15.164:0/3255545257 >> 172.21.15.164:0/3255545257 conn(0x55fef565fb10 msgr2=0x55fef575c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 -- 172.21.15.164:0/3255545257 shutdown_connections 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.964+0000 7f12abd42800 1 -- 172.21.15.164:0/3255545257 wait complete. 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12abd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12abd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fef5764440 con 0x55fef5761790 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12a8287640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12a8287640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60378/0 (socket says 172.21.15.164:60378) 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12a8287640 1 -- 172.21.15.164:0/1077859451 learned_addr learned my addr 172.21.15.164:0/1077859451 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.965+0000 7f12a8287640 1 -- 172.21.15.164:0/1077859451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef5768c10 con 0x55fef5761790 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f12a8287640 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12a0013040 tx=0x7f12a0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f1187fff640 1 -- 172.21.15.164:0/1077859451 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a0020020 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef5768ea0 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f1187fff640 1 -- 172.21.15.164:0/1077859451 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a0010780 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef5769820 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.966+0000 7f1187fff640 1 -- 172.21.15.164:0/1077859451 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12a0015040 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f1187fff640 1 -- 172.21.15.164:0/1077859451 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f12a0023020 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f12abd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f12abd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f1187fff640 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 0x7f118003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f1187fff640 1 -- 172.21.15.164:0/1077859451 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f12a0053830 con 0x55fef5761790 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.967+0000 7f129f285640 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 0x7f118003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12abd42800 1 Processor -- start 2024-09-14T10:55:22.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12abd42800 1 -- start start 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f129f285640 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 0x7f118003f2d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1290000c00 tx=0x7f1290001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12abd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12abd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fef574d0b0 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12a7a86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60384/0 (socket says 172.21.15.164:60384) 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.968+0000 7f12a7a86640 1 -- 172.21.15.164:0/2668476039 learned_addr learned my addr 172.21.15.164:0/2668476039 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f12a7a86640 1 -- 172.21.15.164:0/2668476039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fef57831d0 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f12a7a86640 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1298053730 tx=0x7f129807ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f116cfe1640 1 -- 172.21.15.164:0/2668476039 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1298067ac0 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f116cfe1640 1 -- 172.21.15.164:0/2668476039 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298090070 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f116cfe1640 1 -- 172.21.15.164:0/2668476039 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f129805cae0 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fef5783a20 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.969+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fef5783fc0 con 0x55fef5782790 2024-09-14T10:55:22.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f116cfe1640 1 -- 172.21.15.164:0/2668476039 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f129805f420 con 0x55fef5782790 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f116cfe1640 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 0x7f10e003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f116cfe1640 1 -- 172.21.15.164:0/2668476039 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1298099d30 con 0x55fef5782790 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f129f285640 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 0x7f10e003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f1165ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 0x55fef57925b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fef5792c50 con 0x55fef5790120 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f129f285640 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 0x7f10e003f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.970+0000 7f12a8287640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 0x55fef57925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12a8287640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 0x55fef57925b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12a8287640 1 -- 172.21.15.164:0/3730383487 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12a000e070 con 0x55fef5790120 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 0x55fef5796e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:2 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fef57974e0 con 0x55fef5794a20 2024-09-14T10:55:22.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12a7a86640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 0x55fef5796e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:22.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.971+0000 7f12a7a86640 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 0x55fef5796e10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.972+0000 7f12a7a86640 1 -- 172.21.15.164:0/3730383487 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(2 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f129807a030 con 0x55fef5794a20 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.972+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fef5793f20 con 0x55fef5794a20 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.973+0000 7f12a7a86640 1 -- 172.21.15.164:0/3730383487 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [stat,call,call,writefull 0~993] v35'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f129807a030 con 0x55fef5794a20 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 msgr2=0x7f118003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 0x7f118003f2d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1290000c00 tx=0x7f1290001330 comp rx=0 tx=0).stop 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 msgr2=0x55fef57686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12a0013040 tx=0x7f12a0003370 comp rx=0 tx=0).stop 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 shutdown_connections 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f118003ce10 0x7f118003f2d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/1077859451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5761790 0x55fef57686b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 >> 172.21.15.164:0/1077859451 conn(0x55fef565fb10 msgr2=0x55fef575c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 shutdown_connections 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/1077859451 wait complete. 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 msgr2=0x7f10e003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 0x7f10e003f320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290006000 comp rx=0 tx=0).stop 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 msgr2=0x55fef5782b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1298053730 tx=0x7f129807ce90 comp rx=0 tx=0).stop 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 shutdown_connections 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f10e003ce60 0x7f10e003f320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 --2- 172.21.15.164:0/2668476039 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef5782790 0x55fef5782b90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 >> 172.21.15.164:0/2668476039 conn(0x55fef5777610 msgr2=0x55fef5777db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 shutdown_connections 2024-09-14T10:55:22.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.974+0000 7f12abd42800 1 -- 172.21.15.164:0/2668476039 wait complete. 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 msgr2=0x55fef57925b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 0x55fef57925b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 msgr2=0x55fef5796e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 0x55fef5796e10 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 msgr2=0x7f119003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 0x7f119003f2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1298000c00 tx=0x7f129805efd0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 msgr2=0x55fef5754190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f129800a470 tx=0x7f1298002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 shutdown_connections 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fef5794a20 0x55fef5796e10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fef5790120 0x55fef57925b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f119003ce10 0x7f119003f2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 --2- 172.21.15.164:0/3730383487 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fef55d0820 0x55fef5754190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 >> 172.21.15.164:0/3730383487 conn(0x55fef5657080 msgr2=0x55fef5746860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 shutdown_connections 2024-09-14T10:55:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:22.975+0000 7f12abd42800 1 -- 172.21.15.164:0/3730383487 wait complete. 2024-09-14T10:55:22.982 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:55:22.982 DEBUG:tasks.util.rgw: json result: {'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:55:22.983 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-14T10:55:22.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-14T10:55:22.984 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-14T10:55:23.026 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.026 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.028+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fe5a7800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c0108acf90 0x55c0108af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fe5a7800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0108af950 con 0x55c01081a700 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fe5a7800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55c0107317d0 con 0x55c0108acf90 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fb890640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c0108acf90 0x55c0108af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fc091640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55c01081a700 0x55c0108ab870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38522/0 (socket says 172.21.15.164:38522) 2024-09-14T10:55:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fc091640 1 -- 172.21.15.164:0/3973420712 learned_addr learned my addr 172.21.15.164:0/3973420712 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fb890640 1 -- 172.21.15.164:0/3973420712 >> v1:172.21.15.116:6789/0 conn(0x55c01081a700 legacy=0x55c0108ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fb890640 1 -- 172.21.15.164:0/3973420712 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0108b0b30 con 0x55c0108acf90 2024-09-14T10:55:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.029+0000 7f03fb08f640 1 -- 172.21.15.164:0/3973420712 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847347082 0 0) 0x55c0108af950 con 0x55c01081a700 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.031+0000 7f03fb890640 1 --2- 172.21.15.164:0/3973420712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0108acf90 0x55c0108af380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03e400a470 tx=0x7f03e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629b3b5af040250c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.031+0000 7f03fb08f640 1 -- 172.21.15.164:0/3973420712 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e4053570 con 0x55c0108acf90 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.031+0000 7f03fb08f640 1 -- 172.21.15.164:0/3973420712 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e4058070 con 0x55c0108acf90 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.031+0000 7f03fb08f640 1 -- 172.21.15.164:0/3973420712 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03e4053880 con 0x55c0108acf90 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3973420712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0108acf90 msgr2=0x55c0108af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3973420712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0108acf90 0x55c0108af380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03e400a470 tx=0x7f03e4045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3973420712 shutdown_connections 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3973420712 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0108acf90 0x55c0108af380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3973420712 >> 172.21.15.164:0/3973420712 conn(0x55c0108a0fa0 msgr2=0x55c0108a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3973420712 shutdown_connections 2024-09-14T10:55:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.032+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3973420712 wait complete. 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.045+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.045+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fe5a7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fe5a7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c01073edd0 con 0x55c01081a700 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fc091640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fc091640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60406/0 (socket says 172.21.15.164:60406) 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fc091640 1 -- 172.21.15.164:0/4285346120 learned_addr learned my addr 172.21.15.164:0/4285346120 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fc091640 1 -- 172.21.15.164:0/4285346120 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c010998dd0 con 0x55c01081a700 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f03fc091640 1 --2- 172.21.15.164:0/4285346120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fa0 tx=0x7f03ec001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b7ea735a249fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f02ea60c640 1 -- 172.21.15.164:0/4285346120 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ec003450 con 0x55c01081a700 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.046+0000 7f02ea60c640 1 -- 172.21.15.164:0/4285346120 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec003610 con 0x55c01081a700 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f02ea60c640 1 -- 172.21.15.164:0/4285346120 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ec003970 con 0x55c01081a700 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 -- 172.21.15.164:0/4285346120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 msgr2=0x55c0109987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/4285346120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f03ec006fa0 tx=0x7f03ec001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 -- 172.21.15.164:0/4285346120 shutdown_connections 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/4285346120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109987e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 -- 172.21.15.164:0/4285346120 >> 172.21.15.164:0/4285346120 conn(0x55c0108a0fa0 msgr2=0x55c010994160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 -- 172.21.15.164:0/4285346120 shutdown_connections 2024-09-14T10:55:23.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 -- 172.21.15.164:0/4285346120 wait complete. 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.047+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fe5a7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fe5a7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c0108afe20 con 0x55c01081a700 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fc091640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fc091640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60422/0 (socket says 172.21.15.164:60422) 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fc091640 1 -- 172.21.15.164:0/3884633321 learned_addr learned my addr 172.21.15.164:0/3884633321 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fc091640 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0109a0820 con 0x55c01081a700 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.048+0000 7f03fc091640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f03ec001330 tx=0x7f03ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f02e8e09640 1 -- 172.21.15.164:0/3884633321 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ec014a10 con 0x55c01081a700 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f02e8e09640 1 -- 172.21.15.164:0/3884633321 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec014bb0 con 0x55c01081a700 2024-09-14T10:55:23.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f02e8e09640 1 -- 172.21.15.164:0/3884633321 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ec01e3f0 con 0x55c01081a700 2024-09-14T10:55:23.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0109a0ab0 con 0x55c01081a700 2024-09-14T10:55:23.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0109a14b0 con 0x55c01081a700 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.049+0000 7f02e8e09640 1 -- 172.21.15.164:0/3884633321 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f03ec010070 con 0x55c01081a700 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f02e8e09640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 0x7f02e403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f02e8e09640 1 -- 172.21.15.164:0/3884633321 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f03ec018070 con 0x55c01081a700 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fb890640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 0x7f02e403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 0x55c0109a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109a7e50 con 0x55c0108acf90 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fc892640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 0x55c0109a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fb890640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 0x7f02e403f2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03e4057000 tx=0x7f03e4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fc892640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 0x55c0109a7910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.050+0000 7f03fc892640 1 -- 172.21.15.164:0/3884633321 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03f40083e0 con 0x55c0108acf90 2024-09-14T10:55:23.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109a81f0 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fc892640 1 -- 172.21.15.164:0/3884633321 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03f40083e0 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 0x55c0109ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109ac8c0 con 0x55c0109a9cb0 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fc091640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 0x55c0109ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fc091640 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 0x55c0109ac130 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fc091640 1 -- 172.21.15.164:0/3884633321 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f03ec01b070 con 0x55c0109a9cb0 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.051+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109a8a40 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fc892640 1 -- 172.21.15.164:0/3884633321 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03f40083e0 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109a8e20 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fc892640 1 -- 172.21.15.164:0/3884633321 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f03f40083e0 con 0x55c0108acf90 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fe5a7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.052+0000 7f03fe5a7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c01079d4a0 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60434/0 (socket says 172.21.15.164:60434) 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fc892640 1 -- 172.21.15.164:0/848736041 learned_addr learned my addr 172.21.15.164:0/848736041 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fc892640 1 -- 172.21.15.164:0/848736041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0109bbd60 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fc892640 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55c0109a21b0 tx=0x7f03f400af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f02e1ffb640 1 -- 172.21.15.164:0/848736041 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f4007d60 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0109bc590 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f02e1ffb640 1 -- 172.21.15.164:0/848736041 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f401e020 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.053+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0109bcb30 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.054+0000 7f02e1ffb640 1 -- 172.21.15.164:0/848736041 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f4019550 con 0x55c0109bb300 2024-09-14T10:55:23.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.054+0000 7f02e1ffb640 1 -- 172.21.15.164:0/848736041 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f03f4016040 con 0x55c0109bb300 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f02e1ffb640 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 0x7f02d403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f02e1ffb640 1 -- 172.21.15.164:0/848736041 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f03f401f030 con 0x55c0109bb300 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fc091640 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 0x7f02d403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fc091640 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 0x7f02d403f2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55c0109a2370 tx=0x7f03ec054040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fe5a7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fe5a7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c010999200 con 0x55c0109c8eb0 2024-09-14T10:55:23.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60446/0 (socket says 172.21.15.164:60446) 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.055+0000 7f03fc892640 1 -- 172.21.15.164:0/3117128282 learned_addr learned my addr 172.21.15.164:0/3117128282 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fc892640 1 -- 172.21.15.164:0/3117128282 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0109c98a0 con 0x55c0109c8eb0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fc892640 1 --2- 172.21.15.164:0/3117128282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03f4054420 tx=0x7f03f4016f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefce256fcefb96d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f02db7fe640 1 -- 172.21.15.164:0/3117128282 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f401d040 con 0x55c0109c8eb0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f02db7fe640 1 -- 172.21.15.164:0/3117128282 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f404b070 con 0x55c0109c8eb0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f02db7fe640 1 -- 172.21.15.164:0/3117128282 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f4015e50 con 0x55c0109c8eb0 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3117128282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 msgr2=0x55c0109c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3117128282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03f4054420 tx=0x7f03f4016f60 comp rx=0 tx=0).stop 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3117128282 shutdown_connections 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3117128282 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109c92b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3117128282 >> 172.21.15.164:0/3117128282 conn(0x55c0109c4200 msgr2=0x55c0109c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3117128282 shutdown_connections 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.056+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3117128282 wait complete. 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fe5a7800 1 Processor -- start 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fe5a7800 1 -- start start 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fe5a7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fe5a7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c0109c7e40 con 0x55c0109c8eb0 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fc892640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60448/0 (socket says 172.21.15.164:60448) 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 learned_addr learned my addr 172.21.15.164:0/2765544854 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.057+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0109cf9b0 con 0x55c0109c8eb0 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f03fc892640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109cf450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f03f4048040 tx=0x7f03f4054380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f02d9ffb640 1 -- 172.21.15.164:0/2765544854 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f401d040 con 0x55c0109c8eb0 2024-09-14T10:55:23.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f02d9ffb640 1 -- 172.21.15.164:0/2765544854 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f40173b0 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0109cfc40 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f02d9ffb640 1 -- 172.21.15.164:0/2765544854 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f40176b0 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0109d05c0 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.058+0000 7f02d9ffb640 1 -- 172.21.15.164:0/2765544854 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f03f40188b0 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f02d9ffb640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02cc03ce10 0x7f02cc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f02d9ffb640 1 -- 172.21.15.164:0/2765544854 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f03f4032070 con 0x55c0109c8eb0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fc091640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02cc03ce10 0x7f02cc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0109dafc0 0x55c0109dd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109ddbd0 con 0x55c0109dafc0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fc091640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02cc03ce10 0x7f02cc03f2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03ec01e810 tx=0x7f03ec03f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fb890640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0109dafc0 0x55c0109dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.059+0000 7f03fb890640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0109dafc0 0x55c0109dd480 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 realm 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109de000 con 0x55c0109dafc0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109de8d0 con 0x55c0109dafc0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109dec70 con 0x55c0109dafc0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109df9d0 0x55c0109e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.060+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109df9d0 0x55c0109e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109df9d0 0x55c0109e1dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f03f403c020 con 0x55c0109df9d0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fe5a7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fe5a7800 20 searching for the correct realm 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e3c50 con 0x55c0109df9d0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f03f403c020 con 0x55c0109df9d0 2024-09-14T10:55:23.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f03f4019040 0x7f03f40155a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.061+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fc091640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f03f4019040 0x7f03f40155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fc091640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f03f4019040 0x7f03f40155a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fc091640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f03ec044040 0x7f03ec054720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.062+0000 7f03fb890640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f03ec044040 0x7f03ec054720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f03ec044040 0x7f03ec054720 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.063+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f403c020 con 0x55c0109df9d0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.064+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.065+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f403c020 con 0x55c0109df9d0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.066+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.067+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.068+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109df9d0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03ec044040 2024-09-14T10:55:23.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.069+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x55c0109dafc0 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2300 con 0x7f03f4019040 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e2d70 con 0x55c0109dafc0 2024-09-14T10:55:23.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e3610 con 0x55c0109dafc0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.070+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e29b0 con 0x55c0109dafc0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 zone default found 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 4 Realm: () 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 zonegroup default 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e4100 con 0x7f03ec044040 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e5c80 con 0x55c0109df9d0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e6130 con 0x55c0109df9d0 2024-09-14T10:55:23.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 started sync module instance, tier type = 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.071+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e4f90 con 0x7f03f4019040 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.073+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.073+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283400891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e6590 con 0x7f03f4019040 2024-09-14T10:55:23.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.073+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e6de0 con 0x55c0109dafc0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.075+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.075+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283400899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e7530 con 0x55c0109dafc0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.075+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e8030 con 0x55c0109df9d0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.075+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283400891104] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.077+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.077+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283400903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e7ff0 con 0x55c0109df9d0 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.077+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e8ae0 con 0x7f03f4019040 2024-09-14T10:55:23.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.077+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283400899136] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.078+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283400903456] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.081+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.081+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283400893312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e8ae0 con 0x7f03f4019040 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.081+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e93b0 con 0x55c0109dafc0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.082+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283400893312] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.082+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.082+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283400906176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e8ae0 con 0x55c0109dafc0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.082+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e9a90 con 0x7f03ec044040 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.085+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283400906176] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.085+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.085+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283400910208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109e9a50 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.085+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109ea4a0 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.088+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283400910208] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.088+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.088+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283400908544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109ea4a0 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.088+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109eae60 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283400908544] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283400915376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109eadd0 con 0x7f03ec044040 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=0 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=1 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=2 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=3 2024-09-14T10:55:23.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=4 2024-09-14T10:55:23.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=5 2024-09-14T10:55:23.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.089+0000 7f03fe5a7800 20 add_watcher() i=6 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283400915376] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fe5a7800 20 add_watcher() i=7 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fe5a7800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c0109ee230 con 0x55c0109dafc0 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.090+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283400912880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c0109eb780 con 0x55c0109dafc0 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.091+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283400912880] v35'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.091+0000 7f02b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.091+0000 7f03fe5a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.091+0000 7f03fe5a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.091+0000 7f03fe5a7800 5 note: GC not initialized 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f02b17e2640 20 reqs_thread_entry: start 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fe5a7800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fe5a7800 20 Filter name: none 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f0222ffd640 20 reqs_thread_entry: start 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21ab0 con 0x55c0109dafc0 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21ab0 con 0x7f03f4019040 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.092+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21ab0 con 0x55c0109dafc0 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.093+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.094+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03f4019040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.095+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.096+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03f4019040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.097+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.098+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.099+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.100+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.100+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.100+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.101+0000 7f02b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.101+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283400912880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.102+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94283400912880] v35'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.102+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283400891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03f4019040 2024-09-14T10:55:23.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.103+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94283400891104] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.103+0000 7f03fe5a7800 20 remove_watcher() i=0 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.103+0000 7f03fe5a7800 2 removed watcher, disabling cache 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.103+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283400899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.104+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94283400899136] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.104+0000 7f03fe5a7800 20 remove_watcher() i=1 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.104+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283400903456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109df9d0 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.106+0000 7f03fc892640 1 -- 172.21.15.164:0/2765544854 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94283400903456] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03f4065040 con 0x55c0109df9d0 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.106+0000 7f03fe5a7800 20 remove_watcher() i=2 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.106+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283400893312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03f4019040 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.107+0000 7f03fc091640 1 -- 172.21.15.164:0/2765544854 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94283400893312] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03ec040030 con 0x7f03f4019040 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.107+0000 7f03fe5a7800 20 remove_watcher() i=3 2024-09-14T10:55:23.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.107+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283400906176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x55c0109dafc0 2024-09-14T10:55:23.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.108+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94283400906176] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x55c0109dafc0 2024-09-14T10:55:23.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.108+0000 7f03fe5a7800 20 remove_watcher() i=4 2024-09-14T10:55:23.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.108+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283400910208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a1eec0 con 0x7f03ec044040 2024-09-14T10:55:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.110+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94283400910208] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.110+0000 7f03fe5a7800 20 remove_watcher() i=5 2024-09-14T10:55:23.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.110+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283400908544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a21a70 con 0x7f03ec044040 2024-09-14T10:55:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.111+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94283400908544] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.111+0000 7f03fe5a7800 20 remove_watcher() i=6 2024-09-14T10:55:23.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.111+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283400915376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c010a1eec0 con 0x7f03ec044040 2024-09-14T10:55:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94283400915376] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03e4051070 con 0x7f03ec044040 2024-09-14T10:55:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 20 remove_watcher() i=7 2024-09-14T10:55:23.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f03ec044040 msgr2=0x7f03ec054720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f03ec044040 0x7f03ec054720 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0109dafc0 msgr2=0x55c0109dd480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0109dafc0 0x55c0109dd480 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f03f4019040 msgr2=0x7f03f40155a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f03f4019040 0x7f03f40155a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109df9d0 msgr2=0x55c0109e1dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109df9d0 0x55c0109e1dc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02cc03ce10 msgr2=0x7f02cc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02cc03ce10 0x7f02cc03f2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f03ec01e810 tx=0x7f03ec03f000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 msgr2=0x55c0109cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/2765544854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109c8eb0 0x55c0109cf450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f03f4048040 tx=0x7f03f4054380 comp rx=0 tx=0).stop 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 reap_dead start 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fb890640 1 -- 172.21.15.164:0/2765544854 reap_dead start 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 shutdown_connections 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 >> 172.21.15.164:0/2765544854 conn(0x55c0109c4200 msgr2=0x55c0109c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 shutdown_connections 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.112+0000 7f03fe5a7800 1 -- 172.21.15.164:0/2765544854 wait complete. 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 msgr2=0x7f02d403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 0x7f02d403f2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55c0109a2370 tx=0x7f03ec054040 comp rx=0 tx=0).stop 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 msgr2=0x55c0109bb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55c0109a21b0 tx=0x7f03f400af20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 shutdown_connections 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02d403ce10 0x7f02d403f2d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/848736041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c0109bb300 0x55c0109bb720 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 >> 172.21.15.164:0/848736041 conn(0x55c0109af6b0 msgr2=0x55c0109afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 shutdown_connections 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/848736041 wait complete. 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 msgr2=0x55c0109a7910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 0x55c0109a7910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 msgr2=0x55c0109ac130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 0x55c0109ac130 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 msgr2=0x7f02e403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 0x7f02e403f2d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03e4057000 tx=0x7f03e4052000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 msgr2=0x55c0109a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f03ec001330 tx=0x7f03ec001250 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 shutdown_connections 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c0109a9cb0 0x55c0109ac130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c0108acf90 0x55c0109a7910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f02e403ce10 0x7f02e403f2d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 --2- 172.21.15.164:0/3884633321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c01081a700 0x55c0109a02c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 >> 172.21.15.164:0/3884633321 conn(0x55c0108a0fa0 msgr2=0x55c010999cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 shutdown_connections 2024-09-14T10:55:23.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.113+0000 7f03fe5a7800 1 -- 172.21.15.164:0/3884633321 wait complete. 2024-09-14T10:55:23.119 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[],"summary":[]} 2024-09-14T10:55:23.120 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-14T10:55:23.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.120 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:23.204 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.204 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcc02339800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d1ef1e37b0 0x55d1ef272460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcc02339800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1ef276720 con 0x55d1ef2729d0 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcc02339800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55d1ef0fa7d0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfdfc7640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d1ef1e37b0 0x55d1ef272460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfdfc7640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d1ef1e37b0 0x55d1ef272460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60462/0 (socket says 172.21.15.164:60462) 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfd7c6640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55d1ef2729d0 0x55d1ef274e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38534/0 (socket says 172.21.15.164:38534) 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3833486783 learned_addr learned my addr 172.21.15.164:0/3833486783 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3833486783 >> v1:172.21.15.116:6789/0 conn(0x55d1ef2729d0 legacy=0x55d1ef274e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.207+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3833486783 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef277950 con 0x55d1ef1e37b0 2024-09-14T10:55:23.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.209+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3833486783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef272460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000a520 tx=0x7fcbf0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525c1b10707a9f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.209+0000 7fcbfcfc5640 1 -- 172.21.15.164:0/3833486783 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf0055070 con 0x55d1ef1e37b0 2024-09-14T10:55:23.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.209+0000 7fcbfcfc5640 1 -- 172.21.15.164:0/3833486783 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf00515b0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.209+0000 7fcbfcfc5640 1 -- 172.21.15.164:0/3833486783 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf00518d0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 -- 172.21.15.164:0/3833486783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 msgr2=0x55d1ef272460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 --2- 172.21.15.164:0/3833486783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef272460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000a520 tx=0x7fcbf0045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 -- 172.21.15.164:0/3833486783 shutdown_connections 2024-09-14T10:55:23.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 --2- 172.21.15.164:0/3833486783 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef272460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 -- 172.21.15.164:0/3833486783 >> 172.21.15.164:0/3833486783 conn(0x55d1ef269fb0 msgr2=0x55d1ef26c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 -- 172.21.15.164:0/3833486783 shutdown_connections 2024-09-14T10:55:23.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.210+0000 7fcc02339800 1 -- 172.21.15.164:0/3833486783 wait complete. 2024-09-14T10:55:23.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.224+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.224+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.224+0000 7fcc02339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.224+0000 7fcc02339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1ef107dd0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.224+0000 7fcbfdfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcbfdfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60468/0 (socket says 172.21.15.164:60468) 2024-09-14T10:55:23.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/1667940114 learned_addr learned my addr 172.21.15.164:0/1667940114 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/1667940114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef35fd90 con 0x55d1ef1e37b0 2024-09-14T10:55:23.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/1667940114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00460d0 tx=0x7fcbf0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acc443f45f99c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcaebe07640 1 -- 172.21.15.164:0/1667940114 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf00519d0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcaebe07640 1 -- 172.21.15.164:0/1667940114 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf0051b70 con 0x55d1ef1e37b0 2024-09-14T10:55:23.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.225+0000 7fcaebe07640 1 -- 172.21.15.164:0/1667940114 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf0051e50 con 0x55d1ef1e37b0 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- 172.21.15.164:0/1667940114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 msgr2=0x55d1ef35f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 --2- 172.21.15.164:0/1667940114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00460d0 tx=0x7fcbf0051000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- 172.21.15.164:0/1667940114 shutdown_connections 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 --2- 172.21.15.164:0/1667940114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef35f7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- 172.21.15.164:0/1667940114 >> 172.21.15.164:0/1667940114 conn(0x55d1ef269fb0 msgr2=0x55d1ef35b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- 172.21.15.164:0/1667940114 shutdown_connections 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- 172.21.15.164:0/1667940114 wait complete. 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.226+0000 7fcc02339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1ef276bf0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcbfdfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcbfdfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60476/0 (socket says 172.21.15.164:60476) 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/4143208727 learned_addr learned my addr 172.21.15.164:0/4143208727 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef2700d0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00460d0 tx=0x7fcbf0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcaea604640 1 -- 172.21.15.164:0/4143208727 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf0073020 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcaea604640 1 -- 172.21.15.164:0/4143208727 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf006f580 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcaea604640 1 -- 172.21.15.164:0/4143208727 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf006f8a0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ef26e480 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.227+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ef26eaa0 con 0x55d1ef1e37b0 2024-09-14T10:55:23.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.228+0000 7fcaea604640 1 -- 172.21.15.164:0/4143208727 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbf0076020 con 0x55d1ef1e37b0 2024-09-14T10:55:23.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.228+0000 7fcaea604640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 0x7fcae403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.228+0000 7fcaea604640 1 -- 172.21.15.164:0/4143208727 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbf006b040 con 0x55d1ef1e37b0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 0x7fcae403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 0x55d1ef3706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef370c10 con 0x55d1ef2729d0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 0x55d1ef3706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 0x7fcae403f2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001e30 tx=0x7fcbe8001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 0x55d1ef3706d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/4143208727 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbf800a4d0 con 0x55d1ef2729d0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.229+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3714f0 con 0x55d1ef2729d0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/4143208727 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbf800a4d0 con 0x55d1ef2729d0 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 0x55d1ef3752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef375a30 con 0x55d1ef372e00 2024-09-14T10:55:23.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 0x55d1ef3752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 0x55d1ef3752a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/4143208727 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbf0057030 con 0x55d1ef372e00 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.230+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef371d40 con 0x55d1ef2729d0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/4143208727 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbf800a4d0 con 0x55d1ef2729d0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef372160 con 0x55d1ef2729d0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/4143208727 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbf800a4d0 con 0x55d1ef2729d0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcc02339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.231+0000 7fcc02339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1ef1664a0 con 0x55d1ef384440 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60486/0 (socket says 172.21.15.164:60486) 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3858751538 learned_addr learned my addr 172.21.15.164:0/3858751538 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3858751538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef384ea0 con 0x55d1ef384440 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55d1ef371010 tx=0x7fcbf8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcae37fe640 1 -- 172.21.15.164:0/3858751538 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf8014450 con 0x55d1ef384440 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcae37fe640 1 -- 172.21.15.164:0/3858751538 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf80145f0 con 0x55d1ef384440 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ef3856d0 con 0x55d1ef384440 2024-09-14T10:55:23.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcae37fe640 1 -- 172.21.15.164:0/3858751538 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf8014910 con 0x55d1ef384440 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.232+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ef385c70 con 0x55d1ef384440 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.233+0000 7fcae37fe640 1 -- 172.21.15.164:0/3858751538 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbf8011040 con 0x55d1ef384440 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.233+0000 7fcae37fe640 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 0x7fcad803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.233+0000 7fcae37fe640 1 -- 172.21.15.164:0/3858751538 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbf801e070 con 0x55d1ef384440 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 0x7fcad803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 0x7fcad803f2d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d1ef26f0d0 tx=0x7fcbf00966f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcc02339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcc02339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1ef360100 con 0x55d1ef390ea0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60494/0 (socket says 172.21.15.164:60494) 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/2402279823 learned_addr learned my addr 172.21.15.164:0/2402279823 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.234+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/2402279823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef391890 con 0x55d1ef390ea0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/2402279823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8016620 tx=0x7fcbf8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796780eb8ee58b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcae17fa640 1 -- 172.21.15.164:0/2402279823 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf8028070 con 0x55d1ef390ea0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcae17fa640 1 -- 172.21.15.164:0/2402279823 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf8022de0 con 0x55d1ef390ea0 2024-09-14T10:55:23.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcae17fa640 1 -- 172.21.15.164:0/2402279823 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf802b350 con 0x55d1ef390ea0 2024-09-14T10:55:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 -- 172.21.15.164:0/2402279823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 msgr2=0x55d1ef3912a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 --2- 172.21.15.164:0/2402279823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8016620 tx=0x7fcbf8011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 -- 172.21.15.164:0/2402279823 shutdown_connections 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 --2- 172.21.15.164:0/2402279823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef3912a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 -- 172.21.15.164:0/2402279823 >> 172.21.15.164:0/2402279823 conn(0x55d1ef38d2a0 msgr2=0x55d1ef38b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 -- 172.21.15.164:0/2402279823 shutdown_connections 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 -- 172.21.15.164:0/2402279823 wait complete. 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.235+0000 7fcc02339800 1 Processor -- start 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcc02339800 1 -- start start 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcc02339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcc02339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d1ef391eb0 con 0x55d1ef390ea0 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcbfe7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60496/0 (socket says 172.21.15.164:60496) 2024-09-14T10:55:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 learned_addr learned my addr 172.21.15.164:0/3423306757 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ef3989f0 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8022f90 tx=0x7fcbf8054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcacf7fe640 1 -- 172.21.15.164:0/3423306757 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf8044070 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcacf7fe640 1 -- 172.21.15.164:0/3423306757 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf8032070 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1ef398c80 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcacf7fe640 1 -- 172.21.15.164:0/3423306757 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbf8054cd0 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.236+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ef399600 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.237+0000 7fcacf7fe640 1 -- 172.21.15.164:0/3423306757 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbf8001770 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.237+0000 7fcacf7fe640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcac803ce60 0x7fcac803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.237+0000 7fcacf7fe640 1 -- 172.21.15.164:0/3423306757 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbf800e040 con 0x55d1ef390ea0 2024-09-14T10:55:23.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.237+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcac803ce60 0x7fcac803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef3a4220 0x55d1ef3a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3a6e30 con 0x55d1ef3a4220 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcac803ce60 0x7fcac803f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0065fd0 tx=0x7fcbf0085070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef3a4220 0x55d1ef3a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef3a4220 0x55d1ef3a66e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800f610 con 0x55d1ef3a4220 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 20 realm 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.238+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3a3570 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800f610 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3a7910 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800f610 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3a81e0 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbe800f610 con 0x55d1ef3a4220 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef3a8b20 0x55d1ef3aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3ab650 con 0x55d1ef3a8b20 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef3a8b20 0x55d1ef3aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.239+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef3a8b20 0x55d1ef3aaf10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbf802a070 con 0x55d1ef3a8b20 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcc02339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcc02339800 20 searching for the correct realm 2024-09-14T10:55:23.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcbf802a070 con 0x55d1ef3a8b20 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfe7c8640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbf8014070 0x7fcbf8037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbf8014070 0x7fcbf8037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.240+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbf8014070 0x7fcbf8037960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfdfc7640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbf0078020 0x7fcbf008f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbf0078020 0x7fcbf008f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfd7c6640 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbf0078020 0x7fcbf008f5c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800f610 con 0x7fcbf0078020 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.241+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800f610 con 0x55d1ef3a4220 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x7fcbf0078020 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x7fcbf0078020 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.242+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf802a070 con 0x55d1ef3a8b20 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x7fcbf0078020 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.243+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf802a070 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf802a070 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.244+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x7fcbf0078020 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.245+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x7fcbf0078020 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.246+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe802b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.247+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf0078020 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x55d1ef3a4220 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.248+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3acfe0 con 0x7fcbf8014070 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3ac0d0 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3ac970 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3abd10 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 zone default found 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 4 Realm: () 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 zonegroup default 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.249+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3ad490 con 0x7fcbf0078020 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3aefb0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3af470 con 0x55d1ef3a8b20 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 started sync module instance, tier type = 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.250+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3ae320 con 0x7fcbf8014070 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.251+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.251+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94360150140688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3afd80 con 0x7fcbf8014070 2024-09-14T10:55:23.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.251+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b05d0 con 0x55d1ef3a4220 2024-09-14T10:55:23.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.254+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.254+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94360150147360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b0bf0 con 0x55d1ef3a4220 2024-09-14T10:55:23.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.254+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b1710 con 0x55d1ef3a8b20 2024-09-14T10:55:23.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.254+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94360150140688] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.256+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94360150147360] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.256+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.256+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94360150151648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b16d0 con 0x55d1ef3a8b20 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.256+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b1fb0 con 0x7fcbf8014070 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.259+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94360150151648] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.259+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.259+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94360150153984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b16d0 con 0x7fcbf8014070 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.260+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b2a40 con 0x55d1ef3a4220 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.262+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.262+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94360150156624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b32e0 con 0x55d1ef3a4220 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.262+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b3da0 con 0x7fcbf0078020 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.265+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94360150153984] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.265+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.265+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94360150161520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b3d60 con 0x7fcbf0078020 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.265+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b47b0 con 0x7fcbf0078020 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.265+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94360150156624] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.266+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.266+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94360150158896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b47b0 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.266+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b51b0 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.266+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94360150161520] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94360150158896] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94360150145232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b4300 con 0x7fcbf0078020 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=0 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=1 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=2 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=3 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=4 2024-09-14T10:55:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=5 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.267+0000 7fcc02339800 20 add_watcher() i=6 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94360150145232] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcc02339800 20 add_watcher() i=7 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcc02339800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b4300 con 0x55d1ef3a4220 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.268+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94360150166720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3b4300 con 0x55d1ef3a4220 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.269+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94360150166720] v35'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.269+0000 7fcaaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.269+0000 7fcc02339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.269+0000 7fcc02339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.269+0000 7fcc02339800 5 note: GC not initialized 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcaae7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcc02339800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcc02339800 20 Filter name: none 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fca1ffff640 20 reqs_thread_entry: start 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcc02339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae70 con 0x55d1ef3a4220 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.270+0000 7fcc02339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:could not fetch user info: no user info saved 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.271+0000 7fcaaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.271+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94360150166720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x55d1ef3a4220 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.272+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94360150166720] v35'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.272+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94360150140688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3e8d00 con 0x7fcbf8014070 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.275+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94360150140688] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.275+0000 7fcc02339800 20 remove_watcher() i=0 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.275+0000 7fcc02339800 2 removed watcher, disabling cache 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.275+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94360150147360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x55d1ef3a4220 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.276+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94360150147360] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.276+0000 7fcc02339800 20 remove_watcher() i=1 2024-09-14T10:55:23.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.276+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94360150151648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x55d1ef3a8b20 2024-09-14T10:55:23.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.277+0000 7fcbfe7c8640 1 -- 172.21.15.164:0/3423306757 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94360150151648] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf8066040 con 0x55d1ef3a8b20 2024-09-14T10:55:23.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.277+0000 7fcc02339800 20 remove_watcher() i=2 2024-09-14T10:55:23.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.277+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94360150153984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x7fcbf8014070 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.278+0000 7fcbfdfc7640 1 -- 172.21.15.164:0/3423306757 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94360150153984] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbf0057030 con 0x7fcbf8014070 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.278+0000 7fcc02339800 20 remove_watcher() i=3 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.278+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94360150156624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x55d1ef3a4220 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.279+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94360150156624] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x55d1ef3a4220 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.279+0000 7fcc02339800 20 remove_watcher() i=4 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.279+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94360150161520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x7fcbf0078020 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.280+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94360150161520] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.280+0000 7fcc02339800 20 remove_watcher() i=5 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.280+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94360150158896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x7fcbf0078020 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.281+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94360150158896] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.281+0000 7fcc02339800 20 remove_watcher() i=6 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.281+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94360150145232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d1ef3eae30 con 0x7fcbf0078020 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94360150145232] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe803b040 con 0x7fcbf0078020 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 20 remove_watcher() i=7 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbf0078020 msgr2=0x7fcbf008f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbf0078020 0x7fcbf008f5c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef3a4220 msgr2=0x55d1ef3a66e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef3a4220 0x55d1ef3a66e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbf8014070 msgr2=0x7fcbf8037960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbf8014070 0x7fcbf8037960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef3a8b20 msgr2=0x55d1ef3aaf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef3a8b20 0x55d1ef3aaf10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcac803ce60 msgr2=0x7fcac803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcac803ce60 0x7fcac803f320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0065fd0 tx=0x7fcbf0085070 comp rx=0 tx=0).stop 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 msgr2=0x55d1ef398490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcbfd7c6640 1 -- 172.21.15.164:0/3423306757 reap_dead start 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8022f90 tx=0x7fcbf8054510 comp rx=0 tx=0).stop 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 shutdown_connections 2024-09-14T10:55:23.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 --2- 172.21.15.164:0/3423306757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef390ea0 0x55d1ef398490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 >> 172.21.15.164:0/3423306757 conn(0x55d1ef38d2a0 msgr2=0x55d1ef38b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 shutdown_connections 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.282+0000 7fcc02339800 1 -- 172.21.15.164:0/3423306757 wait complete. 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 msgr2=0x7fcad803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 0x7fcad803f2d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55d1ef26f0d0 tx=0x7fcbf00966f0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 msgr2=0x55d1ef384860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55d1ef371010 tx=0x7fcbf8018830 comp rx=0 tx=0).stop 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 shutdown_connections 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcad803ce10 0x7fcad803f2d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/3858751538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef384440 0x55d1ef384860 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 >> 172.21.15.164:0/3858751538 conn(0x55d1ef3787f0 msgr2=0x55d1ef378bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 shutdown_connections 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/3858751538 wait complete. 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 msgr2=0x55d1ef3706d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 0x55d1ef3706d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 msgr2=0x55d1ef3752a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 0x55d1ef3752a0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 msgr2=0x7fcae403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 0x7fcae403f2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001e30 tx=0x7fcbe8001390 comp rx=0 tx=0).stop 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 msgr2=0x55d1ef26fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcbf00460d0 tx=0x7fcbf0002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 shutdown_connections 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d1ef372e00 0x55d1ef3752a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d1ef2729d0 0x55d1ef3706d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce10 0x7fcae403f2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 --2- 172.21.15.164:0/4143208727 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d1ef1e37b0 0x55d1ef26fb70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 >> 172.21.15.164:0/4143208727 conn(0x55d1ef269fb0 msgr2=0x55d1ef360ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 shutdown_connections 2024-09-14T10:55:23.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.283+0000 7fcc02339800 1 -- 172.21.15.164:0/4143208727 wait complete. 2024-09-14T10:55:23.291 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T10:55:23.291 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-14T10:55:23.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-14T10:55:23.292 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-14T10:55:23.347 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.347 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fc1925800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c1567e0810 0x55c15686f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fc1925800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c156873780 con 0x55c15686fa30 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fc1925800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55c1566f77d0 con 0x55c1567e0810 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fbd5ae640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c1567e0810 0x55c15686f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fbd5ae640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c1567e0810 0x55c15686f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60504/0 (socket says 172.21.15.164:60504) 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.350+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/815820501 learned_addr learned my addr 172.21.15.164:0/815820501 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.351+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/815820501 >> v1:172.21.15.116:6789/0 conn(0x55c15686fa30 legacy=0x55c156871ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.351+0000 7f2fbcdad640 1 -- 172.21.15.164:0/815820501 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051918729 0 0) 0x55c156873780 con 0x55c15686fa30 2024-09-14T10:55:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.351+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/815820501 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1568749b0 con 0x55c1567e0810 2024-09-14T10:55:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.352+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/815820501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15686f4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000a520 tx=0x7f2fb0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0100f3c7caf51c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.352+0000 7f2fbcdad640 1 -- 172.21.15.164:0/815820501 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0055070 con 0x55c1567e0810 2024-09-14T10:55:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fbcdad640 1 -- 172.21.15.164:0/815820501 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb00515b0 con 0x55c1567e0810 2024-09-14T10:55:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fbcdad640 1 -- 172.21.15.164:0/815820501 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb00518d0 con 0x55c1567e0810 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 -- 172.21.15.164:0/815820501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 msgr2=0x55c15686f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 --2- 172.21.15.164:0/815820501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15686f4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000a520 tx=0x7f2fb0045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 -- 172.21.15.164:0/815820501 shutdown_connections 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 --2- 172.21.15.164:0/815820501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15686f4c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 -- 172.21.15.164:0/815820501 >> 172.21.15.164:0/815820501 conn(0x55c156867010 msgr2=0x55c156869450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 -- 172.21.15.164:0/815820501 shutdown_connections 2024-09-14T10:55:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.353+0000 7f2fc1925800 1 -- 172.21.15.164:0/815820501 wait complete. 2024-09-14T10:55:23.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.367+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.367+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.367+0000 7f2fc1925800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.367+0000 7f2fc1925800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c156704dd0 con 0x55c1567e0810 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2fbd5ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2fbd5ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60520/0 (socket says 172.21.15.164:60520) 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2003481814 learned_addr learned my addr 172.21.15.164:0/2003481814 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2003481814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15695cce0 con 0x55c1567e0810 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2003481814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0025da0 tx=0x7f2fb0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f233d578093be743 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2eab606640 1 -- 172.21.15.164:0/2003481814 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0051950 con 0x55c1567e0810 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2eab606640 1 -- 172.21.15.164:0/2003481814 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0051af0 con 0x55c1567e0810 2024-09-14T10:55:23.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.368+0000 7f2eab606640 1 -- 172.21.15.164:0/2003481814 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0051dd0 con 0x55c1567e0810 2024-09-14T10:55:23.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 -- 172.21.15.164:0/2003481814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 msgr2=0x55c15695c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2003481814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0025da0 tx=0x7f2fb0051000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 -- 172.21.15.164:0/2003481814 shutdown_connections 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2003481814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c15695c6f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 -- 172.21.15.164:0/2003481814 >> 172.21.15.164:0/2003481814 conn(0x55c156867010 msgr2=0x55c156958070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 -- 172.21.15.164:0/2003481814 shutdown_connections 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 -- 172.21.15.164:0/2003481814 wait complete. 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.369+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fc1925800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fc1925800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c156873c50 con 0x55c1567e0810 2024-09-14T10:55:23.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fbd5ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fbd5ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60536/0 (socket says 172.21.15.164:60536) 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/50050135 learned_addr learned my addr 172.21.15.164:0/50050135 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1569645b0 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0025da0 tx=0x7f2fb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2ea9e03640 1 -- 172.21.15.164:0/50050135 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb005a600 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2ea9e03640 1 -- 172.21.15.164:0/50050135 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0073070 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2ea9e03640 1 -- 172.21.15.164:0/50050135 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb005a910 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.370+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c156964840 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.371+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c156965450 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.371+0000 7f2ea9e03640 1 -- 172.21.15.164:0/50050135 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2fb0058070 con 0x55c1567e0810 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.371+0000 7f2ea9e03640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 0x7f2ea403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2ea9e03640 1 -- 172.21.15.164:0/50050135 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb006b040 con 0x55c1567e0810 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 0x7f2ea403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 0x55c15696b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c15696bbe0 con 0x55c15686fa30 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 0x55c15696b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 0x7f2ea403f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8000f60 tx=0x7f2fa80013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 0x55c15696b6a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fbddaf640 1 -- 172.21.15.164:0/50050135 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb800a4d0 con 0x55c15686fa30 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.372+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c15696bf80 con 0x55c15686fa30 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fbddaf640 1 -- 172.21.15.164:0/50050135 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fb800a4d0 con 0x55c15686fa30 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 0x55c15696ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569706d0 con 0x55c15696dac0 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 0x55c15696ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 0x55c15696ff40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/50050135 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2fb0057030 con 0x55c15696dac0 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.373+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c15696c7d0 con 0x55c15686fa30 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fbddaf640 1 -- 172.21.15.164:0/50050135 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fb800a4d0 con 0x55c15686fa30 2024-09-14T10:55:23.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c15696cbf0 con 0x55c15686fa30 2024-09-14T10:55:23.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fbddaf640 1 -- 172.21.15.164:0/50050135 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2fb800a4d0 con 0x55c15686fa30 2024-09-14T10:55:23.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fc1925800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.374+0000 7f2fc1925800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c1567634a0 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60552/0 (socket says 172.21.15.164:60552) 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fbddaf640 1 -- 172.21.15.164:0/3485986341 learned_addr learned my addr 172.21.15.164:0/3485986341 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fbddaf640 1 -- 172.21.15.164:0/3485986341 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15686d170 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55c156965050 tx=0x7f2fb8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2ea2ffd640 1 -- 172.21.15.164:0/3485986341 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb8014450 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2ea2ffd640 1 -- 172.21.15.164:0/3485986341 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8014610 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c15686ba00 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2ea2ffd640 1 -- 172.21.15.164:0/3485986341 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb8014930 con 0x55c15686cc50 2024-09-14T10:55:23.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.375+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c15686bf50 con 0x55c15686cc50 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.376+0000 7f2ea2ffd640 1 -- 172.21.15.164:0/3485986341 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2fb8011040 con 0x55c15686cc50 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.376+0000 7f2ea2ffd640 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 0x7f2e9803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.376+0000 7f2ea2ffd640 1 -- 172.21.15.164:0/3485986341 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb801e070 con 0x55c15686cc50 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.376+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 0x7f2e9803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.376+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 0x7f2e9803f2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0051580 tx=0x7f2fb00773c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fc1925800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fc1925800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c15695d050 con 0x55c15698dd30 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60564/0 (socket says 172.21.15.164:60564) 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbddaf640 1 -- 172.21.15.164:0/101213976 learned_addr learned my addr 172.21.15.164:0/101213976 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbddaf640 1 -- 172.21.15.164:0/101213976 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15698e720 con 0x55c15698dd30 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/101213976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8054590 tx=0x7f2fb8045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14be47845d99d0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/101213976 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb804b070 con 0x55c15698dd30 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/101213976 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8051070 con 0x55c15698dd30 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.377+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/101213976 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb80168f0 con 0x55c15698dd30 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- 172.21.15.164:0/101213976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 msgr2=0x55c15698e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 --2- 172.21.15.164:0/101213976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8054590 tx=0x7f2fb8045490 comp rx=0 tx=0).stop 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- 172.21.15.164:0/101213976 shutdown_connections 2024-09-14T10:55:23.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 --2- 172.21.15.164:0/101213976 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c15698e130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- 172.21.15.164:0/101213976 >> 172.21.15.164:0/101213976 conn(0x55c15698a130 msgr2=0x55c156988370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- 172.21.15.164:0/101213976 shutdown_connections 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- 172.21.15.164:0/101213976 wait complete. 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 Processor -- start 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- start start 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c156995320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.378+0000 7f2fc1925800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c15698ed40 con 0x55c15698dd30 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c156995320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fbddaf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c156995320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60574/0 (socket says 172.21.15.164:60574) 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 learned_addr learned my addr 172.21.15.164:0/2936997111 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c156995880 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c156995320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80544f0 tx=0x7f2fb8054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2e8effd640 1 -- 172.21.15.164:0/2936997111 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb804b030 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2e8effd640 1 -- 172.21.15.164:0/2936997111 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8031070 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c156995b10 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2e8effd640 1 -- 172.21.15.164:0/2936997111 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb8045760 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.379+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c156996490 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.380+0000 7f2e8effd640 1 -- 172.21.15.164:0/2936997111 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2fb8045900 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.380+0000 7f2e8effd640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e8803ce60 0x7f2e8803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.380+0000 7f2e8effd640 1 -- 172.21.15.164:0/2936997111 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb804c070 con 0x55c15698dd30 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e8803ce60 0x7f2e8803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e8803ce60 0x7f2e8803f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0077530 tx=0x7f2fb0087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c1569a10d0 0x55c1569a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a3ce0 con 0x55c1569a10d0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c1569a10d0 0x55c1569a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.381+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c1569a10d0 0x55c1569a3590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fa80104c0 con 0x55c1569a10d0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 realm 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a0420 con 0x55c1569a10d0 2024-09-14T10:55:23.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fa80104c0 con 0x55c1569a10d0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a47d0 con 0x55c1569a10d0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fa80104c0 con 0x55c1569a10d0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a50a0 con 0x55c1569a10d0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fa80104c0 con 0x55c1569a10d0 2024-09-14T10:55:23.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c1569a5ac0 0x55c1569a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a85f0 con 0x55c1569a5ac0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.382+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c1569a5ac0 0x55c1569a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c1569a5ac0 0x55c1569a7eb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fc1925800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fc1925800 20 searching for the correct realm 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbddaf640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2fb8014070 0x7f2fb80238a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.383+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2fb8014070 0x7f2fb80238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.384+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2fb8014070 0x7f2fb80238a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.384+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.384+0000 7f2fbd5ae640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2fb0065020 0x7f2fb006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.384+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.384+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2fb0065020 0x7f2fb006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2fb0065020 0x7f2fb006e900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa80104c0 con 0x7f2fb0065020 2024-09-14T10:55:23.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa80104c0 con 0x55c1569a10d0 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.385+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.386+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.387+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.388+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.389+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.390+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a5ac0 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.391+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb0065020 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x55c1569a10d0 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9ee0 con 0x7f2fb8014070 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a8fb0 con 0x55c1569a10d0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.392+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569a9800 con 0x55c1569a10d0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569aa360 con 0x55c1569a10d0 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 zone default found 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 4 Realm: () 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 zonegroup default 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569aa360 con 0x7f2fb0065020 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ac140 con 0x55c1569a5ac0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.393+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ac630 con 0x55c1569a5ac0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 20 started sync module instance, tier type = 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.394+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ab5e0 con 0x7f2fb8014070 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.395+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.395+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288870027568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569aca90 con 0x7f2fb8014070 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.395+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ad2e0 con 0x55c1569a10d0 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.396+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288870027568] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.396+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.396+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288870034992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ad700 con 0x55c1569a10d0 2024-09-14T10:55:23.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.396+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569adf50 con 0x55c1569a5ac0 2024-09-14T10:55:23.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.398+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288870034992] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.398+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.398+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288870036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ade40 con 0x55c1569a5ac0 2024-09-14T10:55:23.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.398+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ae9a0 con 0x7f2fb8014070 2024-09-14T10:55:23.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.399+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288870036528] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.399+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.400+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288870037648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569aedc0 con 0x7f2fb8014070 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.400+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569af7c0 con 0x55c1569a10d0 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.401+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288870037648] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.401+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.401+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288870040752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569afbe0 con 0x55c1569a10d0 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.401+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b05e0 con 0x7f2fb0065020 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.402+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.402+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288870040752] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.402+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288870047984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b0a00 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.402+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569af330 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.403+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288870047984] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.403+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.403+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288870044464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b0fc0 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.403+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b19c0 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288870044464] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288870049040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b1980 con 0x7f2fb0065020 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=0 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=1 2024-09-14T10:55:23.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=2 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=3 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=4 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=5 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.404+0000 7f2fc1925800 20 add_watcher() i=6 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.405+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288870049040] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.405+0000 7f2fc1925800 20 add_watcher() i=7 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.405+0000 7f2fc1925800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.405+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b4de0 con 0x55c1569a10d0 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.406+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.406+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288870053536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569b2330 con 0x55c1569a10d0 2024-09-14T10:55:23.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288870053536] v35'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2e73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fc1925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fc1925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fc1925800 5 note: GC not initialized 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2e72fe5640 20 reqs_thread_entry: start 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fc1925800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2fc1925800 20 Filter name: none 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.407+0000 7f2e70fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e8150 con 0x55c1569a10d0 2024-09-14T10:55:23.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e67f0 con 0x55c1569a10d0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:55:23.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.408+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e6be0 con 0x7f2fb0065020 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.409+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569eb590 con 0x55c1569a10d0 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fc1925800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fc1925800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94288870273024 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ebb40 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify (1) cookie 94288870040752 notify 150323855360 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55c1569e75a0 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2ea0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94288870040752 notifier 4304 bl.length()=567 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2ea0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 notify.4 [notify cookie 94288870273024 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2ea0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2e80003ea0 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== watch-notify(notify_complete (2) cookie 94288870273024 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c1569e6db0 con 0x55c1569a10d0 2024-09-14T10:55:23.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.410+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e6f80 con 0x55c1569a10d0 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fc1925800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fc1925800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94288870272896 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569ebb70 con 0x7f2fb8014070 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== watch-notify(notify (1) cookie 94288870037648 notify 150323855360 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f2fb00a9040 con 0x7f2fb8014070 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2ea0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94288870037648 notifier 4304 bl.length()=169 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2ea0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2ea0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(69 notify.3 [notify cookie 94288870272896 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2e80003ea0 con 0x7f2fb8014070 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.412+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.413+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== watch-notify(notify_complete (2) cookie 94288870272896 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c156965450 con 0x7f2fb8014070 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.413+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e9b50 con 0x7f2fb0065020 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fc1925800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fc1925800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fc1925800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94288870289584 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e9540 con 0x7f2fb8014070 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== watch-notify(notify (1) cookie 94288870037648 notify 150323855361 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c156965450 con 0x7f2fb8014070 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2ea0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 94288870037648 notifier 4304 bl.length()=177 2024-09-14T10:55:23.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2ea0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2ea0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(72 notify.3 [notify cookie 94288870289584 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2ea0ff9640 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2e80004240 con 0x7f2fb8014070 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.414+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== watch-notify(notify_complete (2) cookie 94288870289584 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c156964840 con 0x7f2fb8014070 2024-09-14T10:55:23.432 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:23.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.415+0000 7f2e73fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.415+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288870053536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569eb7c0 con 0x55c1569a10d0 2024-09-14T10:55:23.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.417+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94288870053536] v35'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.417+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288870027568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x7f2fb8014070 2024-09-14T10:55:23.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.419+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94288870027568] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.419+0000 7f2fc1925800 20 remove_watcher() i=0 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.419+0000 7f2fc1925800 2 removed watcher, disabling cache 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.419+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288870034992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x55c1569a10d0 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.420+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94288870034992] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.420+0000 7f2fc1925800 20 remove_watcher() i=1 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.420+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288870036528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x55c1569a5ac0 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.422+0000 7f2fbddaf640 1 -- 172.21.15.164:0/2936997111 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94288870036528] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb802a070 con 0x55c1569a5ac0 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.422+0000 7f2fc1925800 20 remove_watcher() i=2 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.422+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288870037648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x7f2fb8014070 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.423+0000 7f2fbd5ae640 1 -- 172.21.15.164:0/2936997111 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94288870037648] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0057030 con 0x7f2fb8014070 2024-09-14T10:55:23.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.423+0000 7f2fc1925800 20 remove_watcher() i=3 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.423+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288870040752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x55c1569a10d0 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.424+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94288870040752] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x55c1569a10d0 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.424+0000 7f2fc1925800 20 remove_watcher() i=4 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.424+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288870047984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x7f2fb0065020 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.425+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94288870047984] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.425+0000 7f2fc1925800 20 remove_watcher() i=5 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.425+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288870044464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x7f2fb0065020 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.426+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94288870044464] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.426+0000 7f2fc1925800 20 remove_watcher() i=6 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.426+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288870049040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c1569e5eb0 con 0x7f2fb0065020 2024-09-14T10:55:23.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94288870049040] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fa802a040 con 0x7f2fb0065020 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 20 remove_watcher() i=7 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2fb0065020 msgr2=0x7f2fb006e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2fb0065020 0x7f2fb006e900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c1569a10d0 msgr2=0x55c1569a3590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c1569a10d0 0x55c1569a3590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2fb8014070 msgr2=0x7f2fb80238a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2fb8014070 0x7f2fb80238a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c1569a5ac0 msgr2=0x55c1569a7eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c1569a5ac0 0x55c1569a7eb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e8803ce60 msgr2=0x7f2e8803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e8803ce60 0x7f2e8803f320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0077530 tx=0x7f2fb0087000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 msgr2=0x55c156995320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fc1925800 1 --2- 172.21.15.164:0/2936997111 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15698dd30 0x55c156995320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80544f0 tx=0x7f2fb8054520 comp rx=0 tx=0).stop 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.427+0000 7f2fb7fff640 1 -- 172.21.15.164:0/2936997111 reap_dead start 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 shutdown_connections 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 >> 172.21.15.164:0/2936997111 conn(0x55c15698a130 msgr2=0x55c156988340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 shutdown_connections 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/2936997111 wait complete. 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 msgr2=0x7f2e9803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 0x7f2e9803f2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0051580 tx=0x7f2fb00773c0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 msgr2=0x55c15686b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55c156965050 tx=0x7f2fb8018830 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 shutdown_connections 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e9803ce10 0x7f2e9803f2d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/3485986341 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c15686cc50 0x55c15686b4c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 >> 172.21.15.164:0/3485986341 conn(0x55c156973470 msgr2=0x55c156973850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 shutdown_connections 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/3485986341 wait complete. 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 msgr2=0x55c15696b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 0x55c15696b6a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 msgr2=0x55c15696ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 0x55c15696ff40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 msgr2=0x7f2ea403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 0x7f2ea403f320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8000f60 tx=0x7f2fa80013f0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 msgr2=0x55c156964050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0025da0 tx=0x7f2fb0002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.428+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 shutdown_connections 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c15696dac0 0x55c15696ff40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c15686fa30 0x55c15696b6a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ea403ce60 0x7f2ea403f320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 --2- 172.21.15.164:0/50050135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c1567e0810 0x55c156964050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 >> 172.21.15.164:0/50050135 conn(0x55c156867010 msgr2=0x55c156956860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 shutdown_connections 2024-09-14T10:55:23.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.429+0000 7f2fc1925800 1 -- 172.21.15.164:0/50050135 wait complete. 2024-09-14T10:55:23.445 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:23.445 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-14T10:55:23.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-14T10:55:23.445 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-14T10:55:23.493 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.494 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.496+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.496+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d26e40800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560333fd7730 0x5603340688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d26e40800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56033406c980 con 0x560334068de0 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d26e40800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x560333eee7d0 con 0x560333fd7730 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d2492a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560333fd7730 0x5603340688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d24129640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x560334068de0 0x56033406b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38554/0 (socket says 172.21.15.164:38554) 2024-09-14T10:55:23.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d24129640 1 -- 172.21.15.164:0/3063630641 learned_addr learned my addr 172.21.15.164:0/3063630641 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:23.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d2492a640 1 -- 172.21.15.164:0/3063630641 >> v1:172.21.15.116:6789/0 conn(0x560334068de0 legacy=0x56033406b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.497+0000 7f9d2492a640 1 -- 172.21.15.164:0/3063630641 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033406db60 con 0x560333fd7730 2024-09-14T10:55:23.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.499+0000 7f9d2492a640 1 --2- 172.21.15.164:0/3063630641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603340688a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400a470 tx=0x7f9d14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d519ae8d3dc2487b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.499+0000 7f9d23928640 1 -- 172.21.15.164:0/3063630641 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14053570 con 0x560333fd7730 2024-09-14T10:55:23.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.499+0000 7f9d23928640 1 -- 172.21.15.164:0/3063630641 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d14058070 con 0x560333fd7730 2024-09-14T10:55:23.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.499+0000 7f9d23928640 1 -- 172.21.15.164:0/3063630641 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14053880 con 0x560333fd7730 2024-09-14T10:55:23.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 -- 172.21.15.164:0/3063630641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 msgr2=0x5603340688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3063630641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603340688a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400a470 tx=0x7f9d14045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 -- 172.21.15.164:0/3063630641 shutdown_connections 2024-09-14T10:55:23.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3063630641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603340688a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 -- 172.21.15.164:0/3063630641 >> 172.21.15.164:0/3063630641 conn(0x56033405dfd0 msgr2=0x560334060410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 -- 172.21.15.164:0/3063630641 shutdown_connections 2024-09-14T10:55:23.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.500+0000 7f9d26e40800 1 -- 172.21.15.164:0/3063630641 wait complete. 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d26e40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d26e40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560333efbdd0 con 0x560333fd7730 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d2492a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d2492a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60596/0 (socket says 172.21.15.164:60596) 2024-09-14T10:55:23.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d2492a640 1 -- 172.21.15.164:0/2818712322 learned_addr learned my addr 172.21.15.164:0/2818712322 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.514+0000 7f9d2492a640 1 -- 172.21.15.164:0/2818712322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560334155f90 con 0x560333fd7730 2024-09-14T10:55:23.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9d2492a640 1 --2- 172.21.15.164:0/2818712322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9d14025c20 tx=0x7f9d14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d12b1241825ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9c12e0d640 1 -- 172.21.15.164:0/2818712322 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14053a20 con 0x560333fd7730 2024-09-14T10:55:23.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9c12e0d640 1 -- 172.21.15.164:0/2818712322 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d14063070 con 0x560333fd7730 2024-09-14T10:55:23.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9c12e0d640 1 -- 172.21.15.164:0/2818712322 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14053cf0 con 0x560333fd7730 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9d26e40800 1 -- 172.21.15.164:0/2818712322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 msgr2=0x5603341559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.515+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2818712322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9d14025c20 tx=0x7f9d14051000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- 172.21.15.164:0/2818712322 shutdown_connections 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2818712322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x5603341559a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- 172.21.15.164:0/2818712322 >> 172.21.15.164:0/2818712322 conn(0x56033405dfd0 msgr2=0x560334151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- 172.21.15.164:0/2818712322 shutdown_connections 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- 172.21.15.164:0/2818712322 wait complete. 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d26e40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56033406ce50 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d2492a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d2492a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60612/0 (socket says 172.21.15.164:60612) 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.516+0000 7f9d2492a640 1 -- 172.21.15.164:0/3664226249 learned_addr learned my addr 172.21.15.164:0/3664226249 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9d2492a640 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033415da20 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9d2492a640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d14025c20 tx=0x7f9d14002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9c1160a640 1 -- 172.21.15.164:0/3664226249 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14068660 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9c1160a640 1 -- 172.21.15.164:0/3664226249 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d14068800 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56033415dcb0 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9c1160a640 1 -- 172.21.15.164:0/3664226249 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d14068ae0 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.517+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033415e8c0 con 0x560333fd7730 2024-09-14T10:55:23.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9c1160a640 1 -- 172.21.15.164:0/3664226249 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9d14068c80 con 0x560333fd7730 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9c1160a640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 0x7f9c0c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9c1160a640 1 -- 172.21.15.164:0/3664226249 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f9d14098b50 con 0x560333fd7730 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9d24129640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 0x7f9c0c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 0x560334164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56033415f280 con 0x560334068de0 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9d2512b640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 0x560334164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.518+0000 7f9d24129640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 0x7f9c0c03f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d18001d70 tx=0x7f9d180012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d2512b640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 0x560334164b10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d2512b640 1 -- 172.21.15.164:0/3664226249 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d1c00a4d0 con 0x560334068de0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560334165530 con 0x560334068de0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d2512b640 1 -- 172.21.15.164:0/3664226249 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d1c00a4d0 con 0x560334068de0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 0x5603341692e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560334169a70 con 0x560334166e40 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d2492a640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 0x5603341692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.519+0000 7f9d2492a640 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 0x5603341692e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.520+0000 7f9d2492a640 1 -- 172.21.15.164:0/3664226249 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d14051070 con 0x560334166e40 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.520+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560334165d80 con 0x560334068de0 2024-09-14T10:55:23.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.520+0000 7f9d2512b640 1 -- 172.21.15.164:0/3664226249 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d1c00a4d0 con 0x560334068de0 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.520+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560334166160 con 0x560334068de0 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.520+0000 7f9d2512b640 1 -- 172.21.15.164:0/3664226249 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d1c00a4d0 con 0x560334068de0 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d26e40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d26e40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560333f5a4a0 con 0x560334178410 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60614/0 (socket says 172.21.15.164:60614) 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d2512b640 1 -- 172.21.15.164:0/2586272717 learned_addr learned my addr 172.21.15.164:0/2586272717 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d2512b640 1 -- 172.21.15.164:0/2586272717 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560334178e70 con 0x560334178410 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.521+0000 7f9d2512b640 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x56033415e4c0 tx=0x7f9d1c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.522+0000 7f9c0a7fc640 1 -- 172.21.15.164:0/2586272717 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c014450 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.522+0000 7f9c0a7fc640 1 -- 172.21.15.164:0/2586272717 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c014610 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.522+0000 7f9c0a7fc640 1 -- 172.21.15.164:0/2586272717 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c014930 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.522+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5603341796a0 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.522+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560334179c40 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9c0a7fc640 1 -- 172.21.15.164:0/2586272717 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9d1c011040 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9c0a7fc640 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 0x7f9bfc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9c0a7fc640 1 -- 172.21.15.164:0/2586272717 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f9d1c01e070 con 0x560334178410 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d2492a640 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 0x7f9bfc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d2492a640 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 0x7f9bfc03f2d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56033415ed80 tx=0x7f9d1405f4a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d26e40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.523+0000 7f9d26e40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560334156360 con 0x560334184eb0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60622/0 (socket says 172.21.15.164:60622) 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9d2512b640 1 -- 172.21.15.164:0/743443855 learned_addr learned my addr 172.21.15.164:0/743443855 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9d2512b640 1 -- 172.21.15.164:0/743443855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603341858a0 con 0x560334184eb0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9d2512b640 1 --2- 172.21.15.164:0/743443855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c016fd0 tx=0x7f9d1c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86baf48b1d3026ec server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9bfbfff640 1 -- 172.21.15.164:0/743443855 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c04b070 con 0x560334184eb0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9bfbfff640 1 -- 172.21.15.164:0/743443855 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c051070 con 0x560334184eb0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.524+0000 7f9bfbfff640 1 -- 172.21.15.164:0/743443855 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c045510 con 0x560334184eb0 2024-09-14T10:55:23.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- 172.21.15.164:0/743443855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 msgr2=0x5603341852b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 --2- 172.21.15.164:0/743443855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c016fd0 tx=0x7f9d1c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- 172.21.15.164:0/743443855 shutdown_connections 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 --2- 172.21.15.164:0/743443855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x5603341852b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- 172.21.15.164:0/743443855 >> 172.21.15.164:0/743443855 conn(0x5603341812b0 msgr2=0x56033417f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- 172.21.15.164:0/743443855 shutdown_connections 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- 172.21.15.164:0/743443855 wait complete. 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 Processor -- start 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- start start 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d26e40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560334185ec0 con 0x560334184eb0 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d2512b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60628/0 (socket says 172.21.15.164:60628) 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.525+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 learned_addr learned my addr 172.21.15.164:0/1575971331 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56033418ca20 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9d2512b640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c053380 tx=0x7f9d1c054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9bfa7fc640 1 -- 172.21.15.164:0/1575971331 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c04b030 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9bfa7fc640 1 -- 172.21.15.164:0/1575971331 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c031030 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56033418ccb0 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9bfa7fc640 1 -- 172.21.15.164:0/1575971331 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d1c011330 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.526+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56033418d630 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.527+0000 7f9bfa7fc640 1 -- 172.21.15.164:0/1575971331 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9d1c014ad0 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.527+0000 7f9bfa7fc640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bf003ce60 0x7f9bf003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.527+0000 7f9bfa7fc640 1 -- 172.21.15.164:0/1575971331 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f9d1c04c070 con 0x560334184eb0 2024-09-14T10:55:23.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.527+0000 7f9d2492a640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bf003ce60 0x7f9bf003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.527+0000 7f9d2492a640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bf003ce60 0x7f9bf003f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d1405dac0 tx=0x7f9d1408a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334198280 0x56033419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56033419ae90 con 0x560334198280 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d24129640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334198280 0x56033419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d24129640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334198280 0x56033419a740 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d18009050 con 0x560334198280 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 realm 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341975d0 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d18009050 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.528+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56033419b980 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d18009050 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56033419c250 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d18009050 con 0x560334198280 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56033419cc70 0x56033419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56033419f7a0 con 0x56033419cc70 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d2512b640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56033419cc70 0x56033419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d2512b640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56033419cc70 0x56033419f060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.529+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d26e40800 20 searching for the correct realm 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2512b640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9d1c014070 0x7f9d1c0378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2492a640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9d1c014070 0x7f9d1c0378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2492a640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9d1c014070 0x7f9d1c0378b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2492a640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9d140a5040 0x7f9d1407e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.530+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9d140a5040 0x7f9d1407e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9d140a5040 0x7f9d1407e770 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18009050 con 0x7f9d140a5040 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18009050 con 0x560334198280 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.531+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.532+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.533+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.534+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.535+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.536+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.537+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x56033419cc70 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d140a5040 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x560334198280 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1090 con 0x7f9d1c014070 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.538+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a0160 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a09b0 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a1510 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 zone default found 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 4 Realm: () 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 zonegroup default 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a18b0 con 0x7f9d140a5040 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.539+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a3750 con 0x56033419cc70 2024-09-14T10:55:23.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341a3b40 con 0x56033419cc70 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 20 started sync module instance, tier type = 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.540+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a2be0 con 0x7f9d1c014070 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.541+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.541+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571759022032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a4450 con 0x7f9d1c014070 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.541+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a4ca0 con 0x560334198280 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.543+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.544+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571759028208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a5240 con 0x560334198280 2024-09-14T10:55:23.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.544+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a5d60 con 0x56033419cc70 2024-09-14T10:55:23.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.544+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571759022032] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.544+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571759028208] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.546+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.546+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571759032368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a5d20 con 0x56033419cc70 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.546+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a6600 con 0x7f9d1c014070 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.549+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571759032368] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.549+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.549+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571759034704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a5d60 con 0x7f9d1c014070 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.549+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a7110 con 0x560334198280 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.550+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.550+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571759037376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a7110 con 0x560334198280 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.550+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a80f0 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.551+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571759034704] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.551+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.551+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571759026080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a80b0 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.551+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a8b30 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.551+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571759037376] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.552+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571759026080] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.553+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.553+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571759044128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a7c00 con 0x7f9d140a5040 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.553+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a91c0 con 0x7f9d140a5040 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571759044128] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571759039744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a7c00 con 0x7f9d140a5040 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=0 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=1 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=2 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=3 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=4 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=5 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.554+0000 7f9d26e40800 20 add_watcher() i=6 2024-09-14T10:55:23.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.555+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571759039744] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.555+0000 7f9d26e40800 20 add_watcher() i=7 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.555+0000 7f9d26e40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.555+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341ac360 con 0x560334198280 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.556+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.556+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571759045904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341a9820 con 0x560334198280 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571759045904] v35'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9bdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 5 note: GC not initialized 2024-09-14T10:55:23.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9bd9fe3640 20 reqs_thread_entry: start 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 20 Filter name: none 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9b4b7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.557+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341df6c0 con 0x7f9d140a5040 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:23.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341ddda0 con 0x560334198280 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=7 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.558+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603341de190 con 0x560334198280 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9d26e40800 20 get_user_info_from_index found 0 xattrs 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.559+0000 7f9bdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.560+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571759045904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560334194090 con 0x560334198280 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.560+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94571759045904] v35'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.560+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571759022032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x7f9d1c014070 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.562+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94571759022032] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.562+0000 7f9d26e40800 20 remove_watcher() i=0 2024-09-14T10:55:23.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.562+0000 7f9d26e40800 2 removed watcher, disabling cache 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.562+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571759028208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x560334198280 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.563+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94571759028208] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.563+0000 7f9d26e40800 20 remove_watcher() i=1 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.563+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571759032368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x56033419cc70 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.564+0000 7f9d2512b640 1 -- 172.21.15.164:0/1575971331 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94571759032368] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d1c03d070 con 0x56033419cc70 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.564+0000 7f9d26e40800 20 remove_watcher() i=2 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.564+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571759034704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x7f9d1c014070 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.565+0000 7f9d2492a640 1 -- 172.21.15.164:0/1575971331 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94571759034704] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d14051070 con 0x7f9d1c014070 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.565+0000 7f9d26e40800 20 remove_watcher() i=3 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.565+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571759037376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x560334198280 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.566+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94571759037376] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x560334198280 2024-09-14T10:55:23.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.566+0000 7f9d26e40800 20 remove_watcher() i=4 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.566+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571759026080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.567+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94571759026080] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.567+0000 7f9d26e40800 20 remove_watcher() i=5 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.567+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571759044128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.568+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94571759044128] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.568+0000 7f9d26e40800 20 remove_watcher() i=6 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.568+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571759039744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603341dd4d0 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94571759039744] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d18029040 con 0x7f9d140a5040 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 20 remove_watcher() i=7 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9d140a5040 msgr2=0x7f9d1407e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9d140a5040 0x7f9d1407e770 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334198280 msgr2=0x56033419a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334198280 0x56033419a740 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9d1c014070 msgr2=0x7f9d1c0378b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9d1c014070 0x7f9d1c0378b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56033419cc70 msgr2=0x56033419f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.569+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56033419cc70 0x56033419f060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bf003ce60 msgr2=0x7f9bf003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bf003ce60 0x7f9bf003f320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d1405dac0 tx=0x7f9d1408a000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 msgr2=0x56033418c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d24129640 1 -- 172.21.15.164:0/1575971331 reap_dead start 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c053380 tx=0x7f9d1c054530 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 shutdown_connections 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/1575971331 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334184eb0 0x56033418c4c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 >> 172.21.15.164:0/1575971331 conn(0x5603341812b0 msgr2=0x56033417f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 shutdown_connections 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/1575971331 wait complete. 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 msgr2=0x7f9bfc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 0x7f9bfc03f2d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56033415ed80 tx=0x7f9d1405f4a0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 msgr2=0x560334178830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x56033415e4c0 tx=0x7f9d1c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 shutdown_connections 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bfc03ce10 0x7f9bfc03f2d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 --2- 172.21.15.164:0/2586272717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560334178410 0x560334178830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 >> 172.21.15.164:0/2586272717 conn(0x56033416c7c0 msgr2=0x56033416cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 shutdown_connections 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.570+0000 7f9d26e40800 1 -- 172.21.15.164:0/2586272717 wait complete. 2024-09-14T10:55:23.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 msgr2=0x560334164b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 0x560334164b10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 msgr2=0x5603341692e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 0x5603341692e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 msgr2=0x7f9c0c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 0x7f9c0c03f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d18001d70 tx=0x7f9d180012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 msgr2=0x56033415d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d14025c20 tx=0x7f9d14002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 shutdown_connections 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560334166e40 0x5603341692e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560334068de0 0x560334164b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9c0c03ce60 0x7f9c0c03f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 --2- 172.21.15.164:0/3664226249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560333fd7730 0x56033415d4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 >> 172.21.15.164:0/3664226249 conn(0x56033405dfd0 msgr2=0x56033414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 shutdown_connections 2024-09-14T10:55:23.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.571+0000 7f9d26e40800 1 -- 172.21.15.164:0/3664226249 wait complete. 2024-09-14T10:55:23.582 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-14T10:55:23.583 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.583 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:23.627 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.627 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff8213800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ccbc79d790 0x55ccbc79db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff8213800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ccbc79f470 con 0x55ccbc79e8b0 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff8213800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55ccbc6297d0 con 0x55ccbc79d790 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff3992640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ccbc79d790 0x55ccbc79db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff3191640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55ccbc79e8b0 0x55ccbc79ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38560/0 (socket says 172.21.15.164:38560) 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff3992640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ccbc79d790 0x55ccbc79db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60630/0 (socket says 172.21.15.164:60630) 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.630+0000 7f5ff3191640 1 -- 172.21.15.164:0/252610547 learned_addr learned my addr 172.21.15.164:0/252610547 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.631+0000 7f5ff3992640 1 -- 172.21.15.164:0/252610547 >> v1:172.21.15.116:6789/0 conn(0x55ccbc79e8b0 legacy=0x55ccbc79ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.631+0000 7f5ff3992640 1 -- 172.21.15.164:0/252610547 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc79f640 con 0x55ccbc79d790 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.632+0000 7f5ff3992640 1 --2- 172.21.15.164:0/252610547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc79db90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61002cbea0f4164f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff2990640 1 -- 172.21.15.164:0/252610547 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4058530 con 0x55ccbc79d790 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff2990640 1 -- 172.21.15.164:0/252610547 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40586d0 con 0x55ccbc79d790 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff2990640 1 -- 172.21.15.164:0/252610547 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe40589d0 con 0x55ccbc79d790 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 -- 172.21.15.164:0/252610547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 msgr2=0x55ccbc79db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 --2- 172.21.15.164:0/252610547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc79db90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe4045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:23.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 -- 172.21.15.164:0/252610547 shutdown_connections 2024-09-14T10:55:23.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 --2- 172.21.15.164:0/252610547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc79db90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 -- 172.21.15.164:0/252610547 >> 172.21.15.164:0/252610547 conn(0x55ccbc798f80 msgr2=0x55ccbc79b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 -- 172.21.15.164:0/252610547 shutdown_connections 2024-09-14T10:55:23.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.633+0000 7f5ff8213800 1 -- 172.21.15.164:0/252610547 wait complete. 2024-09-14T10:55:23.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.647+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.647+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.647+0000 7f5ff8213800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.647+0000 7f5ff8213800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ccbc636dd0 con 0x55ccbc79d790 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.647+0000 7f5ff3992640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ff3992640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60636/0 (socket says 172.21.15.164:60636) 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ff3992640 1 -- 172.21.15.164:0/2528284197 learned_addr learned my addr 172.21.15.164:0/2528284197 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ff3992640 1 -- 172.21.15.164:0/2528284197 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc8913c0 con 0x55ccbc79d790 2024-09-14T10:55:23.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ff3992640 1 --2- 172.21.15.164:0/2528284197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4025a60 tx=0x7f5fe4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec028c590691e0f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ee1e0b640 1 -- 172.21.15.164:0/2528284197 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe40589b0 con 0x55ccbc79d790 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ee1e0b640 1 -- 172.21.15.164:0/2528284197 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe4068070 con 0x55ccbc79d790 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.648+0000 7f5ee1e0b640 1 -- 172.21.15.164:0/2528284197 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4058c80 con 0x55ccbc79d790 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- 172.21.15.164:0/2528284197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 msgr2=0x55ccbc711d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 --2- 172.21.15.164:0/2528284197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4025a60 tx=0x7f5fe4051000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- 172.21.15.164:0/2528284197 shutdown_connections 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 --2- 172.21.15.164:0/2528284197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc711d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- 172.21.15.164:0/2528284197 >> 172.21.15.164:0/2528284197 conn(0x55ccbc798f80 msgr2=0x55ccbc889080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- 172.21.15.164:0/2528284197 shutdown_connections 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- 172.21.15.164:0/2528284197 wait complete. 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.649+0000 7f5ff8213800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ccbc7a4da0 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff3992640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff3992640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60652/0 (socket says 172.21.15.164:60652) 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff3992640 1 -- 172.21.15.164:0/1639786770 learned_addr learned my addr 172.21.15.164:0/1639786770 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff3992640 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc896790 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff3992640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4025a60 tx=0x7f5fe4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5edbfff640 1 -- 172.21.15.164:0/1639786770 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4063650 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5edbfff640 1 -- 172.21.15.164:0/1639786770 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40637f0 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccbc896a20 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5edbfff640 1 -- 172.21.15.164:0/1639786770 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4063af0 con 0x55ccbc79d790 2024-09-14T10:55:23.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.650+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccbc897630 con 0x55ccbc79d790 2024-09-14T10:55:23.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.651+0000 7f5edbfff640 1 -- 172.21.15.164:0/1639786770 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5fe4063c90 con 0x55ccbc79d790 2024-09-14T10:55:23.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.651+0000 7f5edbfff640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 0x7f5edc03f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.651+0000 7f5edbfff640 1 -- 172.21.15.164:0/1639786770 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5fe4098640 con 0x55ccbc79d790 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.651+0000 7f5ff3191640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 0x7f5edc03f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 0x55ccbc89d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc89ddc0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff4193640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 0x55ccbc89d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff3191640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 0x7f5edc03f370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001d70 tx=0x7f5fdc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff4193640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 0x55ccbc89d880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff4193640 1 -- 172.21.15.164:0/1639786770 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.652+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc89e160 con 0x55ccbc79e8b0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff4193640 1 -- 172.21.15.164:0/1639786770 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 0x55ccbc8a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8a2850 con 0x55ccbc89fc20 2024-09-14T10:55:23.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff3992640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 0x55ccbc8a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff3992640 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 0x55ccbc8a20c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff3992640 1 -- 172.21.15.164:0/1639786770 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fe40743e0 con 0x55ccbc89fc20 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc89e9b0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff4193640 1 -- 172.21.15.164:0/1639786770 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.653+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc89edd0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff4193640 1 -- 172.21.15.164:0/1639786770 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc79e8b0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff8213800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff8213800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ccbc6954a0 con 0x55ccbc88eb50 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.654+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60664/0 (socket says 172.21.15.164:60664) 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ff4193640 1 -- 172.21.15.164:0/307886700 learned_addr learned my addr 172.21.15.164:0/307886700 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ff4193640 1 -- 172.21.15.164:0/307886700 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc88f070 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ff4193640 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55ccbc898120 tx=0x7f5fec00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ed97fa640 1 -- 172.21.15.164:0/307886700 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec007dc0 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ed97fa640 1 -- 172.21.15.164:0/307886700 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec01e020 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccbc88d900 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ed97fa640 1 -- 172.21.15.164:0/307886700 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec019570 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.655+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccbc88de50 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ed97fa640 1 -- 172.21.15.164:0/307886700 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5fec016040 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ed97fa640 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 0x7f5ecc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ed97fa640 1 -- 172.21.15.164:0/307886700 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5fec01f030 con 0x55ccbc88eb50 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ff3992640 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 0x7f5ecc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ff3992640 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 0x7f5ecc03f2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55ccbc898300 tx=0x7f5fe4098040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.656+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff8213800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff8213800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ccbc8915c0 con 0x55ccbc8bff80 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60680/0 (socket says 172.21.15.164:60680) 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff4193640 1 -- 172.21.15.164:0/1282074185 learned_addr learned my addr 172.21.15.164:0/1282074185 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff4193640 1 -- 172.21.15.164:0/1282074185 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc8c0970 con 0x55ccbc8bff80 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ff4193640 1 --2- 172.21.15.164:0/1282074185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec014d90 tx=0x7f5fec014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e2db1033b0312e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ed2ffd640 1 -- 172.21.15.164:0/1282074185 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec051020 con 0x55ccbc8bff80 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ed2ffd640 1 -- 172.21.15.164:0/1282074185 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec045260 con 0x55ccbc8bff80 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.657+0000 7f5ed2ffd640 1 -- 172.21.15.164:0/1282074185 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec01d070 con 0x55ccbc8bff80 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- 172.21.15.164:0/1282074185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 msgr2=0x55ccbc8c0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1282074185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec014d90 tx=0x7f5fec014d00 comp rx=0 tx=0).stop 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- 172.21.15.164:0/1282074185 shutdown_connections 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1282074185 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c0380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- 172.21.15.164:0/1282074185 >> 172.21.15.164:0/1282074185 conn(0x55ccbc8bc380 msgr2=0x55ccbc8ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- 172.21.15.164:0/1282074185 shutdown_connections 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- 172.21.15.164:0/1282074185 wait complete. 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 Processor -- start 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- start start 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff8213800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ccbc8c0f90 con 0x55ccbc8bff80 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff4193640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60694/0 (socket says 172.21.15.164:60694) 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.658+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 learned_addr learned my addr 172.21.15.164:0/265534188 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbc8c7aa0 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ff4193640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c7540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5fec014d90 tx=0x7f5fec0543f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ed17fa640 1 -- 172.21.15.164:0/265534188 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec030020 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ed17fa640 1 -- 172.21.15.164:0/265534188 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec045410 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ed17fa640 1 -- 172.21.15.164:0/265534188 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fec019a50 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccbc8c7d30 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.659+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccbc8c7d30 con 0x55ccbc8bff80 2024-09-14T10:55:23.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ed17fa640 1 -- 172.21.15.164:0/265534188 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5fec033020 con 0x55ccbc8bff80 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ed17fa640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ebc03ce60 0x7f5ebc03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ed17fa640 1 -- 172.21.15.164:0/265534188 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5fec03ebd0 con 0x55ccbc8bff80 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff3992640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ebc03ce60 0x7f5ebc03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc8d2f50 0x55ccbc8d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8d5b60 con 0x55ccbc8d2f50 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff3992640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ebc03ce60 0x7f5ebc03f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4098010 tx=0x7f5fe4084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.660+0000 7f5ff3191640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc8d2f50 0x55ccbc8d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff3191640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc8d2f50 0x55ccbc8d5410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc009050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 realm 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8d22a0 con 0x55ccbc8d2f50 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc009050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8d6640 con 0x55ccbc8d2f50 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc009050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.661+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8d6f10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fdc009050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc8d7850 0x55ccbc8d9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8da380 con 0x55ccbc8d7850 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff4193640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc8d7850 0x55ccbc8d9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff4193640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc8d7850 0x55ccbc8d9c40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc8d7850 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 20 searching for the correct realm 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.662+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc8d7850 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff4193640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5fec035020 0x7f5fec045970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3992640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5fec035020 0x7f5fec045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3992640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5fec035020 0x7f5fec045970 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3992640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5fe408f200 0x7f5fe404f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.663+0000 7f5ff3191640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5fe408f200 0x7f5fe404f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5fe408f200 0x7f5fe404f5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc009050 con 0x7f5fe408f200 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc009050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.664+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc8d7850 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.665+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.666+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec0083e0 con 0x55ccbc8d7850 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.667+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.668+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.669+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d7850 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.670+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fe408f200 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x55ccbc8d2f50 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dbd10 con 0x7f5fec035020 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dae00 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.671+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8daa40 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8db720 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 zone default found 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 4 Realm: () 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 zonegroup default 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8db280 con 0x7f5fe408f200 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.672+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8de090 con 0x55ccbc8d7850 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8de670 con 0x55ccbc8d7850 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 20 started sync module instance, tier type = 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.673+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dd4a0 con 0x7f5fec035020 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.674+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.674+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94337825099760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dead0 con 0x7f5fec035020 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.674+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df320 con 0x55ccbc8d2f50 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.675+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94337825099760] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.675+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.676+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94337825102016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df3c0 con 0x55ccbc8d2f50 2024-09-14T10:55:23.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.676+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dfee0 con 0x55ccbc8d7850 2024-09-14T10:55:23.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.677+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94337825102016] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.677+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.677+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94337825110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dfea0 con 0x55ccbc8d7850 2024-09-14T10:55:23.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.677+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e0960 con 0x7f5fec035020 2024-09-14T10:55:23.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.679+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94337825110448] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.679+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.679+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94337825113200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e0d50 con 0x7f5fec035020 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.680+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e17b0 con 0x55ccbc8d2f50 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.682+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.682+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94337825116816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e2050 con 0x55ccbc8d2f50 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.682+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e2b10 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.685+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.685+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94337825121760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e2ad0 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.685+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e3a70 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.687+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94337825113200] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.687+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94337825121760] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.688+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94337825116816] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.688+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.688+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94337825125760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e1b70 con 0x7f5fe408f200 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.688+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e3a70 con 0x7f5fe408f200 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94337825125760] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94337825123872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e3f20 con 0x7f5fe408f200 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=0 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=1 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=2 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=3 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=4 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=5 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.689+0000 7f5ff8213800 20 add_watcher() i=6 2024-09-14T10:55:23.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.690+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94337825123872] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.690+0000 7f5ff8213800 20 add_watcher() i=7 2024-09-14T10:55:23.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.691+0000 7f5ff8213800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.691+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e6f50 con 0x55ccbc8d2f50 2024-09-14T10:55:23.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.691+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.691+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94337825127024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8e4340 con 0x55ccbc8d2f50 2024-09-14T10:55:23.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.693+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94337825127024] v35'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.693+0000 7f5ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.693+0000 7f5ff8213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 5 note: GC not initialized 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ea8fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 20 Filter name: none 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5e227fc640 20 reqs_thread_entry: start 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc919b80 con 0x55ccbc8d2f50 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.694+0000 7f5ff8213800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:23.695 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:23.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.695+0000 7f5ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.695+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94337825127024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc918520 con 0x55ccbc8d2f50 2024-09-14T10:55:23.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.696+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94337825127024] v35'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.696+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94337825099760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc918520 con 0x7f5fec035020 2024-09-14T10:55:23.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.699+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94337825099760] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.699+0000 7f5ff8213800 20 remove_watcher() i=0 2024-09-14T10:55:23.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.699+0000 7f5ff8213800 2 removed watcher, disabling cache 2024-09-14T10:55:23.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.699+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94337825102016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dcff0 con 0x55ccbc8d2f50 2024-09-14T10:55:23.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.700+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94337825102016] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.700+0000 7f5ff8213800 20 remove_watcher() i=1 2024-09-14T10:55:23.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.700+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94337825110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8dd8c0 con 0x55ccbc8d7850 2024-09-14T10:55:23.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.701+0000 7f5ff4193640 1 -- 172.21.15.164:0/265534188 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94337825110448] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fec065040 con 0x55ccbc8d7850 2024-09-14T10:55:23.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.701+0000 7f5ff8213800 20 remove_watcher() i=2 2024-09-14T10:55:23.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.701+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94337825113200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df9b0 con 0x7f5fec035020 2024-09-14T10:55:23.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.702+0000 7f5ff3992640 1 -- 172.21.15.164:0/265534188 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94337825113200] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe40743e0 con 0x7f5fec035020 2024-09-14T10:55:23.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.702+0000 7f5ff8213800 20 remove_watcher() i=3 2024-09-14T10:55:23.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.702+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94337825116816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df9b0 con 0x55ccbc8d2f50 2024-09-14T10:55:23.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.704+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94337825116816] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x55ccbc8d2f50 2024-09-14T10:55:23.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.704+0000 7f5ff8213800 20 remove_watcher() i=4 2024-09-14T10:55:23.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.704+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94337825121760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df9b0 con 0x7f5fe408f200 2024-09-14T10:55:23.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.706+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94337825121760] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.706+0000 7f5ff8213800 20 remove_watcher() i=5 2024-09-14T10:55:23.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.706+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94337825125760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df9b0 con 0x7f5fe408f200 2024-09-14T10:55:23.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.707+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94337825125760] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.707+0000 7f5ff8213800 20 remove_watcher() i=6 2024-09-14T10:55:23.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.707+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94337825123872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ccbc8df9b0 con 0x7f5fe408f200 2024-09-14T10:55:23.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94337825123872] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc029040 con 0x7f5fe408f200 2024-09-14T10:55:23.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 20 remove_watcher() i=7 2024-09-14T10:55:23.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5fe408f200 msgr2=0x7f5fe404f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5fe408f200 0x7f5fe404f5d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc8d2f50 msgr2=0x55ccbc8d5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc8d2f50 0x55ccbc8d5410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5fec035020 msgr2=0x7f5fec045970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5fec035020 0x7f5fec045970 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc8d7850 msgr2=0x55ccbc8d9c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc8d7850 0x55ccbc8d9c40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ebc03ce60 msgr2=0x7f5ebc03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ebc03ce60 0x7f5ebc03f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4098010 tx=0x7f5fe4084000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 msgr2=0x55ccbc8c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/265534188 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc8bff80 0x55ccbc8c7540 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5fec014d90 tx=0x7f5fec0543f0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 reap_dead start 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff3191640 1 -- 172.21.15.164:0/265534188 reap_dead start 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 shutdown_connections 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 >> 172.21.15.164:0/265534188 conn(0x55ccbc8bc380 msgr2=0x55ccbc8ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 shutdown_connections 2024-09-14T10:55:23.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/265534188 wait complete. 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 msgr2=0x7f5ecc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 0x7f5ecc03f2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55ccbc898300 tx=0x7f5fe4098040 comp rx=0 tx=0).stop 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 msgr2=0x55ccbc88d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55ccbc898120 tx=0x7f5fec00af40 comp rx=0 tx=0).stop 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 shutdown_connections 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5ecc03ce10 0x7f5ecc03f2d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 --2- 172.21.15.164:0/307886700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc88eb50 0x55ccbc88d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.709+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 >> 172.21.15.164:0/307886700 conn(0x55ccbc8a5620 msgr2=0x55ccbc8a5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 shutdown_connections 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/307886700 wait complete. 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 msgr2=0x55ccbc89d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 0x55ccbc89d880 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 msgr2=0x55ccbc8a20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 0x55ccbc8a20c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 msgr2=0x7f5edc03f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 0x7f5edc03f370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001d70 tx=0x7f5fdc0012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 msgr2=0x55ccbc896230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4025a60 tx=0x7f5fe4003330 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 shutdown_connections 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ccbc89fc20 0x55ccbc8a20c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ccbc79e8b0 0x55ccbc89d880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5edc03ceb0 0x7f5edc03f370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 --2- 172.21.15.164:0/1639786770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbc79d790 0x55ccbc896230 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 >> 172.21.15.164:0/1639786770 conn(0x55ccbc798f80 msgr2=0x55ccbc887870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 shutdown_connections 2024-09-14T10:55:23.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.710+0000 7f5ff8213800 1 -- 172.21.15.164:0/1639786770 wait complete. 2024-09-14T10:55:23.716 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:23.716 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-14T10:55:23.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-14T10:55:23.717 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-14T10:55:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f819162b800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x556494dfdc50 0x556494dfe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f819162b800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556494e067f0 con 0x556494e02ce0 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f819162b800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x556494c8a7d0 con 0x556494dfdc50 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f818f115640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x556494dfdc50 0x556494dfe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f818e914640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x556494e02ce0 0x556494e050d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38566/0 (socket says 172.21.15.164:38566) 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f818e914640 1 -- 172.21.15.164:0/3001021401 learned_addr learned my addr 172.21.15.164:0/3001021401 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.764+0000 7f818f115640 1 --2- 172.21.15.164:0/3001021401 >> v2:172.21.15.116:3300/0 conn(0x556494dfdc50 0x556494dfe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60698/0 (socket says 172.21.15.164:60698) 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.765+0000 7f818f115640 1 -- 172.21.15.164:0/3001021401 >> v1:172.21.15.116:6789/0 conn(0x556494e02ce0 legacy=0x556494e050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.765+0000 7f818f115640 1 -- 172.21.15.164:0/3001021401 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494e079d0 con 0x556494dfdc50 2024-09-14T10:55:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f818f115640 1 --2- 172.21.15.164:0/3001021401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494dfe050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f818000a470 tx=0x7f8180045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb97f12efa8e65d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f818e113640 1 -- 172.21.15.164:0/3001021401 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180053570 con 0x556494dfdc50 2024-09-14T10:55:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f818e113640 1 -- 172.21.15.164:0/3001021401 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180058070 con 0x556494dfdc50 2024-09-14T10:55:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f818e113640 1 -- 172.21.15.164:0/3001021401 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180053880 con 0x556494dfdc50 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 -- 172.21.15.164:0/3001021401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 msgr2=0x556494dfe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 --2- 172.21.15.164:0/3001021401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494dfe050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f818000a470 tx=0x7f8180045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 -- 172.21.15.164:0/3001021401 shutdown_connections 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 --2- 172.21.15.164:0/3001021401 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494dfe050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 -- 172.21.15.164:0/3001021401 >> 172.21.15.164:0/3001021401 conn(0x556494df96e0 msgr2=0x556494dfbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 -- 172.21.15.164:0/3001021401 shutdown_connections 2024-09-14T10:55:23.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.767+0000 7f819162b800 1 -- 172.21.15.164:0/3001021401 wait complete. 2024-09-14T10:55:23.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.781+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f819162b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f819162b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556494c97dd0 con 0x556494dfdc50 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f818f115640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f818f115640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60704/0 (socket says 172.21.15.164:60704) 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f818f115640 1 -- 172.21.15.164:0/655275585 learned_addr learned my addr 172.21.15.164:0/655275585 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f818f115640 1 -- 172.21.15.164:0/655275585 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494eefd60 con 0x556494dfdc50 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.782+0000 7f818f115640 1 --2- 172.21.15.164:0/655275585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8180025c20 tx=0x7f8180051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d25be34bd40870f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f807d60a640 1 -- 172.21.15.164:0/655275585 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180053a20 con 0x556494dfdc50 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f807d60a640 1 -- 172.21.15.164:0/655275585 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180063070 con 0x556494dfdc50 2024-09-14T10:55:23.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f807d60a640 1 -- 172.21.15.164:0/655275585 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180053cf0 con 0x556494dfdc50 2024-09-14T10:55:23.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 -- 172.21.15.164:0/655275585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 msgr2=0x556494eef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 --2- 172.21.15.164:0/655275585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8180025c20 tx=0x7f8180051000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 -- 172.21.15.164:0/655275585 shutdown_connections 2024-09-14T10:55:23.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 --2- 172.21.15.164:0/655275585 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494eef770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 -- 172.21.15.164:0/655275585 >> 172.21.15.164:0/655275585 conn(0x556494df96e0 msgr2=0x556494eeb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 -- 172.21.15.164:0/655275585 shutdown_connections 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.783+0000 7f819162b800 1 -- 172.21.15.164:0/655275585 wait complete. 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f819162b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f819162b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556494e06cc0 con 0x556494dfdc50 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f818f115640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f818f115640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60706/0 (socket says 172.21.15.164:60706) 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f818f115640 1 -- 172.21.15.164:0/511356642 learned_addr learned my addr 172.21.15.164:0/511356642 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f818f115640 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494e00950 con 0x556494dfdc50 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.784+0000 7f818f115640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f818000a470 tx=0x7f8180002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.785+0000 7f807be07640 1 -- 172.21.15.164:0/511356642 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180068660 con 0x556494dfdc50 2024-09-14T10:55:23.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.785+0000 7f807be07640 1 -- 172.21.15.164:0/511356642 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180068800 con 0x556494dfdc50 2024-09-14T10:55:23.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.785+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556494dfed00 con 0x556494dfdc50 2024-09-14T10:55:23.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.785+0000 7f807be07640 1 -- 172.21.15.164:0/511356642 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8180068b00 con 0x556494dfdc50 2024-09-14T10:55:23.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.785+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556494dff320 con 0x556494dfdc50 2024-09-14T10:55:23.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f807be07640 1 -- 172.21.15.164:0/511356642 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8180068ca0 con 0x556494dfdc50 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f807be07640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 0x7f807403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f807be07640 1 -- 172.21.15.164:0/511356642 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8180098c70 con 0x556494dfdc50 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f818e914640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 0x7f807403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 0x556494f00730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f00c70 con 0x556494e02ce0 2024-09-14T10:55:23.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f818f916640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 0x556494f00730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.786+0000 7f818e914640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 0x7f807403f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8184001d70 tx=0x7f81840012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f818f916640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 0x556494f00730 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f818f916640 1 -- 172.21.15.164:0/511356642 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f818800a4d0 con 0x556494e02ce0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f01530 con 0x556494e02ce0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f818f916640 1 -- 172.21.15.164:0/511356642 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f818800a4d0 con 0x556494e02ce0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 0x556494f052e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f05a70 con 0x556494f02e40 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.787+0000 7f818f115640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 0x556494f052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f818f115640 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 0x556494f052e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f818f115640 1 -- 172.21.15.164:0/511356642 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8180051070 con 0x556494f02e40 2024-09-14T10:55:23.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f01d80 con 0x556494e02ce0 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f818f916640 1 -- 172.21.15.164:0/511356642 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f818800a4d0 con 0x556494e02ce0 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f02160 con 0x556494e02ce0 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.788+0000 7f818f916640 1 -- 172.21.15.164:0/511356642 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f818800a4d0 con 0x556494e02ce0 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f819162b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f819162b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556494cf64a0 con 0x556494f14480 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60722/0 (socket says 172.21.15.164:60722) 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.789+0000 7f818f916640 1 -- 172.21.15.164:0/68638515 learned_addr learned my addr 172.21.15.164:0/68638515 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f818f916640 1 -- 172.21.15.164:0/68638515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494f14ee0 con 0x556494f14480 2024-09-14T10:55:23.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f818f916640 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x556494dfff90 tx=0x7f8188018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f8079602640 1 -- 172.21.15.164:0/68638515 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8188014450 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f8079602640 1 -- 172.21.15.164:0/68638515 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8188014610 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f8079602640 1 -- 172.21.15.164:0/68638515 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8188014930 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556494f15710 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.790+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556494f15cb0 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f8079602640 1 -- 172.21.15.164:0/68638515 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8188011040 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f8079602640 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 0x7f806803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f8079602640 1 -- 172.21.15.164:0/68638515 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f818801e070 con 0x556494f14480 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f818f115640 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 0x7f806803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f818f115640 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 0x7f806803f2d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x556494dff950 tx=0x7f818007d5e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.791+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f819162b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f819162b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556494ef0130 con 0x556494f20f20 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60724/0 (socket says 172.21.15.164:60724) 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f818f916640 1 -- 172.21.15.164:0/1043587505 learned_addr learned my addr 172.21.15.164:0/1043587505 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f818f916640 1 -- 172.21.15.164:0/1043587505 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494f21910 con 0x556494f20f20 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f818f916640 1 --2- 172.21.15.164:0/1043587505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8188016fd0 tx=0x7f8188011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1d5933a523d0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f8072ffd640 1 -- 172.21.15.164:0/1043587505 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f818804b070 con 0x556494f20f20 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f8072ffd640 1 -- 172.21.15.164:0/1043587505 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8188051070 con 0x556494f20f20 2024-09-14T10:55:23.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.792+0000 7f8072ffd640 1 -- 172.21.15.164:0/1043587505 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81880167c0 con 0x556494f20f20 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- 172.21.15.164:0/1043587505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 msgr2=0x556494f21320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 --2- 172.21.15.164:0/1043587505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8188016fd0 tx=0x7f8188011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- 172.21.15.164:0/1043587505 shutdown_connections 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 --2- 172.21.15.164:0/1043587505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f21320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- 172.21.15.164:0/1043587505 >> 172.21.15.164:0/1043587505 conn(0x556494f1d320 msgr2=0x556494f1b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- 172.21.15.164:0/1043587505 shutdown_connections 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- 172.21.15.164:0/1043587505 wait complete. 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 Processor -- start 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- start start 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f819162b800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556494f21f30 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f818f916640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60734/0 (socket says 172.21.15.164:60734) 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.793+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 learned_addr learned my addr 172.21.15.164:0/2948220498 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556494f28a80 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f818f916640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8188016fd0 tx=0x7f8188054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f80717fa640 1 -- 172.21.15.164:0/2948220498 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f818804b030 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f80717fa640 1 -- 172.21.15.164:0/2948220498 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8188031030 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f80717fa640 1 -- 172.21.15.164:0/2948220498 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8188014c00 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556494f28d10 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.794+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556494f29690 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.795+0000 7f80717fa640 1 -- 172.21.15.164:0/2948220498 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8188001750 con 0x556494f20f20 2024-09-14T10:55:23.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.795+0000 7f80717fa640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f805803ce60 0x7f805803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.795+0000 7f80717fa640 1 -- 172.21.15.164:0/2948220498 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f818804c070 con 0x556494f20f20 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.795+0000 7f818f115640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f805803ce60 0x7f805803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f818f115640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f805803ce60 0x7f805803f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8180097320 tx=0x7f818008a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494f34290 0x556494f36750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f36ea0 con 0x556494f34290 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f818e914640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494f34290 0x556494f36750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f818e914640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494f34290 0x556494f36750 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8184009050 con 0x556494f34290 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 20 realm 2024-09-14T10:55:23.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.796+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f335e0 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8184009050 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f37990 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8184009050 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f38260 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8184009050 con 0x556494f34290 2024-09-14T10:55:23.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f38c80 0x556494f3b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3b7b0 con 0x556494f38c80 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f818f916640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f38c80 0x556494f3b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.797+0000 7f818f916640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f38c80 0x556494f3b070 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f819162b800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f819162b800 20 searching for the correct realm 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f916640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8188014070 0x7f8188041a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f115640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8188014070 0x7f8188041a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.798+0000 7f818f115640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8188014070 0x7f8188041a30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.799+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.799+0000 7f818f115640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81800a5040 0x7f818008fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.799+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.799+0000 7f818e914640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81800a5040 0x7f818008fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.799+0000 7f818e914640 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81800a5040 0x7f818008fe60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184009050 con 0x7f81800a5040 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184009050 con 0x556494f34290 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.800+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.801+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.802+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.803+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.804+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.805+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f38c80 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f81800a5040 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x556494f34290 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d0a0 con 0x7f8188014070 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.806+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3c170 con 0x556494f34290 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3c9c0 con 0x556494f34290 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d520 con 0x556494f34290 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 zone default found 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 4 Realm: () 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 zonegroup default 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3d8c0 con 0x7f81800a5040 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.807+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3f6d0 con 0x556494f38c80 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f3fce0 con 0x556494f38c80 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 20 started sync module instance, tier type = 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.808+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f3eb40 con 0x7f8188014070 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.809+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.809+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890484102800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f40140 con 0x7f8188014070 2024-09-14T10:55:23.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.809+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f409f0 con 0x556494f34290 2024-09-14T10:55:23.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.812+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.812+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890484110560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f412c0 con 0x556494f34290 2024-09-14T10:55:23.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.812+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93890484102800] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.812+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f3ef30 con 0x556494f38c80 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.815+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93890484110560] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.815+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.815+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890484112912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f41230 con 0x556494f38c80 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.815+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f423b0 con 0x7f8188014070 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.817+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93890484112912] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.817+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.817+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890484117152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f42370 con 0x7f8188014070 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.817+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f42e30 con 0x556494f34290 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.820+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.820+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890484119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f42e30 con 0x556494f34290 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.820+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f43df0 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.820+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93890484117152] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.823+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93890484119872] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.823+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.823+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890484123840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f43df0 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.823+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f432c0 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.826+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93890484123840] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.826+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.826+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890484122240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f441e0 con 0x7f81800a5040 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.826+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f44c30 con 0x7f81800a5040 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93890484122240] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890484127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f44bf0 con 0x7f81800a5040 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=0 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=1 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=2 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=3 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=4 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=5 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.827+0000 7f819162b800 20 add_watcher() i=6 2024-09-14T10:55:23.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93890484127520] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f819162b800 20 add_watcher() i=7 2024-09-14T10:55:23.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f819162b800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f48050 con 0x556494f34290 2024-09-14T10:55:23.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.828+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890484115584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f45590 con 0x556494f34290 2024-09-14T10:55:23.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.830+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93890484115584] v35'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.830+0000 7f8045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 5 note: GC not initialized 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f8044fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 Filter name: none 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f7fbe7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f7b330 con 0x556494f34290 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:23.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.831+0000 7f819162b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.832+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f7dc60 con 0x7f8188014070 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.832+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.832+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f81510 con 0x556494f34290 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f819162b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f819162b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f819162b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93890484375248 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556494f7ffb0 con 0x556494f34290 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 93890484119872 notify 150323855361 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556494e067f0 con 0x556494f34290 2024-09-14T10:55:23.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f8072ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 93890484119872 notifier 4325 bl.length()=567 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f8072ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f8072ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(65 notify.4 [notify cookie 93890484375248 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.833+0000 7f8072ffd640 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f8054003ea0 con 0x556494f34290 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.834+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.834+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 93890484375248 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f818403ba70 con 0x556494f34290 2024-09-14T10:55:23.836 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.835+0000 7f8045fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.835+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890484115584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x556494f34290 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.836+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93890484115584] v35'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.836+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890484102800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x7f8188014070 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.837+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93890484102800] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.837+0000 7f819162b800 20 remove_watcher() i=0 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.837+0000 7f819162b800 2 removed watcher, disabling cache 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.837+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890484110560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x556494f34290 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.838+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93890484110560] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.838+0000 7f819162b800 20 remove_watcher() i=1 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.838+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890484112912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x556494f38c80 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.839+0000 7f818f916640 1 -- 172.21.15.164:0/2948220498 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93890484112912] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f818803d070 con 0x556494f38c80 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.839+0000 7f819162b800 20 remove_watcher() i=2 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.839+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890484117152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x7f8188014070 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.840+0000 7f818f115640 1 -- 172.21.15.164:0/2948220498 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93890484117152] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8180051070 con 0x7f8188014070 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.840+0000 7f819162b800 20 remove_watcher() i=3 2024-09-14T10:55:23.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.840+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890484119872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x556494f34290 2024-09-14T10:55:23.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.843+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93890484119872] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x556494f34290 2024-09-14T10:55:23.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.843+0000 7f819162b800 20 remove_watcher() i=4 2024-09-14T10:55:23.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.843+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890484123840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x7f81800a5040 2024-09-14T10:55:23.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.844+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93890484123840] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.844+0000 7f819162b800 20 remove_watcher() i=5 2024-09-14T10:55:23.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.844+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890484122240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x7f81800a5040 2024-09-14T10:55:23.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.845+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93890484122240] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.845+0000 7f819162b800 20 remove_watcher() i=6 2024-09-14T10:55:23.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.845+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890484127520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556494f79100 con 0x7f81800a5040 2024-09-14T10:55:23.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93890484127520] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8184029040 con 0x7f81800a5040 2024-09-14T10:55:23.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 20 remove_watcher() i=7 2024-09-14T10:55:23.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81800a5040 msgr2=0x7f818008fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81800a5040 0x7f818008fe60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494f34290 msgr2=0x556494f36750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494f34290 0x556494f36750 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8188014070 msgr2=0x7f8188041a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8188014070 0x7f8188041a30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f38c80 msgr2=0x556494f3b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.846+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f38c80 0x556494f3b070 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f805803ce60 msgr2=0x7f805803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f805803ce60 0x7f805803f320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8180097320 tx=0x7f818008a000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 msgr2=0x556494f28520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f818e914640 1 -- 172.21.15.164:0/2948220498 reap_dead start 2024-09-14T10:55:23.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8188016fd0 tx=0x7f8188054530 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 shutdown_connections 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/2948220498 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f20f20 0x556494f28520 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 >> 172.21.15.164:0/2948220498 conn(0x556494f1d320 msgr2=0x556494f1b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 shutdown_connections 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/2948220498 wait complete. 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 msgr2=0x7f806803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 0x7f806803f2d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x556494dff950 tx=0x7f818007d5e0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 msgr2=0x556494f148a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x556494dfff90 tx=0x7f8188018830 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 shutdown_connections 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f806803ce10 0x7f806803f2d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/68638515 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494f14480 0x556494f148a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 >> 172.21.15.164:0/68638515 conn(0x556494f08830 msgr2=0x556494f08c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 shutdown_connections 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/68638515 wait complete. 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 msgr2=0x556494f00730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 0x556494f00730 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 msgr2=0x556494f052e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 0x556494f052e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 msgr2=0x7f807403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 0x7f807403f320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8184001d70 tx=0x7f81840012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 msgr2=0x556494e003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.847+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f818000a470 tx=0x7f8180002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 shutdown_connections 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556494f02e40 0x556494f052e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556494e02ce0 0x556494f00730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f807403ce60 0x7f807403f320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 --2- 172.21.15.164:0/511356642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556494dfdc50 0x556494e003f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 >> 172.21.15.164:0/511356642 conn(0x556494df96e0 msgr2=0x556494ee98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 shutdown_connections 2024-09-14T10:55:23.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.848+0000 7f819162b800 1 -- 172.21.15.164:0/511356642 wait complete. 2024-09-14T10:55:23.854 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:23.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:23.855 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:23.899 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:23.899 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17fd135800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e7bfa71bc0 0x55e7bfa74060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17fd135800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7bfa746e0 con 0x55e7bf9e1830 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17fd135800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e7bf8f87d0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17f8620640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e7bfa71bc0 0x55e7bfa74060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17f8e21640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55e7bf9e1830 0x55e7bfa703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38570/0 (socket says 172.21.15.164:38570) 2024-09-14T10:55:23.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.902+0000 7f17f8e21640 1 -- 172.21.15.164:0/1761393844 learned_addr learned my addr 172.21.15.164:0/1761393844 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:23.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.903+0000 7f17f8620640 1 -- 172.21.15.164:0/1761393844 >> v1:172.21.15.116:6789/0 conn(0x55e7bf9e1830 legacy=0x55e7bfa703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.903+0000 7f17f8620640 1 -- 172.21.15.164:0/1761393844 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfa75910 con 0x55e7bfa71bc0 2024-09-14T10:55:23.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.903+0000 7f17f7e1f640 1 -- 172.21.15.164:0/1761393844 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714354846 0 0) 0x55e7bfa746e0 con 0x55e7bf9e1830 2024-09-14T10:55:23.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.904+0000 7f17f8620640 1 --2- 172.21.15.164:0/1761393844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfa71bc0 0x55e7bfa74060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17e000a470 tx=0x7f17e0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3677cf71108f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.904+0000 7f17f7e1f640 1 -- 172.21.15.164:0/1761393844 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0053570 con 0x55e7bfa71bc0 2024-09-14T10:55:23.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17f7e1f640 1 -- 172.21.15.164:0/1761393844 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e0058070 con 0x55e7bfa71bc0 2024-09-14T10:55:23.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17f7e1f640 1 -- 172.21.15.164:0/1761393844 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e0053880 con 0x55e7bfa71bc0 2024-09-14T10:55:23.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 -- 172.21.15.164:0/1761393844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfa71bc0 msgr2=0x55e7bfa74060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 --2- 172.21.15.164:0/1761393844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfa71bc0 0x55e7bfa74060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17e000a470 tx=0x7f17e0045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 -- 172.21.15.164:0/1761393844 shutdown_connections 2024-09-14T10:55:23.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 --2- 172.21.15.164:0/1761393844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfa71bc0 0x55e7bfa74060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 -- 172.21.15.164:0/1761393844 >> 172.21.15.164:0/1761393844 conn(0x55e7bfa67fb0 msgr2=0x55e7bfa6a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 -- 172.21.15.164:0/1761393844 shutdown_connections 2024-09-14T10:55:23.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.905+0000 7f17fd135800 1 -- 172.21.15.164:0/1761393844 wait complete. 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17fd135800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17fd135800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7bf905dd0 con 0x55e7bf9e1830 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17f8e21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17f8e21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60748/0 (socket says 172.21.15.164:60748) 2024-09-14T10:55:23.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.919+0000 7f17f8e21640 1 -- 172.21.15.164:0/922330451 learned_addr learned my addr 172.21.15.164:0/922330451 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.920+0000 7f17f8e21640 1 -- 172.21.15.164:0/922330451 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfa6e150 con 0x55e7bf9e1830 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.920+0000 7f17f8e21640 1 --2- 172.21.15.164:0/922330451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006fa0 tx=0x7f17f0001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319097e3d1864a0c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.920+0000 7f16e6e0d640 1 -- 172.21.15.164:0/922330451 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0003450 con 0x55e7bf9e1830 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.920+0000 7f16e6e0d640 1 -- 172.21.15.164:0/922330451 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0003610 con 0x55e7bf9e1830 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.920+0000 7f16e6e0d640 1 -- 172.21.15.164:0/922330451 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0003970 con 0x55e7bf9e1830 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- 172.21.15.164:0/922330451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 msgr2=0x55e7bfa6db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 --2- 172.21.15.164:0/922330451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006fa0 tx=0x7f17f0001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- 172.21.15.164:0/922330451 shutdown_connections 2024-09-14T10:55:23.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 --2- 172.21.15.164:0/922330451 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfa6db60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- 172.21.15.164:0/922330451 >> 172.21.15.164:0/922330451 conn(0x55e7bfa67fb0 msgr2=0x55e7bfb58f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- 172.21.15.164:0/922330451 shutdown_connections 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- 172.21.15.164:0/922330451 wait complete. 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17fd135800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7bfa74bb0 con 0x55e7bf9e1830 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17f8e21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17f8e21640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60754/0 (socket says 172.21.15.164:60754) 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.921+0000 7f17f8e21640 1 -- 172.21.15.164:0/3908675141 learned_addr learned my addr 172.21.15.164:0/3908675141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f17f8e21640 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfb67820 con 0x55e7bf9e1830 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f17f8e21640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f17f0001330 tx=0x7f17f0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f16e560a640 1 -- 172.21.15.164:0/3908675141 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0014a10 con 0x55e7bf9e1830 2024-09-14T10:55:23.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f16e560a640 1 -- 172.21.15.164:0/3908675141 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0014bb0 con 0x55e7bf9e1830 2024-09-14T10:55:23.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f16e560a640 1 -- 172.21.15.164:0/3908675141 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f001e3f0 con 0x55e7bf9e1830 2024-09-14T10:55:23.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bfb67ab0 con 0x55e7bf9e1830 2024-09-14T10:55:23.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.922+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bfb684b0 con 0x55e7bf9e1830 2024-09-14T10:55:23.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f16e560a640 1 -- 172.21.15.164:0/3908675141 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f17f0010070 con 0x55e7bf9e1830 2024-09-14T10:55:23.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f16e560a640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 0x7f16e003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f16e560a640 1 -- 172.21.15.164:0/3908675141 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f17f0018070 con 0x55e7bf9e1830 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f17f8620640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 0x7f16e003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 0x55e7bfb6e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb6ee50 con 0x55e7bfa71bc0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f17f9622640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 0x55e7bfb6e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.923+0000 7f17f8620640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 0x7f16e003f2d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17e0057000 tx=0x7f17e0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17f9622640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 0x55e7bfb6e910 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17f9622640 1 -- 172.21.15.164:0/3908675141 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17e80083e0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb6f1f0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17f9622640 1 -- 172.21.15.164:0/3908675141 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17e80083e0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 0x55e7bfb73130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb738c0 con 0x55e7bfb70cb0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.924+0000 7f17f8e21640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 0x55e7bfb73130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17f8e21640 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 0x55e7bfb73130 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17f8e21640 1 -- 172.21.15.164:0/3908675141 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f17f001b070 con 0x55e7bfb70cb0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb6fa40 con 0x55e7bfa71bc0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17f9622640 1 -- 172.21.15.164:0/3908675141 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17e80083e0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb6fe20 con 0x55e7bfa71bc0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.925+0000 7f17f9622640 1 -- 172.21.15.164:0/3908675141 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17e80083e0 con 0x55e7bfa71bc0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17fd135800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17fd135800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7bf9644a0 con 0x55e7bfb82300 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60762/0 (socket says 172.21.15.164:60762) 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.926+0000 7f17f9622640 1 -- 172.21.15.164:0/2108366537 learned_addr learned my addr 172.21.15.164:0/2108366537 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f17f9622640 1 -- 172.21.15.164:0/2108366537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfb82d60 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f17f9622640 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55e7bfb691b0 tx=0x7f17e800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f16de7fc640 1 -- 172.21.15.164:0/2108366537 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8007d60 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f16de7fc640 1 -- 172.21.15.164:0/2108366537 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e801e020 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bfb83590 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f16de7fc640 1 -- 172.21.15.164:0/2108366537 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8019590 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.927+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bfb83b30 con 0x55e7bfb82300 2024-09-14T10:55:23.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f16de7fc640 1 -- 172.21.15.164:0/2108366537 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f17e8016040 con 0x55e7bfb82300 2024-09-14T10:55:23.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f16de7fc640 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 0x7f16d003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f16de7fc640 1 -- 172.21.15.164:0/2108366537 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f17e801f030 con 0x55e7bfb82300 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f17f8e21640 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 0x7f16d003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f17f8e21640 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 0x7f16d003f2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55e7bfb69370 tx=0x7f17f0054040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.928+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17fd135800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17fd135800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7bfa6c5b0 con 0x55e7bfb8ed40 2024-09-14T10:55:23.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60768/0 (socket says 172.21.15.164:60768) 2024-09-14T10:55:23.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17f9622640 1 -- 172.21.15.164:0/2064761536 learned_addr learned my addr 172.21.15.164:0/2064761536 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17f9622640 1 -- 172.21.15.164:0/2064761536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfb8f730 con 0x55e7bfb8ed40 2024-09-14T10:55:23.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f17f9622640 1 --2- 172.21.15.164:0/2064761536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17e8054440 tx=0x7f17e8045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118fbc4a20e69f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f16cffff640 1 -- 172.21.15.164:0/2064761536 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e801d040 con 0x55e7bfb8ed40 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f16cffff640 1 -- 172.21.15.164:0/2064761536 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e8017e00 con 0x55e7bfb8ed40 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.929+0000 7f16cffff640 1 -- 172.21.15.164:0/2064761536 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e80184e0 con 0x55e7bfb8ed40 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- 172.21.15.164:0/2064761536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 msgr2=0x55e7bfb8f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 --2- 172.21.15.164:0/2064761536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f17e8054440 tx=0x7f17e8045490 comp rx=0 tx=0).stop 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- 172.21.15.164:0/2064761536 shutdown_connections 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 --2- 172.21.15.164:0/2064761536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb8f140 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- 172.21.15.164:0/2064761536 >> 172.21.15.164:0/2064761536 conn(0x55e7bfb8b140 msgr2=0x55e7bfb89380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- 172.21.15.164:0/2064761536 shutdown_connections 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- 172.21.15.164:0/2064761536 wait complete. 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 Processor -- start 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- start start 2024-09-14T10:55:23.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17fd135800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7bfb8fd50 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17f9622640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60774/0 (socket says 172.21.15.164:60774) 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.930+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 learned_addr learned my addr 172.21.15.164:0/234373098 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7bfb96860 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f17f9622640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17e8017fd0 tx=0x7f17e80543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f16ce7fc640 1 -- 172.21.15.164:0/234373098 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e801d030 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f16ce7fc640 1 -- 172.21.15.164:0/234373098 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e8016330 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7bfb96af0 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f16ce7fc640 1 -- 172.21.15.164:0/234373098 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8016650 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.931+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7bfb97680 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f16ce7fc640 1 -- 172.21.15.164:0/234373098 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f17e80169f0 con 0x55e7bfb8ed40 2024-09-14T10:55:23.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f16ce7fc640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16c403ce60 0x7f16c403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f16ce7fc640 1 -- 172.21.15.164:0/234373098 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f17e8034030 con 0x55e7bfb8ed40 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f17f8e21640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16c403ce60 0x7f16c403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f17f8e21640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16c403ce60 0x7f16c403f320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17f001e810 tx=0x7f17f003f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfba1dd0 0x55e7bfba4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.932+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba49e0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17f8620640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfba1dd0 0x55e7bfba4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17f8620640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfba1dd0 0x55e7bfba4290 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 realm 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba4e10 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba56e0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.933+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba5a80 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfba67e0 0x55e7bfba8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba9110 con 0x55e7bfba67e0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17f9622640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfba67e0 0x55e7bfba8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17f9622640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfba67e0 0x55e7bfba8bd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f17e805a040 con 0x55e7bfba67e0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 20 searching for the correct realm 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.934+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f17e805a040 con 0x55e7bfba67e0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f9622640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f17e8019040 0x7f17e8053800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f8e21640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f17e8019040 0x7f17e8053800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f8e21640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f17e8019040 0x7f17e8053800 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f8e21640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f17f0044040 0x7f17f0054720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.935+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f17f0044040 0x7f17f0054720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f17f0044040 0x7f17f0054720 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.936+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.937+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e805a040 con 0x55e7bfba67e0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.938+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.939+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e805a040 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.939+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.939+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.939+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.940+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.941+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.942+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba67e0 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17f0044040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x55e7bfba1dd0 2024-09-14T10:55:23.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaaa60 con 0x7f17e8019040 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.943+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba9b50 con 0x55e7bfba1dd0 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaa3f0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba9790 con 0x55e7bfba1dd0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 zone default found 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 4 Realm: () 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:23.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 zonegroup default 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfba9fd0 con 0x7f17f0044040 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.944+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbace00 con 0x55e7bfba67e0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbad2e0 con 0x55e7bfba67e0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 20 started sync module instance, tier type = 2024-09-14T10:55:23.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.945+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbac2a0 con 0x7f17e8019040 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.946+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.946+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94453842492912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbad740 con 0x7f17e8019040 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.946+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbadf90 con 0x55e7bfba1dd0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.947+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94453842492912] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.947+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.947+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94453842500320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbae3b0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.947+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaed70 con 0x55e7bfba67e0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.948+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94453842500320] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.948+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.949+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94453842501856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaed70 con 0x55e7bfba67e0 2024-09-14T10:55:23.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.949+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaf730 con 0x7f17e8019040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.950+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.950+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94453842506368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaffd0 con 0x7f17e8019040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.950+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb0820 con 0x55e7bfba1dd0 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.950+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94453842501856] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.951+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.951+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94453842509776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb08a0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.951+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb1260 con 0x7f17f0044040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.951+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94453842506368] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.951+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94453842509776] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.952+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.952+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94453842510832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb0810 con 0x7f17f0044040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.952+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb1710 con 0x7f17f0044040 2024-09-14T10:55:23.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.953+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.953+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94453842514528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb1b30 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.953+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb2560 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.953+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94453842510832] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94453842514528] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94453842518128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb1680 con 0x7f17f0044040 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=0 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=1 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=2 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=3 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=4 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=5 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.954+0000 7f17fd135800 20 add_watcher() i=6 2024-09-14T10:55:23.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94453842518128] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17fd135800 20 add_watcher() i=7 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17fd135800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb5660 con 0x55e7bfba1dd0 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.955+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94453842513328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb2ae0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.956+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94453842513328] v35'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.956+0000 7f16aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.956+0000 7f17fd135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.956+0000 7f17fd135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.956+0000 7f17fd135800 5 note: GC not initialized 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f16adfe3640 20 reqs_thread_entry: start 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17fd135800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17fd135800 20 Filter name: none 2024-09-14T10:55:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f161f7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17fd135800 20 rados->read ofs=0 len=0 2024-09-14T10:55:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbe81f0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.957+0000 7f17fd135800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:23.969 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.958+0000 7f16aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.958+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94453842513328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfb9ec90 con 0x55e7bfba1dd0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.959+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94453842513328] v35'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.959+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94453842492912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbb0db0 con 0x7f17e8019040 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.960+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94453842492912] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.960+0000 7f17fd135800 20 remove_watcher() i=0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.960+0000 7f17fd135800 2 removed watcher, disabling cache 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.960+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94453842500320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbabdf0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.961+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94453842500320] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.961+0000 7f17fd135800 20 remove_watcher() i=1 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.961+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94453842501856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbabdf0 con 0x55e7bfba67e0 2024-09-14T10:55:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.962+0000 7f17f9622640 1 -- 172.21.15.164:0/234373098 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94453842501856] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e8068040 con 0x55e7bfba67e0 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.962+0000 7f17fd135800 20 remove_watcher() i=2 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.962+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94453842506368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbae0e0 con 0x7f17e8019040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.963+0000 7f17f8e21640 1 -- 172.21.15.164:0/234373098 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94453842506368] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17f0040030 con 0x7f17e8019040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.963+0000 7f17fd135800 20 remove_watcher() i=3 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.963+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94453842509776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbabdf0 con 0x55e7bfba1dd0 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.964+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94453842509776] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x55e7bfba1dd0 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.964+0000 7f17fd135800 20 remove_watcher() i=4 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.965+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94453842510832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbaf280 con 0x7f17f0044040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.965+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94453842510832] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.965+0000 7f17fd135800 20 remove_watcher() i=5 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.965+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94453842514528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbae0e0 con 0x7f17f0044040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.966+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94453842514528] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.966+0000 7f17fd135800 20 remove_watcher() i=6 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.966+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94453842518128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7bfbae0e0 con 0x7f17f0044040 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.967+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94453842518128] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17e0051070 con 0x7f17f0044040 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.967+0000 7f17fd135800 20 remove_watcher() i=7 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f17f0044040 msgr2=0x7f17f0054720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f17f0044040 0x7f17f0054720 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfba1dd0 msgr2=0x55e7bfba4290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfba1dd0 0x55e7bfba4290 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f17e8019040 msgr2=0x7f17e8053800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f17e8019040 0x7f17e8053800 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfba67e0 msgr2=0x55e7bfba8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfba67e0 0x55e7bfba8bd0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16c403ce60 msgr2=0x7f16c403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16c403ce60 0x7f16c403f320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17f001e810 tx=0x7f17f003f000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 msgr2=0x55e7bfb96300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17f8620640 1 -- 172.21.15.164:0/234373098 reap_dead start 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17e8017fd0 tx=0x7f17e80543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 shutdown_connections 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/234373098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb8ed40 0x55e7bfb96300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 >> 172.21.15.164:0/234373098 conn(0x55e7bfb8b140 msgr2=0x55e7bfb89350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 shutdown_connections 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/234373098 wait complete. 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 msgr2=0x7f16d003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 0x7f16d003f2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55e7bfb69370 tx=0x7f17f0054040 comp rx=0 tx=0).stop 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 msgr2=0x55e7bfb82720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55e7bfb691b0 tx=0x7f17e800af20 comp rx=0 tx=0).stop 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 shutdown_connections 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16d003ce10 0x7f16d003f2d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 --2- 172.21.15.164:0/2108366537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bfb82300 0x55e7bfb82720 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 >> 172.21.15.164:0/2108366537 conn(0x55e7bfb766b0 msgr2=0x55e7bfb76a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 shutdown_connections 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.968+0000 7f17fd135800 1 -- 172.21.15.164:0/2108366537 wait complete. 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 msgr2=0x55e7bfb6e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 0x55e7bfb6e910 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 msgr2=0x55e7bfb73130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 0x55e7bfb73130 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 msgr2=0x7f16e003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 0x7f16e003f2d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17e0057000 tx=0x7f17e0052000 comp rx=0 tx=0).stop 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 msgr2=0x55e7bfb672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f17f0001330 tx=0x7f17f0001250 comp rx=0 tx=0).stop 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 shutdown_connections 2024-09-14T10:55:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7bfb70cb0 0x55e7bfb73130 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7bfa71bc0 0x55e7bfb6e910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f16e003ce10 0x7f16e003f2d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 --2- 172.21.15.164:0/3908675141 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7bf9e1830 0x55e7bfb672c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 >> 172.21.15.164:0/3908675141 conn(0x55e7bfa67fb0 msgr2=0x55e7bfb58aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 shutdown_connections 2024-09-14T10:55:23.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:23.969+0000 7f17fd135800 1 -- 172.21.15.164:0/3908675141 wait complete. 2024-09-14T10:55:23.980 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:23.980 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-14T10:55:23.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-14T10:55:23.980 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-14T10:55:24.025 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.025 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f125441d800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55eb945c3c10 0x55eb945c6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f125441d800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb945c66e0 con 0x55eb94532ef0 2024-09-14T10:55:24.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f125441d800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55eb9444a7d0 con 0x55eb945c3c10 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124f3ea640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55eb945c3c10 0x55eb945c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124f3ea640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55eb945c3c10 0x55eb945c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60776/0 (socket says 172.21.15.164:60776) 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124fbeb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55eb94532ef0 0x55eb945c24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38578/0 (socket says 172.21.15.164:38578) 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124f3ea640 1 -- 172.21.15.164:0/70706054 learned_addr learned my addr 172.21.15.164:0/70706054 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124f3ea640 1 -- 172.21.15.164:0/70706054 >> v1:172.21.15.116:6789/0 conn(0x55eb94532ef0 legacy=0x55eb945c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.028+0000 7f124f3ea640 1 -- 172.21.15.164:0/70706054 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb945c7910 con 0x55eb945c3c10 2024-09-14T10:55:24.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.030+0000 7f124f3ea640 1 --2- 172.21.15.164:0/70706054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb945c3c10 0x55eb945c6060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f124400a520 tx=0x7f1244045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697e3213121be6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.030+0000 7f124ebe9640 1 -- 172.21.15.164:0/70706054 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1244055070 con 0x55eb945c3c10 2024-09-14T10:55:24.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.030+0000 7f124ebe9640 1 -- 172.21.15.164:0/70706054 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12440515b0 con 0x55eb945c3c10 2024-09-14T10:55:24.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.030+0000 7f124ebe9640 1 -- 172.21.15.164:0/70706054 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12440518d0 con 0x55eb945c3c10 2024-09-14T10:55:24.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 -- 172.21.15.164:0/70706054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb945c3c10 msgr2=0x55eb945c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 --2- 172.21.15.164:0/70706054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb945c3c10 0x55eb945c6060 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f124400a520 tx=0x7f1244045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 -- 172.21.15.164:0/70706054 shutdown_connections 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 --2- 172.21.15.164:0/70706054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb945c3c10 0x55eb945c6060 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 -- 172.21.15.164:0/70706054 >> 172.21.15.164:0/70706054 conn(0x55eb945b9f80 msgr2=0x55eb945bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 -- 172.21.15.164:0/70706054 shutdown_connections 2024-09-14T10:55:24.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.031+0000 7f125441d800 1 -- 172.21.15.164:0/70706054 wait complete. 2024-09-14T10:55:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.044+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f125441d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f125441d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb94457dd0 con 0x55eb94532ef0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f124fbeb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f124fbeb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60780/0 (socket says 172.21.15.164:60780) 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f124fbeb640 1 -- 172.21.15.164:0/290629502 learned_addr learned my addr 172.21.15.164:0/290629502 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f124fbeb640 1 -- 172.21.15.164:0/290629502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb945c0260 con 0x55eb94532ef0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f124fbeb640 1 --2- 172.21.15.164:0/290629502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f124000b260 tx=0x7f124000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e45488d54291ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.045+0000 7f113de0b640 1 -- 172.21.15.164:0/290629502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124000be60 con 0x55eb94532ef0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f113de0b640 1 -- 172.21.15.164:0/290629502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1240006070 con 0x55eb94532ef0 2024-09-14T10:55:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f113de0b640 1 -- 172.21.15.164:0/290629502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124000e710 con 0x55eb94532ef0 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 -- 172.21.15.164:0/290629502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 msgr2=0x55eb945bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 --2- 172.21.15.164:0/290629502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f124000b260 tx=0x7f124000b660 comp rx=0 tx=0).stop 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 -- 172.21.15.164:0/290629502 shutdown_connections 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 --2- 172.21.15.164:0/290629502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb945bfc70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 -- 172.21.15.164:0/290629502 >> 172.21.15.164:0/290629502 conn(0x55eb945b9f80 msgr2=0x55eb946ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 -- 172.21.15.164:0/290629502 shutdown_connections 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.046+0000 7f125441d800 1 -- 172.21.15.164:0/290629502 wait complete. 2024-09-14T10:55:24.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f125441d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f125441d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb945c6bb0 con 0x55eb94532ef0 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f124fbeb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f124fbeb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60788/0 (socket says 172.21.15.164:60788) 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f124fbeb640 1 -- 172.21.15.164:0/3920188533 learned_addr learned my addr 172.21.15.164:0/3920188533 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f124fbeb640 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb946b9a90 con 0x55eb94532ef0 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.047+0000 7f124fbeb640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55eb945bf7a0 tx=0x7f1240000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.048+0000 7f1137fff640 1 -- 172.21.15.164:0/3920188533 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124000ee10 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.048+0000 7f1137fff640 1 -- 172.21.15.164:0/3920188533 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124000fa30 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.048+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb946b9d20 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.048+0000 7f1137fff640 1 -- 172.21.15.164:0/3920188533 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124000fd30 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.048+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb946ba720 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f1137fff640 1 -- 172.21.15.164:0/3920188533 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1240017070 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f1137fff640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 0x7f113803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f1137fff640 1 -- 172.21.15.164:0/3920188533 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1240015020 con 0x55eb94532ef0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f124f3ea640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 0x7f113803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 0x55eb946c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946c10c0 con 0x55eb945c3c10 2024-09-14T10:55:24.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f12503ec640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 0x55eb946c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f124f3ea640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 0x7f113803f320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1244057000 tx=0x7f1244052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.049+0000 7f12503ec640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 0x55eb946c0b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f12503ec640 1 -- 172.21.15.164:0/3920188533 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f124800a4d0 con 0x55eb945c3c10 2024-09-14T10:55:24.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946c1460 con 0x55eb945c3c10 2024-09-14T10:55:24.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f12503ec640 1 -- 172.21.15.164:0/3920188533 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f124800a4d0 con 0x55eb945c3c10 2024-09-14T10:55:24.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 0x55eb946c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946c5b70 con 0x55eb946c2f60 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f124fbeb640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 0x55eb946c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.050+0000 7f124fbeb640 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 0x55eb946c53e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.051+0000 7f124fbeb640 1 -- 172.21.15.164:0/3920188533 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f124002e070 con 0x55eb946c2f60 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.051+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946c1cb0 con 0x55eb945c3c10 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.051+0000 7f12503ec640 1 -- 172.21.15.164:0/3920188533 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f124800a4d0 con 0x55eb945c3c10 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.051+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946c20a0 con 0x55eb945c3c10 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.051+0000 7f12503ec640 1 -- 172.21.15.164:0/3920188533 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f124800a4d0 con 0x55eb945c3c10 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f125441d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f125441d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb944b64a0 con 0x55eb946d4520 2024-09-14T10:55:24.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60804/0 (socket says 172.21.15.164:60804) 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f12503ec640 1 -- 172.21.15.164:0/2643726539 learned_addr learned my addr 172.21.15.164:0/2643726539 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f12503ec640 1 -- 172.21.15.164:0/2643726539 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb946d4f80 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.052+0000 7f12503ec640 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f124800a2a0 tx=0x7f1248018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.053+0000 7f11357fa640 1 -- 172.21.15.164:0/2643726539 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1248014450 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.053+0000 7f11357fa640 1 -- 172.21.15.164:0/2643726539 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12480145f0 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.053+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb946d57b0 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.053+0000 7f11357fa640 1 -- 172.21.15.164:0/2643726539 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1248014910 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.053+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb946d5d50 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f11357fa640 1 -- 172.21.15.164:0/2643726539 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1248011040 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f11357fa640 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 0x7f112803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f11357fa640 1 -- 172.21.15.164:0/2643726539 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f124801e070 con 0x55eb946d4520 2024-09-14T10:55:24.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 0x7f112803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 0x7f112803f2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55eb946bb620 tx=0x7f124000fed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f125441d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f125441d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb945be6c0 con 0x55eb946e0fc0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.054+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60820/0 (socket says 172.21.15.164:60820) 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f12503ec640 1 -- 172.21.15.164:0/124476184 learned_addr learned my addr 172.21.15.164:0/124476184 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f12503ec640 1 -- 172.21.15.164:0/124476184 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb946e19b0 con 0x55eb946e0fc0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f12503ec640 1 --2- 172.21.15.164:0/124476184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1248016fd0 tx=0x7f1248011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa3d7443c871911 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f112effd640 1 -- 172.21.15.164:0/124476184 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124804b070 con 0x55eb946e0fc0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f112effd640 1 -- 172.21.15.164:0/124476184 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1248051070 con 0x55eb946e0fc0 2024-09-14T10:55:24.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f112effd640 1 -- 172.21.15.164:0/124476184 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12480167c0 con 0x55eb946e0fc0 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 -- 172.21.15.164:0/124476184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 msgr2=0x55eb946e13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 --2- 172.21.15.164:0/124476184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1248016fd0 tx=0x7f1248011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 -- 172.21.15.164:0/124476184 shutdown_connections 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 --2- 172.21.15.164:0/124476184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e13c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 -- 172.21.15.164:0/124476184 >> 172.21.15.164:0/124476184 conn(0x55eb946dd3c0 msgr2=0x55eb946db600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.055+0000 7f125441d800 1 -- 172.21.15.164:0/124476184 shutdown_connections 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f125441d800 1 -- 172.21.15.164:0/124476184 wait complete. 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f125441d800 1 Processor -- start 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f125441d800 1 -- start start 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f125441d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f125441d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb946e1fd0 con 0x55eb946e0fc0 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f12503ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60822/0 (socket says 172.21.15.164:60822) 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 learned_addr learned my addr 172.21.15.164:0/2167783109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.056+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb946e8bb0 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f12503ec640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e8650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12480014d0 tx=0x7f1248054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f112d7fa640 1 -- 172.21.15.164:0/2167783109 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124804b030 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f112d7fa640 1 -- 172.21.15.164:0/2167783109 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12480167c0 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb946e8e40 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f112d7fa640 1 -- 172.21.15.164:0/2167783109 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1248001770 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb946e97c0 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.057+0000 7f112d7fa640 1 -- 172.21.15.164:0/2167783109 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1248001910 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f112d7fa640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f111803ce10 0x7f111803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f112d7fa640 1 -- 172.21.15.164:0/2167783109 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f124804c070 con 0x55eb946e0fc0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f111803ce10 0x7f111803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f111803ce10 0x7f111803f2d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12400014c0 tx=0x7f1240032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb946f4350 0x55eb946f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946f6f60 con 0x55eb946f4350 2024-09-14T10:55:24.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.058+0000 7f124f3ea640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb946f4350 0x55eb946f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f124f3ea640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb946f4350 0x55eb946f6810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 20 realm 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946f7390 con 0x55eb946f4350 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.059+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946f7c60 con 0x55eb946f4350 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946f8000 con 0x55eb946f4350 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946f8d60 0x55eb946fb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fb760 con 0x55eb946f8d60 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f12503ec640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946f8d60 0x55eb946fb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f12503ec640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946f8d60 0x55eb946fb150 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f124803c020 con 0x55eb946f8d60 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 20 searching for the correct realm 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.060+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f8d60 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f124803c020 con 0x55eb946f8d60 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f12503ec640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1248014070 0x7f1248035820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f1248014070 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1248014070 0x7f1248035820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1248014070 0x7f1248035820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f124fbeb640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f124000f070 0x7f12400543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.061+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f124000f070 2024-09-14T10:55:24.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f124000f070 0x7f12400543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f124000f070 0x7f12400543a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f4350 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.062+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f4350 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f124000f070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f124000f070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f1248014070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.063+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124803c020 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f4350 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f124000f070 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x55eb946f4350 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.064+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd070 con 0x7f1248014070 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124803c020 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f124000f070 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.065+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f4350 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f4350 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f124000f070 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.066+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f1248014070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f4350 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x55eb946f4350 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.067+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f124000f070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f124000f070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244057030 con 0x7f124000f070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f1248014070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f8d60 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.068+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f124000f070 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x55eb946f4350 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f1240061060 con 0x7f1248014070 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fc150 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.069+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fc9a0 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd4f0 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 zone default found 2024-09-14T10:55:24.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 4 Realm: () 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 zonegroup default 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fd890 con 0x7f124000f070 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.070+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946ff670 con 0x55eb946f8d60 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb946ffb80 con 0x55eb946f8d60 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 20 started sync module instance, tier type = 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.071+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb946feb10 con 0x7f1248014070 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.072+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.072+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94470296039168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb946fe770 con 0x7f1248014070 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.072+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94700ab0 con 0x55eb946f4350 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.075+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.075+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94470296039168] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.075+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94470296045536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94701290 con 0x55eb946f4350 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.075+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94700020 con 0x55eb946f8d60 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.076+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.076+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94470296049792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94701290 con 0x55eb946f8d60 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.076+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb947028a0 con 0x7f1248014070 2024-09-14T10:55:24.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.076+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94470296045536] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.078+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94470296049792] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.078+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.078+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94470296050848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94700ce0 con 0x7f1248014070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.078+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94703180 con 0x55eb946f4350 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.082+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94470296050848] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.082+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.082+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94470296052592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94703570 con 0x55eb946f4350 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.082+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94703f70 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.083+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94470296052592] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.083+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.083+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94470296054928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94703f30 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.083+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94704980 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.084+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.084+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94470296061136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94704da0 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.084+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94705860 con 0x7f124000f070 2024-09-14T10:55:24.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94470296054928] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94470296061136] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94470296064912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94705860 con 0x7f124000f070 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=0 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=1 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=2 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=3 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=4 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=5 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.085+0000 7f125441d800 20 add_watcher() i=6 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.086+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94470296064912] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.086+0000 7f125441d800 20 add_watcher() i=7 2024-09-14T10:55:24.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.086+0000 7f125441d800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.086+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb94708890 con 0x55eb946f4350 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.087+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.087+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94470296058496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94705d10 con 0x55eb946f4350 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94470296058496] v35'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f1105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 5 note: GC not initialized 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f1104fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 20 Filter name: none 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f107e7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:24.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.088+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb9473b960 con 0x55eb946f4350 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb9473b380 con 0x7f1248014070 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.089+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94741b90 con 0x55eb946f4350 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f125441d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f125441d800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f125441d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94470296311280 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55eb9473e7c0 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94470296052592 notify 150323855362 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55eb945c7910 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f112effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94470296052592 notifier 4339 bl.length()=567 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f112effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f112effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(65 notify.4 [notify cookie 94470296311280 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.090+0000 7f112effd640 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1114003ea0 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.091+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.091+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94470296311280 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f124405be20 con 0x55eb946f4350 2024-09-14T10:55:24.095 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.092+0000 7f1105fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.092+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94470296058496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x55eb946f4350 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.093+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94470296058496] v35'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.093+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94470296039168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x7f1248014070 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.096+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94470296039168] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.096+0000 7f125441d800 20 remove_watcher() i=0 2024-09-14T10:55:24.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.096+0000 7f125441d800 2 removed watcher, disabling cache 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.096+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94470296045536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x55eb946f4350 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.097+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94470296045536] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.097+0000 7f125441d800 20 remove_watcher() i=1 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.097+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94470296049792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x55eb946f8d60 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.098+0000 7f12503ec640 1 -- 172.21.15.164:0/2167783109 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94470296049792] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1248064040 con 0x55eb946f8d60 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.098+0000 7f125441d800 20 remove_watcher() i=2 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.098+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94470296050848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x7f1248014070 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.099+0000 7f124fbeb640 1 -- 172.21.15.164:0/2167783109 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94470296050848] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f124002e070 con 0x7f1248014070 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.099+0000 7f125441d800 20 remove_watcher() i=3 2024-09-14T10:55:24.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.099+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94470296052592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x55eb946f4350 2024-09-14T10:55:24.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.101+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94470296052592] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x55eb946f4350 2024-09-14T10:55:24.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.101+0000 7f125441d800 20 remove_watcher() i=4 2024-09-14T10:55:24.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.101+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94470296054928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x7f124000f070 2024-09-14T10:55:24.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.102+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94470296054928] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.102+0000 7f125441d800 20 remove_watcher() i=5 2024-09-14T10:55:24.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.102+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94470296061136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x7f124000f070 2024-09-14T10:55:24.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.103+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94470296061136] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.103+0000 7f125441d800 20 remove_watcher() i=6 2024-09-14T10:55:24.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.104+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94470296064912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55eb94739730 con 0x7f124000f070 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94470296064912] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1244089040 con 0x7f124000f070 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 20 remove_watcher() i=7 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f124000f070 msgr2=0x7f12400543a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f124000f070 0x7f12400543a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb946f4350 msgr2=0x55eb946f6810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb946f4350 0x55eb946f6810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1248014070 msgr2=0x7f1248035820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1248014070 0x7f1248035820 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946f8d60 msgr2=0x55eb946fb150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946f8d60 0x55eb946fb150 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f111803ce10 msgr2=0x7f111803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f111803ce10 0x7f111803f2d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12400014c0 tx=0x7f1240032000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 msgr2=0x55eb946e8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2167783109 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946e0fc0 0x55eb946e8650 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12480014d0 tx=0x7f1248054560 comp rx=0 tx=0).stop 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 reap_dead start 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f124f3ea640 1 -- 172.21.15.164:0/2167783109 reap_dead start 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 shutdown_connections 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 >> 172.21.15.164:0/2167783109 conn(0x55eb946dd3c0 msgr2=0x55eb946db5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 shutdown_connections 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2167783109 wait complete. 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 msgr2=0x7f112803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 0x7f112803f2d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55eb946bb620 tx=0x7f124000fed0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 msgr2=0x55eb946d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f124800a2a0 tx=0x7f1248018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 shutdown_connections 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f112803ce10 0x7f112803f2d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 --2- 172.21.15.164:0/2643726539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb946d4520 0x55eb946d4940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 >> 172.21.15.164:0/2643726539 conn(0x55eb946c88d0 msgr2=0x55eb946c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 shutdown_connections 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.105+0000 7f125441d800 1 -- 172.21.15.164:0/2643726539 wait complete. 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 msgr2=0x55eb946c0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 0x55eb946c0b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 msgr2=0x55eb946c53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 0x55eb946c53e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 msgr2=0x7f113803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 0x7f113803f320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1244057000 tx=0x7f1244052000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 msgr2=0x55eb946b9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55eb945bf7a0 tx=0x7f1240000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 shutdown_connections 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb946c2f60 0x55eb946c53e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb945c3c10 0x55eb946c0b80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f113803ce60 0x7f113803f320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 --2- 172.21.15.164:0/3920188533 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb94532ef0 0x55eb946b9530 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 >> 172.21.15.164:0/3920188533 conn(0x55eb945b9f80 msgr2=0x55eb946aacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 shutdown_connections 2024-09-14T10:55:24.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.106+0000 7f125441d800 1 -- 172.21.15.164:0/3920188533 wait complete. 2024-09-14T10:55:24.112 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.113 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:24.157 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.157 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.160+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.160+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.160+0000 7fa22600f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5563c872dbf0 0x5563c8730060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa22600f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5563c87306e0 con 0x5563c869cf10 2024-09-14T10:55:24.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa22600f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5563c85b47d0 con 0x5563c872dbf0 2024-09-14T10:55:24.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa2232f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5563c872dbf0 0x5563c8730060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa2232f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5563c872dbf0 0x5563c8730060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60824/0 (socket says 172.21.15.164:60824) 2024-09-14T10:55:24.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa2232f8640 1 -- 172.21.15.164:0/2490761643 learned_addr learned my addr 172.21.15.164:0/2490761643 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa223af9640 1 --1- 172.21.15.164:0/2490761643 >> v1:172.21.15.116:6789/0 conn(0x5563c869cf10 0x5563c872c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38580/0 (socket says 172.21.15.164:38580) 2024-09-14T10:55:24.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa2232f8640 1 -- 172.21.15.164:0/2490761643 >> v1:172.21.15.116:6789/0 conn(0x5563c869cf10 legacy=0x5563c872c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.161+0000 7fa2232f8640 1 -- 172.21.15.164:0/2490761643 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c8731910 con 0x5563c872dbf0 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.163+0000 7fa2232f8640 1 --2- 172.21.15.164:0/2490761643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8730060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa21800a520 tx=0x7fa218045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f2e0529700cf8d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.163+0000 7fa222af7640 1 -- 172.21.15.164:0/2490761643 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa218055070 con 0x5563c872dbf0 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.163+0000 7fa222af7640 1 -- 172.21.15.164:0/2490761643 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2180515b0 con 0x5563c872dbf0 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.163+0000 7fa222af7640 1 -- 172.21.15.164:0/2490761643 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2180518d0 con 0x5563c872dbf0 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 -- 172.21.15.164:0/2490761643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 msgr2=0x5563c8730060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 --2- 172.21.15.164:0/2490761643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8730060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa21800a520 tx=0x7fa218045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 -- 172.21.15.164:0/2490761643 shutdown_connections 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 --2- 172.21.15.164:0/2490761643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8730060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 -- 172.21.15.164:0/2490761643 >> 172.21.15.164:0/2490761643 conn(0x5563c8723f80 msgr2=0x5563c87263e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 -- 172.21.15.164:0/2490761643 shutdown_connections 2024-09-14T10:55:24.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.164+0000 7fa22600f800 1 -- 172.21.15.164:0/2490761643 wait complete. 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.177+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa22600f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa22600f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5563c85c1dd0 con 0x5563c869cf10 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa223af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa223af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60830/0 (socket says 172.21.15.164:60830) 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa223af9640 1 -- 172.21.15.164:0/1133380034 learned_addr learned my addr 172.21.15.164:0/1133380034 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.178+0000 7fa223af9640 1 -- 172.21.15.164:0/1133380034 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c8819dd0 con 0x5563c869cf10 2024-09-14T10:55:24.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa223af9640 1 --2- 172.21.15.164:0/1133380034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b260 tx=0x7fa21400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dadffa6fe2ab87 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa111e0b640 1 -- 172.21.15.164:0/1133380034 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21400be60 con 0x5563c869cf10 2024-09-14T10:55:24.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa111e0b640 1 -- 172.21.15.164:0/1133380034 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214006070 con 0x5563c869cf10 2024-09-14T10:55:24.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa111e0b640 1 -- 172.21.15.164:0/1133380034 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21400e710 con 0x5563c869cf10 2024-09-14T10:55:24.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 -- 172.21.15.164:0/1133380034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 msgr2=0x5563c88197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 --2- 172.21.15.164:0/1133380034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa21400b260 tx=0x7fa21400b660 comp rx=0 tx=0).stop 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 -- 172.21.15.164:0/1133380034 shutdown_connections 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 --2- 172.21.15.164:0/1133380034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c869cf10 0x5563c88197e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 -- 172.21.15.164:0/1133380034 >> 172.21.15.164:0/1133380034 conn(0x5563c8723f80 msgr2=0x5563c8815160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.179+0000 7fa22600f800 1 -- 172.21.15.164:0/1133380034 shutdown_connections 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa22600f800 1 -- 172.21.15.164:0/1133380034 wait complete. 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa22600f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa22600f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5563c8730bb0 con 0x5563c872dbf0 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa223af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa223af9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60836/0 (socket says 172.21.15.164:60836) 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa223af9640 1 -- 172.21.15.164:0/2585429636 learned_addr learned my addr 172.21.15.164:0/2585429636 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.180+0000 7fa223af9640 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c8821ac0 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa223af9640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5563c881a770 tx=0x7fa214000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa10bfff640 1 -- 172.21.15.164:0/2585429636 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa214001560 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa10bfff640 1 -- 172.21.15.164:0/2585429636 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21400ee10 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa10bfff640 1 -- 172.21.15.164:0/2585429636 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21400fb00 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563c8821d50 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.181+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c8822750 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa10bfff640 1 -- 172.21.15.164:0/2585429636 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa214017070 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa10bfff640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 0x7fa10c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa10bfff640 1 -- 172.21.15.164:0/2585429636 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa214015020 con 0x5563c872dbf0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa2232f8640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 0x7fa10c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 0x5563c8828bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8829140 con 0x5563c8823250 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa2242fa640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 0x5563c8828bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.182+0000 7fa2232f8640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 0x7fa10c03f320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa218057000 tx=0x7fa218052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa2242fa640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 0x5563c8828bb0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa2242fa640 1 -- 172.21.15.164:0/2585429636 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa21c00a4d0 con 0x5563c8823250 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8822c00 con 0x5563c8823250 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa2242fa640 1 -- 172.21.15.164:0/2585429636 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x5563c8823250 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 0x5563c882d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c882df50 con 0x5563c882b490 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.183+0000 7fa223af9640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 0x5563c882d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa223af9640 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 0x5563c882d880 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa223af9640 1 -- 172.21.15.164:0/2585429636 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa21402e070 con 0x5563c882b490 2024-09-14T10:55:24.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c882a330 con 0x5563c8823250 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa2242fa640 1 -- 172.21.15.164:0/2585429636 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa21c00a4d0 con 0x5563c8823250 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c882a800 con 0x5563c8823250 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.184+0000 7fa2242fa640 1 -- 172.21.15.164:0/2585429636 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa21c00a4d0 con 0x5563c8823250 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa22600f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa22600f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5563c86204a0 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60840/0 (socket says 172.21.15.164:60840) 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa2242fa640 1 -- 172.21.15.164:0/3984766534 learned_addr learned my addr 172.21.15.164:0/3984766534 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.185+0000 7fa2242fa640 1 -- 172.21.15.164:0/3984766534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c883d390 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa2242fa640 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00a2a0 tx=0x7fa21c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa1097fa640 1 -- 172.21.15.164:0/3984766534 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c014450 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa1097fa640 1 -- 172.21.15.164:0/3984766534 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c0145f0 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563c883dbc0 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa1097fa640 1 -- 172.21.15.164:0/3984766534 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c014910 con 0x5563c883c930 2024-09-14T10:55:24.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.186+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c883e160 con 0x5563c883c930 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa1097fa640 1 -- 172.21.15.164:0/3984766534 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa21c011040 con 0x5563c883c930 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa1097fa640 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 0x7fa0fc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa1097fa640 1 -- 172.21.15.164:0/3984766534 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa21c01e070 con 0x5563c883c930 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa223af9640 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 0x7fa0fc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa223af9640 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 0x7fa0fc03f2d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5563c88295e0 tx=0x7fa2140179c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa22600f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.187+0000 7fa22600f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5563c881a200 con 0x5563c87284c0 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60848/0 (socket says 172.21.15.164:60848) 2024-09-14T10:55:24.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa2242fa640 1 -- 172.21.15.164:0/1695452903 learned_addr learned my addr 172.21.15.164:0/1695452903 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa2242fa640 1 -- 172.21.15.164:0/1695452903 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c8728eb0 con 0x5563c87284c0 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa2242fa640 1 --2- 172.21.15.164:0/1695452903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa21c016fd0 tx=0x7fa21c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156657600e4bb95a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa102ffd640 1 -- 172.21.15.164:0/1695452903 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c04b070 con 0x5563c87284c0 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa102ffd640 1 -- 172.21.15.164:0/1695452903 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c051070 con 0x5563c87284c0 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa102ffd640 1 -- 172.21.15.164:0/1695452903 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c011da0 con 0x5563c87284c0 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa22600f800 1 -- 172.21.15.164:0/1695452903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 msgr2=0x5563c87288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.188+0000 7fa22600f800 1 --2- 172.21.15.164:0/1695452903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa21c016fd0 tx=0x7fa21c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- 172.21.15.164:0/1695452903 shutdown_connections 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 --2- 172.21.15.164:0/1695452903 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c87288c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- 172.21.15.164:0/1695452903 >> 172.21.15.164:0/1695452903 conn(0x5563c88457d0 msgr2=0x5563c8843a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- 172.21.15.164:0/1695452903 shutdown_connections 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- 172.21.15.164:0/1695452903 wait complete. 2024-09-14T10:55:24.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 Processor -- start 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- start start 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c8852ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa22600f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5563c8729520 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c8852ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa2242fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c8852ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60856/0 (socket says 172.21.15.164:60856) 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.189+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 learned_addr learned my addr 172.21.15.164:0/3133919334 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c8853100 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa2242fa640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c8852ba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa21c054530 tx=0x7fa21c054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa1017fa640 1 -- 172.21.15.164:0/3133919334 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c04b030 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563c8853390 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa1017fa640 1 -- 172.21.15.164:0/3133919334 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21c056070 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa1017fa640 1 -- 172.21.15.164:0/3133919334 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa21c011460 con 0x5563c87284c0 2024-09-14T10:55:24.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.190+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c8853d10 con 0x5563c87284c0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa1017fa640 1 -- 172.21.15.164:0/3133919334 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa21c0457a0 con 0x5563c87284c0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa1017fa640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0ec03ce10 0x7fa0ec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa1017fa640 1 -- 172.21.15.164:0/3133919334 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa21c04c070 con 0x5563c87284c0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa223af9640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0ec03ce10 0x7fa0ec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c885e920 0x5563c8860d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c88614e0 con 0x5563c885e920 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa2232f8640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c885e920 0x5563c8860d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.191+0000 7fa223af9640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0ec03ce10 0x7fa0ec03f2d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa21401aec0 tx=0x7fa214032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa2232f8640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c885e920 0x5563c8860d90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 realm 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8861910 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c88621e0 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.192+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8862580 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c88632e0 0x5563c88656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8865c10 con 0x5563c88632e0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa2242fa640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c88632e0 0x5563c88656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa2242fa640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c88632e0 0x5563c88656d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 20 searching for the correct realm 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.193+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa2242fa640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa21c014070 0x7fa21c0419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa223af9640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa21c014070 0x7fa21c0419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa223af9640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa21c014070 0x7fa21c0419c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa223af9640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5563c869cf10 0x7fa21404b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.194+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5563c869cf10 0x7fa21404b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5563c869cf10 0x7fa21404b1b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.195+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.196+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.197+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.198+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.199+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c885e920 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.200+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218057030 con 0x5563c869cf10 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c88632e0 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.201+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c869cf10 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x5563c885e920 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867590 con 0x7fa21c014070 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8866680 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.202+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8866f20 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867a40 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 zone default found 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 4 Realm: () 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 zonegroup default 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8867de0 con 0x5563c869cf10 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.203+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8869c80 con 0x5563c88632e0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c886a020 con 0x5563c88632e0 2024-09-14T10:55:24.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 20 started sync module instance, tier type = 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.204+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88690c0 con 0x7fa21c014070 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.205+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.205+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93887054386400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886a870 con 0x7fa21c014070 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.205+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886b0c0 con 0x5563c885e920 2024-09-14T10:55:24.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.206+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93887054386400] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.206+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.206+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93887054390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886b140 con 0x5563c885e920 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.206+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886bc60 con 0x5563c88632e0 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.207+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.208+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93887054395184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886bc60 con 0x5563c88632e0 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.208+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886cc50 con 0x7fa21c014070 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.208+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93887054390208] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.210+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93887054395184] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.210+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.210+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93887054397520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886ac10 con 0x7fa21c014070 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.210+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886d660 con 0x5563c885e920 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.213+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.213+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93887054402240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886dd10 con 0x5563c885e920 2024-09-14T10:55:24.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.213+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886e800 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.213+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93887054397520] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.214+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.214+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93887054406352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886e7c0 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.214+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886f210 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.214+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93887054402240] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.215+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93887054406352] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.215+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.215+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93887054399264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886ed60 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.215+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886fab0 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93887054399264] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93887054403424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886ed60 con 0x5563c869cf10 2024-09-14T10:55:24.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=0 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=1 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=2 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=3 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=4 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=5 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.216+0000 7fa22600f800 20 add_watcher() i=6 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93887054403424] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa22600f800 20 add_watcher() i=7 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa22600f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c8872ae0 con 0x5563c885e920 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.217+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93887054411264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886ffe0 con 0x5563c885e920 2024-09-14T10:55:24.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93887054411264] v35'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa0d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa22600f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa22600f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa22600f800 5 note: GC not initialized 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa0d8fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa22600f800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.219+0000 7fa22600f800 20 Filter name: none 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.220+0000 7fa0527fc640 20 reqs_thread_entry: start 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.220+0000 7fa22600f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.220+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5563c88a5830 con 0x5563c885e920 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.220+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.220+0000 7fa22600f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:24.228 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.221+0000 7fa0d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.221+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93887054411264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c8871b30 con 0x5563c885e920 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.222+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93887054411264] v35'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.222+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93887054386400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c8871680 con 0x7fa21c014070 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.223+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93887054386400] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.223+0000 7fa22600f800 20 remove_watcher() i=0 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.223+0000 7fa22600f800 2 removed watcher, disabling cache 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.223+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93887054390208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x5563c885e920 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.224+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93887054390208] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.224+0000 7fa22600f800 20 remove_watcher() i=1 2024-09-14T10:55:24.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.224+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93887054395184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x5563c88632e0 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.225+0000 7fa2242fa640 1 -- 172.21.15.164:0/3133919334 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93887054395184] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21c02a070 con 0x5563c88632e0 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.225+0000 7fa22600f800 20 remove_watcher() i=2 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.225+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93887054397520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x7fa21c014070 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.226+0000 7fa223af9640 1 -- 172.21.15.164:0/3133919334 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93887054397520] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa21402e070 con 0x7fa21c014070 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.226+0000 7fa22600f800 20 remove_watcher() i=3 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.226+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93887054402240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x5563c885e920 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.227+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93887054402240] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c885e920 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.227+0000 7fa22600f800 20 remove_watcher() i=4 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.227+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93887054406352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x5563c869cf10 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.228+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93887054406352] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.228+0000 7fa22600f800 20 remove_watcher() i=5 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.228+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93887054399264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c886e2d0 con 0x5563c869cf10 2024-09-14T10:55:24.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.229+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93887054399264] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.229+0000 7fa22600f800 20 remove_watcher() i=6 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.229+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93887054403424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5563c88694e0 con 0x5563c869cf10 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93887054403424] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa218089040 con 0x5563c869cf10 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 20 remove_watcher() i=7 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5563c869cf10 msgr2=0x7fa21404b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5563c869cf10 0x7fa21404b1b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c885e920 msgr2=0x5563c8860d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c885e920 0x5563c8860d90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa21c014070 msgr2=0x7fa21c0419c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa21c014070 0x7fa21c0419c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c88632e0 msgr2=0x5563c88656d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c88632e0 0x5563c88656d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0ec03ce10 msgr2=0x7fa0ec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0ec03ce10 0x7fa0ec03f2d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa21401aec0 tx=0x7fa214032000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 msgr2=0x5563c8852ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 --2- 172.21.15.164:0/3133919334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c87284c0 0x5563c8852ba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa21c054530 tx=0x7fa21c054560 comp rx=0 tx=0).stop 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 reap_dead start 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa2232f8640 1 -- 172.21.15.164:0/3133919334 reap_dead start 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 shutdown_connections 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.230+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 >> 172.21.15.164:0/3133919334 conn(0x5563c88457d0 msgr2=0x5563c88439e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 shutdown_connections 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3133919334 wait complete. 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 msgr2=0x7fa0fc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 0x7fa0fc03f2d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5563c88295e0 tx=0x7fa2140179c0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 msgr2=0x5563c883cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00a2a0 tx=0x7fa21c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 shutdown_connections 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa0fc03ce10 0x7fa0fc03f2d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/3984766534 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c883c930 0x5563c883cd50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 >> 172.21.15.164:0/3984766534 conn(0x5563c8830ce0 msgr2=0x5563c88310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 shutdown_connections 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/3984766534 wait complete. 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 msgr2=0x5563c8828bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 0x5563c8828bb0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 msgr2=0x5563c882d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 0x5563c882d880 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 msgr2=0x7fa10c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 0x7fa10c03f320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa218057000 tx=0x7fa218052000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 msgr2=0x5563c8821560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5563c881a770 tx=0x7fa214000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 shutdown_connections 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5563c882b490 0x5563c882d880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5563c8823250 0x5563c8828bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa10c03ce60 0x7fa10c03f320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 --2- 172.21.15.164:0/2585429636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5563c872dbf0 0x5563c8821560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.231+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 >> 172.21.15.164:0/2585429636 conn(0x5563c8723f80 msgr2=0x5563c881ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.232+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 shutdown_connections 2024-09-14T10:55:24.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.232+0000 7fa22600f800 1 -- 172.21.15.164:0/2585429636 wait complete. 2024-09-14T10:55:24.239 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.239 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-14T10:55:24.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-14T10:55:24.240 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-14T10:55:24.289 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.289 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85e898800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5602013dcfc0 0x5602013df3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85e898800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602013df980 con 0x56020134a730 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85e898800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5602012617d0 con 0x5602013dcfc0 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb853b81640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5602013dcfc0 0x5602013df3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb853b81640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5602013dcfc0 0x5602013df3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60860/0 (socket says 172.21.15.164:60860) 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb853b81640 1 -- 172.21.15.164:0/1753992024 learned_addr learned my addr 172.21.15.164:0/1753992024 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb85c382640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x56020134a730 0x5602013db8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38596/0 (socket says 172.21.15.164:38596) 2024-09-14T10:55:24.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb853b81640 1 -- 172.21.15.164:0/1753992024 >> v1:172.21.15.116:6789/0 conn(0x56020134a730 legacy=0x5602013db8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.292+0000 7fb853b81640 1 -- 172.21.15.164:0/1753992024 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602013e0b60 con 0x5602013dcfc0 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.294+0000 7fb853b81640 1 --2- 172.21.15.164:0/1753992024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602013dcfc0 0x5602013df3b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb84400a520 tx=0x7fb844045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815d47e020c0b6fd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.294+0000 7fb85bb81640 1 -- 172.21.15.164:0/1753992024 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb844055070 con 0x5602013dcfc0 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.294+0000 7fb85bb81640 1 -- 172.21.15.164:0/1753992024 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8440515b0 con 0x5602013dcfc0 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.294+0000 7fb85bb81640 1 -- 172.21.15.164:0/1753992024 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8440518d0 con 0x5602013dcfc0 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 -- 172.21.15.164:0/1753992024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602013dcfc0 msgr2=0x5602013df3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 --2- 172.21.15.164:0/1753992024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602013dcfc0 0x5602013df3b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb84400a520 tx=0x7fb844045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 -- 172.21.15.164:0/1753992024 shutdown_connections 2024-09-14T10:55:24.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 --2- 172.21.15.164:0/1753992024 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602013dcfc0 0x5602013df3b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 -- 172.21.15.164:0/1753992024 >> 172.21.15.164:0/1753992024 conn(0x5602013d0fd0 msgr2=0x5602013d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 -- 172.21.15.164:0/1753992024 shutdown_connections 2024-09-14T10:55:24.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.295+0000 7fb85e898800 1 -- 172.21.15.164:0/1753992024 wait complete. 2024-09-14T10:55:24.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.308+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.308+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85e898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85e898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56020126edd0 con 0x56020134a730 2024-09-14T10:55:24.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85c382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85c382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60866/0 (socket says 172.21.15.164:60866) 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85c382640 1 -- 172.21.15.164:0/1011803042 learned_addr learned my addr 172.21.15.164:0/1011803042 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85c382640 1 -- 172.21.15.164:0/1011803042 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014c9060 con 0x56020134a730 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb85c382640 1 --2- 172.21.15.164:0/1011803042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00b260 tx=0x7fb84c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdcca0d913ab61b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb74a60c640 1 -- 172.21.15.164:0/1011803042 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c00be60 con 0x56020134a730 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb74a60c640 1 -- 172.21.15.164:0/1011803042 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c006070 con 0x56020134a730 2024-09-14T10:55:24.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.309+0000 7fb74a60c640 1 -- 172.21.15.164:0/1011803042 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c00e710 con 0x56020134a730 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 -- 172.21.15.164:0/1011803042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 msgr2=0x5602014c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 --2- 172.21.15.164:0/1011803042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00b260 tx=0x7fb84c00b660 comp rx=0 tx=0).stop 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 -- 172.21.15.164:0/1011803042 shutdown_connections 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 --2- 172.21.15.164:0/1011803042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014c8a70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 -- 172.21.15.164:0/1011803042 >> 172.21.15.164:0/1011803042 conn(0x5602013d0fd0 msgr2=0x5602014c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 -- 172.21.15.164:0/1011803042 shutdown_connections 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 -- 172.21.15.164:0/1011803042 wait complete. 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.310+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85e898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85e898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5602013dfe50 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85c382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85c382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60874/0 (socket says 172.21.15.164:60874) 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85c382640 1 -- 172.21.15.164:0/3705387579 learned_addr learned my addr 172.21.15.164:0/3705387579 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85c382640 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014d0ad0 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.311+0000 7fb85c382640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5602014c9a00 tx=0x7fb84c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.312+0000 7fb748e09640 1 -- 172.21.15.164:0/3705387579 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c00f810 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.312+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602014d0d60 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.312+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602014d1760 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.312+0000 7fb748e09640 1 -- 172.21.15.164:0/3705387579 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c00f9b0 con 0x56020134a730 2024-09-14T10:55:24.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.312+0000 7fb748e09640 1 -- 172.21.15.164:0/3705387579 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c02c060 con 0x56020134a730 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb748e09640 1 -- 172.21.15.164:0/3705387579 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb84c017070 con 0x56020134a730 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb748e09640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 0x7fb74403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb748e09640 1 -- 172.21.15.164:0/3705387579 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb84c015020 con 0x56020134a730 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb853b81640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 0x7fb74403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 0x5602014d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602014d8100 con 0x5602013dcfc0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 0x5602014d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb853b81640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 0x7fb74403f320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb844057000 tx=0x7fb844052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.313+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 0x5602014d7bc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85cb83640 1 -- 172.21.15.164:0/3705387579 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb85400a4d0 con 0x5602013dcfc0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602014d84a0 con 0x5602013dcfc0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85cb83640 1 -- 172.21.15.164:0/3705387579 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb85400a4d0 con 0x5602013dcfc0 2024-09-14T10:55:24.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 0x5602014dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602014dcb60 con 0x5602014d9f60 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85c382640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 0x5602014dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.314+0000 7fb85c382640 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 0x5602014dc3d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.315+0000 7fb85c382640 1 -- 172.21.15.164:0/3705387579 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb84c02e070 con 0x5602014d9f60 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.315+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602014d8cf0 con 0x5602013dcfc0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.315+0000 7fb85cb83640 1 -- 172.21.15.164:0/3705387579 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb85400a4d0 con 0x5602013dcfc0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.315+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602014d90d0 con 0x5602013dcfc0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.315+0000 7fb85cb83640 1 -- 172.21.15.164:0/3705387579 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb85400a4d0 con 0x5602013dcfc0 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85e898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85e898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5602012cd4a0 con 0x5602014eb570 2024-09-14T10:55:24.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60876/0 (socket says 172.21.15.164:60876) 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85cb83640 1 -- 172.21.15.164:0/2048994050 learned_addr learned my addr 172.21.15.164:0/2048994050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85cb83640 1 -- 172.21.15.164:0/2048994050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014ebfd0 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.316+0000 7fb85cb83640 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5602014d1570 tx=0x7fb854018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb741ffb640 1 -- 172.21.15.164:0/2048994050 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb854014450 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb741ffb640 1 -- 172.21.15.164:0/2048994050 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854014610 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb741ffb640 1 -- 172.21.15.164:0/2048994050 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb854014930 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602014ec800 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602014ecda0 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.317+0000 7fb741ffb640 1 -- 172.21.15.164:0/2048994050 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb854011040 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb741ffb640 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 0x7fb73403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb741ffb640 1 -- 172.21.15.164:0/2048994050 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb85401e070 con 0x5602014eb570 2024-09-14T10:55:24.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85c382640 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 0x7fb73403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85c382640 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 0x7fb73403f2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5602014d2610 tx=0x7fb84c00fef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85e898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85e898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5602014c9490 con 0x5602014f8010 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60890/0 (socket says 172.21.15.164:60890) 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.318+0000 7fb85cb83640 1 -- 172.21.15.164:0/2178187261 learned_addr learned my addr 172.21.15.164:0/2178187261 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85cb83640 1 -- 172.21.15.164:0/2178187261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014f8a00 con 0x5602014f8010 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85cb83640 1 --2- 172.21.15.164:0/2178187261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb854016fd0 tx=0x7fb854011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734b9e0105ba3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb7337fe640 1 -- 172.21.15.164:0/2178187261 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85404b070 con 0x5602014f8010 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb7337fe640 1 -- 172.21.15.164:0/2178187261 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854051070 con 0x5602014f8010 2024-09-14T10:55:24.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb7337fe640 1 -- 172.21.15.164:0/2178187261 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb854022df0 con 0x5602014f8010 2024-09-14T10:55:24.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 -- 172.21.15.164:0/2178187261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 msgr2=0x5602014f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 --2- 172.21.15.164:0/2178187261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb854016fd0 tx=0x7fb854011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:24.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 -- 172.21.15.164:0/2178187261 shutdown_connections 2024-09-14T10:55:24.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 --2- 172.21.15.164:0/2178187261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014f8410 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 -- 172.21.15.164:0/2178187261 >> 172.21.15.164:0/2178187261 conn(0x5602014f4410 msgr2=0x5602014f2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 -- 172.21.15.164:0/2178187261 shutdown_connections 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.319+0000 7fb85e898800 1 -- 172.21.15.164:0/2178187261 wait complete. 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85e898800 1 Processor -- start 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85e898800 1 -- start start 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85e898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85e898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5602014f9020 con 0x5602014f8010 2024-09-14T10:55:24.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85cb83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60900/0 (socket says 172.21.15.164:60900) 2024-09-14T10:55:24.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 learned_addr learned my addr 172.21.15.164:0/3372724912 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602014ffb50 con 0x5602014f8010 2024-09-14T10:55:24.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.320+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014ff5f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb854053400 tx=0x7fb854054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb731ffb640 1 -- 172.21.15.164:0/3372724912 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85404b040 con 0x5602014f8010 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb731ffb640 1 -- 172.21.15.164:0/3372724912 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854031030 con 0x5602014f8010 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb731ffb640 1 -- 172.21.15.164:0/3372724912 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8540167c0 con 0x5602014f8010 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602014ffde0 con 0x5602014f8010 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560201500970 con 0x5602014f8010 2024-09-14T10:55:24.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.321+0000 7fb731ffb640 1 -- 172.21.15.164:0/3372724912 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb854011330 con 0x5602014f8010 2024-09-14T10:55:24.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb731ffb640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb72403ce60 0x7fb72403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb731ffb640 1 -- 172.21.15.164:0/3372724912 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb85400e040 con 0x5602014f8010 2024-09-14T10:55:24.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb85c382640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb72403ce60 0x7fb72403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb85c382640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb72403ce60 0x7fb72403f320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb84c01baf0 tx=0x7fb84c04b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56020150b3f0 0x56020150d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56020150e000 con 0x56020150b3f0 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.322+0000 7fb853b81640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56020150b3f0 0x56020150d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb853b81640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56020150b3f0 0x56020150d8b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 realm 2024-09-14T10:55:24.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56020150e430 con 0x56020150b3f0 2024-09-14T10:55:24.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56020150ed00 con 0x56020150b3f0 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.323+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56020150f0a0 con 0x56020150b3f0 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56020150fe00 0x5602015121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201512800 con 0x56020150fe00 2024-09-14T10:55:24.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56020150fe00 0x5602015121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56020150fe00 0x5602015121f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 20 searching for the correct realm 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.324+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85cb83640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb854014070 0x7fb85402d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85c382640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb854014070 0x7fb85402d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85c382640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb854014070 0x7fb85402d450 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85c382640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb84c00f070 0x7fb84c032460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.325+0000 7fb853b81640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb84c00f070 0x7fb84c032460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb84c00f070 0x7fb84c032460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.326+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.327+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.328+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.329+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.330+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x56020150b3f0 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844057030 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.331+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150fe00 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x56020150b3f0 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5602015140f0 con 0x7fb854014070 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.332+0000 7fb85e898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602015131c0 con 0x56020150b3f0 2024-09-14T10:55:24.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201513a10 con 0x56020150b3f0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201514570 con 0x56020150b3f0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 zone default found 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 4 Realm: () 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 zonegroup default 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.333+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201514910 con 0x7fb84c00f070 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602015166f0 con 0x56020150fe00 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201516b90 con 0x56020150fe00 2024-09-14T10:55:24.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 started sync module instance, tier type = 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.334+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201515b90 con 0x7fb854014070 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.335+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.335+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94566612033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5602015157f0 con 0x7fb854014070 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.335+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201517ac0 con 0x56020150b3f0 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.336+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94566612033408] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.336+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.336+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94566612039184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201517ee0 con 0x56020150b3f0 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.336+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5602015188a0 con 0x56020150fe00 2024-09-14T10:55:24.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.337+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94566612039184] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.337+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.337+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94566612043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201517ee0 con 0x56020150fe00 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.337+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201519330 con 0x7fb854014070 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.340+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94566612043248] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.340+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.340+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94566612040240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201517e50 con 0x7fb854014070 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.340+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151a1f0 con 0x56020150b3f0 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.345+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94566612040240] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.345+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.345+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94566612049216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151a160 con 0x56020150b3f0 2024-09-14T10:55:24.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.345+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151b0b0 con 0x7fb84c00f070 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.348+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94566612049216] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.348+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.348+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94566612051344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151b0b0 con 0x7fb84c00f070 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.348+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151ba70 con 0x7fb84c00f070 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.349+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94566612051344] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.349+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.349+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94566612052992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151bc50 con 0x7fb84c00f070 2024-09-14T10:55:24.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.349+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151c4a0 con 0x7fb84c00f070 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94566612057648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151c840 con 0x7fb84c00f070 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=0 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=1 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=2 2024-09-14T10:55:24.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=3 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=4 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94566612052992] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=5 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.350+0000 7fb85e898800 20 add_watcher() i=6 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94566612057648] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb85e898800 20 add_watcher() i=7 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb85e898800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56020151b7a0 con 0x56020150b3f0 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.351+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94566612058832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56020151b7a0 con 0x56020150b3f0 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.352+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94566612058832] v35'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb712fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 5 note: GC not initialized 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb711fdb640 20 reqs_thread_entry: start 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 20 Filter name: none 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb6837fe640 20 reqs_thread_entry: start 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201552b10 con 0x56020150b3f0 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.353+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:24.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201553420 con 0x7fb84c00f070 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:55:24.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.354+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201558e80 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.355+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v35'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.355+0000 7fb85e898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.355+0000 7fb85e898800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.355+0000 7fb85e898800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.355+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94566612305984 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5602015544c0 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94566612049216 notify 150323855363 ret 0) ==== 720+0+0 (crc 0 0 0) 0x5602013e0b60 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb7337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94566612049216 notifier 4353 bl.length()=678 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(65 notify.4 [notify cookie 94566612305984 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb7337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb7337fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb7337fe640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb728003ea0 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== watch-notify(notify_complete (2) cookie 94566612305984 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb84405baf0 con 0x56020150b3f0 2024-09-14T10:55:24.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.356+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201558840 con 0x7fb84c00f070 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85e898800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85e898800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85e898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94566612305984 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560201554010 con 0x56020150fe00 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94566612043248 notify 150323855360 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560201500970 con 0x56020150fe00 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb7337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94566612043248 notifier 4353 bl.length()=177 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb7337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb7337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 notify.2 [notify cookie 94566612305984 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.357+0000 7fb7337fe640 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb728003ea0 con 0x56020150fe00 2024-09-14T10:55:24.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.358+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== watch-notify(notify_complete (2) cookie 94566612305984 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5602014ffde0 con 0x56020150fe00 2024-09-14T10:55:24.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.358+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.381 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:55:24.355478Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.359+0000 7fb712fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.359+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94566612058832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201554250 con 0x56020150b3f0 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.359+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94566612058832] v35'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.360+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94566612033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x7fb854014070 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.360+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94566612033408] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.361+0000 7fb85e898800 20 remove_watcher() i=0 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.361+0000 7fb85e898800 2 removed watcher, disabling cache 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.361+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94566612039184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x56020150b3f0 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.362+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94566612039184] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.362+0000 7fb85e898800 20 remove_watcher() i=1 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.362+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94566612043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x56020150fe00 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.363+0000 7fb85cb83640 1 -- 172.21.15.164:0/3372724912 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94566612043248] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85403e070 con 0x56020150fe00 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.363+0000 7fb85e898800 20 remove_watcher() i=2 2024-09-14T10:55:24.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.363+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94566612040240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x7fb854014070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.365+0000 7fb85c382640 1 -- 172.21.15.164:0/3372724912 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94566612040240] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c054d70 con 0x7fb854014070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.365+0000 7fb85e898800 20 remove_watcher() i=3 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.365+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94566612049216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x56020150b3f0 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.368+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94566612049216] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x56020150b3f0 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.368+0000 7fb85e898800 20 remove_watcher() i=4 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.368+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94566612051344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x7fb84c00f070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.369+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94566612051344] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.369+0000 7fb85e898800 20 remove_watcher() i=5 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.369+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94566612052992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x7fb84c00f070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.370+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94566612052992] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.370+0000 7fb85e898800 20 remove_watcher() i=6 2024-09-14T10:55:24.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.370+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94566612057648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560201550830 con 0x7fb84c00f070 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.371+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94566612057648] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb844089040 con 0x7fb84c00f070 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.371+0000 7fb85e898800 20 remove_watcher() i=7 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb84c00f070 msgr2=0x7fb84c032460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb84c00f070 0x7fb84c032460 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56020150b3f0 msgr2=0x56020150d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56020150b3f0 0x56020150d8b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb854014070 msgr2=0x7fb85402d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb854014070 0x7fb85402d450 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56020150fe00 msgr2=0x5602015121f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56020150fe00 0x5602015121f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb72403ce60 msgr2=0x7fb72403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb72403ce60 0x7fb72403f320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb84c01baf0 tx=0x7fb84c04b000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 msgr2=0x5602014ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/3372724912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014f8010 0x5602014ff5f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb854053400 tx=0x7fb854054510 comp rx=0 tx=0).stop 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb853b81640 1 -- 172.21.15.164:0/3372724912 reap_dead start 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 shutdown_connections 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 >> 172.21.15.164:0/3372724912 conn(0x5602014f4410 msgr2=0x5602014f2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 shutdown_connections 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/3372724912 wait complete. 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 msgr2=0x7fb73403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 0x7fb73403f2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x5602014d2610 tx=0x7fb84c00fef0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 msgr2=0x5602014eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5602014d1570 tx=0x7fb854018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 shutdown_connections 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb73403ce10 0x7fb73403f2d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 --2- 172.21.15.164:0/2048994050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602014eb570 0x5602014eb990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 >> 172.21.15.164:0/2048994050 conn(0x5602014df920 msgr2=0x5602014dfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 shutdown_connections 2024-09-14T10:55:24.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.372+0000 7fb85e898800 1 -- 172.21.15.164:0/2048994050 wait complete. 2024-09-14T10:55:24.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 msgr2=0x5602014d7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 0x5602014d7bc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 msgr2=0x5602014dc3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 0x5602014dc3d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 msgr2=0x7fb74403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 0x7fb74403f320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb844057000 tx=0x7fb844052000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 msgr2=0x5602014d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5602014c9a00 tx=0x7fb84c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 shutdown_connections 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5602014d9f60 0x5602014dc3d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5602013dcfc0 0x5602014d7bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb74403ce60 0x7fb74403f320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 --2- 172.21.15.164:0/3705387579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56020134a730 0x5602014d0570 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 >> 172.21.15.164:0/3705387579 conn(0x5602013d0fd0 msgr2=0x5602014c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 shutdown_connections 2024-09-14T10:55:24.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.373+0000 7fb85e898800 1 -- 172.21.15.164:0/3705387579 wait complete. 2024-09-14T10:55:24.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:55:24.355478Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.393 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.393 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:24.438 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.438 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.441+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.441+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.441+0000 7f764693c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555c1fb96830 0x555c1fc253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.441+0000 7f764693c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c1fc296e0 con 0x555c1fc259e0 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.441+0000 7f764693c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555c1faad7d0 con 0x555c1fb96830 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7642681640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555c1fb96830 0x555c1fc253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7642681640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555c1fb96830 0x555c1fc253e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60904/0 (socket says 172.21.15.164:60904) 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7641e80640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x555c1fc259e0 0x555c1fc27e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38598/0 (socket says 172.21.15.164:38598) 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7642681640 1 -- 172.21.15.164:0/3481020247 learned_addr learned my addr 172.21.15.164:0/3481020247 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7642681640 1 -- 172.21.15.164:0/3481020247 >> v1:172.21.15.116:6789/0 conn(0x555c1fc259e0 legacy=0x555c1fc27e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.442+0000 7f7642681640 1 -- 172.21.15.164:0/3481020247 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fc2a910 con 0x555c1fb96830 2024-09-14T10:55:24.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f7642681640 1 --2- 172.21.15.164:0/3481020247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc253e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f763400a520 tx=0x7f7634045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a778c4bb35a834e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764167f640 1 -- 172.21.15.164:0/3481020247 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634055070 con 0x555c1fb96830 2024-09-14T10:55:24.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764167f640 1 -- 172.21.15.164:0/3481020247 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76340515b0 con 0x555c1fb96830 2024-09-14T10:55:24.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764167f640 1 -- 172.21.15.164:0/3481020247 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76340518d0 con 0x555c1fb96830 2024-09-14T10:55:24.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 -- 172.21.15.164:0/3481020247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 msgr2=0x555c1fc253e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 --2- 172.21.15.164:0/3481020247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc253e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f763400a520 tx=0x7f7634045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 -- 172.21.15.164:0/3481020247 shutdown_connections 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 --2- 172.21.15.164:0/3481020247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc253e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 -- 172.21.15.164:0/3481020247 >> 172.21.15.164:0/3481020247 conn(0x555c1fc1cfb0 msgr2=0x555c1fc1f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 -- 172.21.15.164:0/3481020247 shutdown_connections 2024-09-14T10:55:24.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.444+0000 7f764693c800 1 -- 172.21.15.164:0/3481020247 wait complete. 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.458+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.458+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.458+0000 7f764693c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.458+0000 7f764693c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c1fabadd0 con 0x555c1fb96830 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.458+0000 7f7642681640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7642681640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60920/0 (socket says 172.21.15.164:60920) 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7642681640 1 -- 172.21.15.164:0/3749111155 learned_addr learned my addr 172.21.15.164:0/3749111155 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7642681640 1 -- 172.21.15.164:0/3749111155 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fc23150 con 0x555c1fb96830 2024-09-14T10:55:24.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7642681640 1 --2- 172.21.15.164:0/3749111155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76340460d0 tx=0x7f7634051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efebf1b31706d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7530608640 1 -- 172.21.15.164:0/3749111155 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76340519d0 con 0x555c1fb96830 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7530608640 1 -- 172.21.15.164:0/3749111155 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7634051b70 con 0x555c1fb96830 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.459+0000 7f7530608640 1 -- 172.21.15.164:0/3749111155 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634051e50 con 0x555c1fb96830 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- 172.21.15.164:0/3749111155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 msgr2=0x555c1fc22b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 --2- 172.21.15.164:0/3749111155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f76340460d0 tx=0x7f7634051000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- 172.21.15.164:0/3749111155 shutdown_connections 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 --2- 172.21.15.164:0/3749111155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fc22b60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- 172.21.15.164:0/3749111155 >> 172.21.15.164:0/3749111155 conn(0x555c1fc1cfb0 msgr2=0x555c1fd0e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- 172.21.15.164:0/3749111155 shutdown_connections 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- 172.21.15.164:0/3749111155 wait complete. 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.460+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f764693c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f764693c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c1fc29bb0 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f7642681640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f7642681640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60936/0 (socket says 172.21.15.164:60936) 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f7642681640 1 -- 172.21.15.164:0/3444335144 learned_addr learned my addr 172.21.15.164:0/3444335144 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f7642681640 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fd1c910 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f7642681640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f76340460d0 tx=0x7f7634002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f752ee05640 1 -- 172.21.15.164:0/3444335144 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7634073020 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f752ee05640 1 -- 172.21.15.164:0/3444335144 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763406f580 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f752ee05640 1 -- 172.21.15.164:0/3444335144 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763406f8a0 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c1fd1cba0 con 0x555c1fb96830 2024-09-14T10:55:24.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.461+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1fd1d7b0 con 0x555c1fb96830 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.462+0000 7f752ee05640 1 -- 172.21.15.164:0/3444335144 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7634076020 con 0x555c1fb96830 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.462+0000 7f752ee05640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 0x7f752803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.462+0000 7f752ee05640 1 -- 172.21.15.164:0/3444335144 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f763406b040 con 0x555c1fb96830 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f7641e80640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 0x7f752803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 0x555c1fd23a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd23f40 con 0x555c1fc259e0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f7642e82640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 0x555c1fd23a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f7641e80640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 0x7f752803f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7638001e30 tx=0x7f7638001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f7642e82640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 0x555c1fd23a00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f7642e82640 1 -- 172.21.15.164:0/3444335144 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763c00a4d0 con 0x555c1fc259e0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.463+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd242e0 con 0x555c1fc259e0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f7642e82640 1 -- 172.21.15.164:0/3444335144 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f763c00a4d0 con 0x555c1fc259e0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 0x555c1fd28280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd28a10 con 0x555c1fd25de0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f7642681640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 0x555c1fd28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f7642681640 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 0x555c1fd28280 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f7642681640 1 -- 172.21.15.164:0/3444335144 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7634057030 con 0x555c1fd25de0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.464+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd24b30 con 0x555c1fc259e0 2024-09-14T10:55:24.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f7642e82640 1 -- 172.21.15.164:0/3444335144 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f763c00a4d0 con 0x555c1fc259e0 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd24f90 con 0x555c1fc259e0 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f7642e82640 1 -- 172.21.15.164:0/3444335144 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f763c00a4d0 con 0x555c1fc259e0 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f764693c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.465+0000 7f764693c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c1fb194a0 con 0x555c1fd37480 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60950/0 (socket says 172.21.15.164:60950) 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7642e82640 1 -- 172.21.15.164:0/134977272 learned_addr learned my addr 172.21.15.164:0/134977272 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7642e82640 1 -- 172.21.15.164:0/134977272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fd37ee0 con 0x555c1fd37480 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7642e82640 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x555c1fd1d3b0 tx=0x7f763c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7527fff640 1 -- 172.21.15.164:0/134977272 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c014450 con 0x555c1fd37480 2024-09-14T10:55:24.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7527fff640 1 -- 172.21.15.164:0/134977272 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c014610 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c1fd38710 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f7527fff640 1 -- 172.21.15.164:0/134977272 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c014930 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.466+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1fd38cb0 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.467+0000 7f7527fff640 1 -- 172.21.15.164:0/134977272 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f763c011040 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.467+0000 7f7527fff640 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 0x7f751c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.467+0000 7f7527fff640 1 -- 172.21.15.164:0/134977272 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f763c01e070 con 0x555c1fd37480 2024-09-14T10:55:24.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.467+0000 7f7642681640 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 0x7f751c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642681640 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 0x7f751c03f2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x555c1fd1e4b0 tx=0x7f7634067040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f764693c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f764693c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c1fc214f0 con 0x555c1fd43f20 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60960/0 (socket says 172.21.15.164:60960) 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642e82640 1 -- 172.21.15.164:0/1165038689 learned_addr learned my addr 172.21.15.164:0/1165038689 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642e82640 1 -- 172.21.15.164:0/1165038689 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fd44910 con 0x555c1fd43f20 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.468+0000 7f7642e82640 1 --2- 172.21.15.164:0/1165038689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f763c022ea0 tx=0x7f763c045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a17793c8dd35d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f7525ffb640 1 -- 172.21.15.164:0/1165038689 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c04b070 con 0x555c1fd43f20 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f7525ffb640 1 -- 172.21.15.164:0/1165038689 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c051070 con 0x555c1fd43f20 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f7525ffb640 1 -- 172.21.15.164:0/1165038689 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c0168f0 con 0x555c1fd43f20 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- 172.21.15.164:0/1165038689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 msgr2=0x555c1fd44320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 --2- 172.21.15.164:0/1165038689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f763c022ea0 tx=0x7f763c045490 comp rx=0 tx=0).stop 2024-09-14T10:55:24.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- 172.21.15.164:0/1165038689 shutdown_connections 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 --2- 172.21.15.164:0/1165038689 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd44320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- 172.21.15.164:0/1165038689 >> 172.21.15.164:0/1165038689 conn(0x555c1fd40320 msgr2=0x555c1fd3e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- 172.21.15.164:0/1165038689 shutdown_connections 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- 172.21.15.164:0/1165038689 wait complete. 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 Processor -- start 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.469+0000 7f764693c800 1 -- start start 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f764693c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f764693c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c1fd44f30 con 0x555c1fd43f20 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7642e82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60968/0 (socket says 172.21.15.164:60968) 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 learned_addr learned my addr 172.21.15.164:0/3135999308 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fd4bac0 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7642e82640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f763c022ea0 tx=0x7f763c054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7513fff640 1 -- 172.21.15.164:0/3135999308 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c04b030 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7513fff640 1 -- 172.21.15.164:0/3135999308 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c031070 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c1fd4bd50 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f7513fff640 1 -- 172.21.15.164:0/3135999308 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c054e40 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.470+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1fd4c6d0 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.471+0000 7f7513fff640 1 -- 172.21.15.164:0/3135999308 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f763c045760 con 0x555c1fd43f20 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.471+0000 7f7513fff640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f750c03ce10 0x7f750c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.471+0000 7f7513fff640 1 -- 172.21.15.164:0/3135999308 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f763c04c070 con 0x555c1fd43f20 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.471+0000 7f7642681640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f750c03ce10 0x7f750c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f7642681640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f750c03ce10 0x7f750c03f2d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7634005570 tx=0x7f763406ff90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fd57270 0x555c1fd59730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd59e80 con 0x555c1fd57270 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f7641e80640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fd57270 0x555c1fd59730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f7641e80640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fd57270 0x555c1fd59730 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763800f610 con 0x555c1fd57270 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 20 realm 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.472+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd565c0 con 0x555c1fd57270 2024-09-14T10:55:24.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763800f610 con 0x555c1fd57270 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5a960 con 0x555c1fd57270 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763800f610 con 0x555c1fd57270 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5b230 con 0x555c1fd57270 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f763800f610 con 0x555c1fd57270 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd5bb70 0x555c1fd5df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5e6a0 con 0x555c1fd5bb70 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.473+0000 7f7642e82640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd5bb70 0x555c1fd5df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642e82640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd5bb70 0x555c1fd5df60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f763c02a070 con 0x555c1fd5bb70 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f764693c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f764693c800 20 searching for the correct realm 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f763c02a070 con 0x555c1fd5bb70 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642e82640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f763c014070 0x7f763c03f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.474+0000 7f7642681640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f763c014070 0x7f763c03f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7642681640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f763c014070 0x7f763c03f3f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7642681640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f763408f070 0x7f7634077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7641e80640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f763408f070 0x7f7634077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7641e80640 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f763408f070 0x7f7634077590 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.475+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763800f610 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763800f610 con 0x555c1fd57270 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x7f763408f070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.476+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c02a070 con 0x555c1fd5bb70 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x7f763408f070 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.477+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c02a070 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.478+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x7f763408f070 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.479+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x7f763408f070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.480+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763802b040 con 0x555c1fd57270 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.481+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd5bb70 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763408f070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.482+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x555c1fd57270 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd60030 con 0x7f763c014070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5f120 con 0x555c1fd57270 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5f9c0 con 0x555c1fd57270 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd5ed60 con 0x555c1fd57270 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 zone default found 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 4 Realm: () 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.483+0000 7f764693c800 20 zonegroup default 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd604e0 con 0x7f763408f070 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd62000 con 0x555c1fd5bb70 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd624e0 con 0x555c1fd5bb70 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 started sync module instance, tier type = 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.484+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd61370 con 0x7f763c014070 2024-09-14T10:55:24.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.485+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.485+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854159474368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd62940 con 0x7f763c014070 2024-09-14T10:55:24.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.485+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd63190 con 0x555c1fd57270 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.486+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.486+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854159474368] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.486+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854159482352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd638c0 con 0x555c1fd57270 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.487+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd61790 con 0x555c1fd5bb70 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.487+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854159482352] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.488+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.488+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854159483664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd61790 con 0x555c1fd5bb70 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.488+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd64910 con 0x7f763c014070 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.489+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854159483664] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.490+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.490+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854159487968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd64d00 con 0x7f763c014070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.490+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd65750 con 0x555c1fd57270 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.493+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.493+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854159491648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd66020 con 0x555c1fd57270 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.493+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd66af0 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.496+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854159487968] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.496+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.496+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854159496672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd66ab0 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.496+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd67500 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.498+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854159491648] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.498+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.498+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854159496672] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.498+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854159494000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd67500 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.498+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd63c90 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854159494000] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854159499344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd67470 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=0 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=1 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=2 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=3 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=4 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=5 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.501+0000 7f764693c800 20 add_watcher() i=6 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854159499344] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f764693c800 20 add_watcher() i=7 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f764693c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd6aef0 con 0x555c1fd57270 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.502+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854159501840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd682e0 con 0x555c1fd57270 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.503+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854159501840] v35'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.503+0000 7f74f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 5 note: GC not initialized 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f74737fe640 20 reqs_thread_entry: start 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 20 Filter name: none 2024-09-14T10:55:24.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f74717fa640 20 reqs_thread_entry: start 2024-09-14T10:55:24.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.504+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9db60 con 0x555c1fd57270 2024-09-14T10:55:24.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.505+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.505+0000 7f764693c800 20 rados_obj.operate() r=0 bl.length=502 2024-09-14T10:55:24.506 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:55:24.355478Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.505+0000 7f74f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.505+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854159501840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9c670 con 0x555c1fd57270 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.507+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93854159501840] v35'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.507+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854159474368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x7f763c014070 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.508+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93854159474368] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.508+0000 7f764693c800 20 remove_watcher() i=0 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.508+0000 7f764693c800 2 removed watcher, disabling cache 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.508+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854159482352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x555c1fd57270 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.509+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93854159482352] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.509+0000 7f764693c800 20 remove_watcher() i=1 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.509+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854159483664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x555c1fd5bb70 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.510+0000 7f7642e82640 1 -- 172.21.15.164:0/3135999308 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93854159483664] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c065040 con 0x555c1fd5bb70 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.510+0000 7f764693c800 20 remove_watcher() i=2 2024-09-14T10:55:24.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.510+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854159487968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x7f763c014070 2024-09-14T10:55:24.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.511+0000 7f7642681640 1 -- 172.21.15.164:0/3135999308 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93854159487968] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634057030 con 0x7f763c014070 2024-09-14T10:55:24.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.511+0000 7f764693c800 20 remove_watcher() i=3 2024-09-14T10:55:24.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.511+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854159491648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x555c1fd57270 2024-09-14T10:55:24.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.513+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93854159491648] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x555c1fd57270 2024-09-14T10:55:24.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.513+0000 7f764693c800 20 remove_watcher() i=4 2024-09-14T10:55:24.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.513+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854159496672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x7f763408f070 2024-09-14T10:55:24.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.514+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93854159496672] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.514+0000 7f764693c800 20 remove_watcher() i=5 2024-09-14T10:55:24.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.514+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854159494000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x7f763408f070 2024-09-14T10:55:24.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.515+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93854159494000] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.515+0000 7f764693c800 20 remove_watcher() i=6 2024-09-14T10:55:24.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.515+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854159499344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c1fd9b9f0 con 0x7f763408f070 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93854159499344] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763803b040 con 0x7f763408f070 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 20 remove_watcher() i=7 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f763408f070 msgr2=0x7f7634077590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f763408f070 0x7f7634077590 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fd57270 msgr2=0x555c1fd59730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fd57270 0x555c1fd59730 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f763c014070 msgr2=0x7f763c03f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f763c014070 0x7f763c03f3f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd5bb70 msgr2=0x555c1fd5df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd5bb70 0x555c1fd5df60 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f750c03ce10 msgr2=0x7f750c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f750c03ce10 0x7f750c03f2d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7634005570 tx=0x7f763406ff90 comp rx=0 tx=0).stop 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 msgr2=0x555c1fd4b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f763c022ea0 tx=0x7f763c054520 comp rx=0 tx=0).stop 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.516+0000 7f7641e80640 1 -- 172.21.15.164:0/3135999308 reap_dead start 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 shutdown_connections 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/3135999308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd43f20 0x555c1fd4b560 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 >> 172.21.15.164:0/3135999308 conn(0x555c1fd40320 msgr2=0x555c1fd3e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 shutdown_connections 2024-09-14T10:55:24.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3135999308 wait complete. 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 msgr2=0x7f751c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 0x7f751c03f2d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x555c1fd1e4b0 tx=0x7f7634067040 comp rx=0 tx=0).stop 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 msgr2=0x555c1fd378a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x555c1fd1d3b0 tx=0x7f763c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 shutdown_connections 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f751c03ce10 0x7f751c03f2d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/134977272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fd37480 0x555c1fd378a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 >> 172.21.15.164:0/134977272 conn(0x555c1fd2b830 msgr2=0x555c1fd2bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 shutdown_connections 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/134977272 wait complete. 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 msgr2=0x555c1fd23a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 0x555c1fd23a00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 msgr2=0x555c1fd28280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 0x555c1fd28280 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 msgr2=0x7f752803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 0x7f752803f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7638001e30 tx=0x7f7638001390 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 msgr2=0x555c1fd1c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.517+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f76340460d0 tx=0x7f7634002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 shutdown_connections 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c1fd25de0 0x555c1fd28280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c1fc259e0 0x555c1fd23a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f752803ce60 0x7f752803f320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 --2- 172.21.15.164:0/3444335144 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c1fb96830 0x555c1fd1c3b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 >> 172.21.15.164:0/3444335144 conn(0x555c1fc1cfb0 msgr2=0x555c1fd0dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 shutdown_connections 2024-09-14T10:55:24.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.518+0000 7f764693c800 1 -- 172.21.15.164:0/3444335144 wait complete. 2024-09-14T10:55:24.524 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:55:24.355478Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-14T10:55:24.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-14T10:55:24.524 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-14T10:55:24.571 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.571 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde33946800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5630faa40fb0 0x5630faad0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde33946800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630faad4730 con 0x5630faad09e0 2024-09-14T10:55:24.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde33946800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5630fa9587d0 con 0x5630faa40fb0 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde31437640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5630faa40fb0 0x5630faad0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde31437640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5630faa40fb0 0x5630faad0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60974/0 (socket says 172.21.15.164:60974) 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde31437640 1 -- 172.21.15.164:0/1613740754 learned_addr learned my addr 172.21.15.164:0/1613740754 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.574+0000 7fde28c36640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5630faad09e0 0x5630faad2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38600/0 (socket says 172.21.15.164:38600) 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.575+0000 7fde31437640 1 -- 172.21.15.164:0/1613740754 >> v1:172.21.15.116:6789/0 conn(0x5630faad09e0 legacy=0x5630faad2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.575+0000 7fde31437640 1 -- 172.21.15.164:0/1613740754 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630faad5960 con 0x5630faa40fb0 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.576+0000 7fde31437640 1 --2- 172.21.15.164:0/1613740754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630faad0470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a520 tx=0x7fde24045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f729bb47cd0ae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde30c36640 1 -- 172.21.15.164:0/1613740754 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24055070 con 0x5630faa40fb0 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde30c36640 1 -- 172.21.15.164:0/1613740754 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde240515b0 con 0x5630faa40fb0 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde30c36640 1 -- 172.21.15.164:0/1613740754 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde240518d0 con 0x5630faa40fb0 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 -- 172.21.15.164:0/1613740754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 msgr2=0x5630faad0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 --2- 172.21.15.164:0/1613740754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630faad0470 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a520 tx=0x7fde24045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 -- 172.21.15.164:0/1613740754 shutdown_connections 2024-09-14T10:55:24.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 --2- 172.21.15.164:0/1613740754 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630faad0470 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 -- 172.21.15.164:0/1613740754 >> 172.21.15.164:0/1613740754 conn(0x5630faac7fa0 msgr2=0x5630faaca400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 -- 172.21.15.164:0/1613740754 shutdown_connections 2024-09-14T10:55:24.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.577+0000 7fde33946800 1 -- 172.21.15.164:0/1613740754 wait complete. 2024-09-14T10:55:24.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.591+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.591+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.591+0000 7fde33946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.591+0000 7fde33946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5630fa965dd0 con 0x5630faa40fb0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.591+0000 7fde31437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fde31437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60984/0 (socket says 172.21.15.164:60984) 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fde31437640 1 -- 172.21.15.164:0/67315076 learned_addr learned my addr 172.21.15.164:0/67315076 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fde31437640 1 -- 172.21.15.164:0/67315076 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fabbde70 con 0x5630faa40fb0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fde31437640 1 --2- 172.21.15.164:0/67315076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fde240460d0 tx=0x7fde24051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c5c3cecc5e3c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fdd1f606640 1 -- 172.21.15.164:0/67315076 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde240519d0 con 0x5630faa40fb0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fdd1f606640 1 -- 172.21.15.164:0/67315076 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24051b70 con 0x5630faa40fb0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.592+0000 7fdd1f606640 1 -- 172.21.15.164:0/67315076 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24051e50 con 0x5630faa40fb0 2024-09-14T10:55:24.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- 172.21.15.164:0/67315076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 msgr2=0x5630fabbd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 --2- 172.21.15.164:0/67315076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fde240460d0 tx=0x7fde24051000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- 172.21.15.164:0/67315076 shutdown_connections 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 --2- 172.21.15.164:0/67315076 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabbd880 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- 172.21.15.164:0/67315076 >> 172.21.15.164:0/67315076 conn(0x5630faac7fa0 msgr2=0x5630fabb9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- 172.21.15.164:0/67315076 shutdown_connections 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- 172.21.15.164:0/67315076 wait complete. 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde33946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5630faad4c00 con 0x5630faa40fb0 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.593+0000 7fde31437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde31437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60996/0 (socket says 172.21.15.164:60996) 2024-09-14T10:55:24.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde31437640 1 -- 172.21.15.164:0/334859742 learned_addr learned my addr 172.21.15.164:0/334859742 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde31437640 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fabc57d0 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde31437640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fde240460d0 tx=0x7fde24002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fdd1de03640 1 -- 172.21.15.164:0/334859742 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde24073020 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fdd1de03640 1 -- 172.21.15.164:0/334859742 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2406f580 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630fabc5a60 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fdd1de03640 1 -- 172.21.15.164:0/334859742 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2406f8a0 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.594+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fabc6670 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fdd1de03640 1 -- 172.21.15.164:0/334859742 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fde24076020 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fdd1de03640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 0x7fdd1803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fdd1de03640 1 -- 172.21.15.164:0/334859742 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fde2406b040 con 0x5630faa40fb0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fde28c36640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 0x7fdd1803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 0x5630fabcc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabcce00 con 0x5630faad09e0 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.595+0000 7fde31c38640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 0x5630fabcc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde28c36640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 0x7fdd1803f2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001e30 tx=0x7fde1c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde31c38640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 0x5630fabcc8c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde31c38640 1 -- 172.21.15.164:0/334859742 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c00a4d0 con 0x5630faad09e0 2024-09-14T10:55:24.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabcd1a0 con 0x5630faad09e0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde31c38640 1 -- 172.21.15.164:0/334859742 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde2c00a4d0 con 0x5630faad09e0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 0x5630fabd1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabd18d0 con 0x5630fabceca0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.596+0000 7fde31437640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 0x5630fabd1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.597+0000 7fde31437640 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 0x5630fabd1140 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.597+0000 7fde31437640 1 -- 172.21.15.164:0/334859742 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde24057030 con 0x5630fabceca0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.597+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabcd9f0 con 0x5630faad09e0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.597+0000 7fde31c38640 1 -- 172.21.15.164:0/334859742 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde2c00a4d0 con 0x5630faad09e0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.597+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabcdde0 con 0x5630faad09e0 2024-09-14T10:55:24.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde31c38640 1 -- 172.21.15.164:0/334859742 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde2c00a4d0 con 0x5630faad09e0 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde33946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde33946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5630fa9c44a0 con 0x5630fabe0260 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:60998/0 (socket says 172.21.15.164:60998) 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.598+0000 7fde31c38640 1 -- 172.21.15.164:0/4158647348 learned_addr learned my addr 172.21.15.164:0/4158647348 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fde31c38640 1 -- 172.21.15.164:0/4158647348 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fabe0cc0 con 0x5630fabe0260 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fde31c38640 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00a2a0 tx=0x7fde2c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fdd16ffd640 1 -- 172.21.15.164:0/4158647348 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c014450 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fdd16ffd640 1 -- 172.21.15.164:0/4158647348 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c0145f0 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630fabe14f0 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fdd16ffd640 1 -- 172.21.15.164:0/4158647348 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c014910 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.599+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fabe1a90 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fdd16ffd640 1 -- 172.21.15.164:0/4158647348 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fde2c011040 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fdd16ffd640 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 0x7fdd0803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fdd16ffd640 1 -- 172.21.15.164:0/4158647348 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fde2c01e070 con 0x5630fabe0260 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fde31437640 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 0x7fdd0803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.600+0000 7fde31437640 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 0x7fdd0803f2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5630fabc7380 tx=0x7fde240966f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde33946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde33946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5630fabbe1e0 con 0x5630fabecd20 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32776/0 (socket says 172.21.15.164:32776) 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde31c38640 1 -- 172.21.15.164:0/947315420 learned_addr learned my addr 172.21.15.164:0/947315420 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde31c38640 1 -- 172.21.15.164:0/947315420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fabed710 con 0x5630fabecd20 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fde31c38640 1 --2- 172.21.15.164:0/947315420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fde2c016fd0 tx=0x7fde2c022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39227ea92af3e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fdd14ff9640 1 -- 172.21.15.164:0/947315420 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c04b070 con 0x5630fabecd20 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fdd14ff9640 1 -- 172.21.15.164:0/947315420 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c051070 con 0x5630fabecd20 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.601+0000 7fdd14ff9640 1 -- 172.21.15.164:0/947315420 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c011da0 con 0x5630fabecd20 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- 172.21.15.164:0/947315420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 msgr2=0x5630fabed120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 --2- 172.21.15.164:0/947315420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fde2c016fd0 tx=0x7fde2c022f30 comp rx=0 tx=0).stop 2024-09-14T10:55:24.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- 172.21.15.164:0/947315420 shutdown_connections 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 --2- 172.21.15.164:0/947315420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabed120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- 172.21.15.164:0/947315420 >> 172.21.15.164:0/947315420 conn(0x5630fabe9120 msgr2=0x5630fabe7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- 172.21.15.164:0/947315420 shutdown_connections 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- 172.21.15.164:0/947315420 wait complete. 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 Processor -- start 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- start start 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabf4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde33946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5630fabedd30 con 0x5630fabecd20 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabf4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde31c38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabf4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32780/0 (socket says 172.21.15.164:32780) 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.602+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 learned_addr learned my addr 172.21.15.164:0/1274252378 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630fabf4860 con 0x5630fabecd20 2024-09-14T10:55:24.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fde31c38640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabf4300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde2c022f70 tx=0x7fde2c054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fdd06ffd640 1 -- 172.21.15.164:0/1274252378 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c04b030 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fdd06ffd640 1 -- 172.21.15.164:0/1274252378 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2c056070 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fdd06ffd640 1 -- 172.21.15.164:0/1274252378 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde2c016440 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630fabf4af0 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.603+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630fabf5470 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.604+0000 7fdd06ffd640 1 -- 172.21.15.164:0/1274252378 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fde2c0457c0 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.604+0000 7fdd06ffd640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdcfc03ce10 0x7fdcfc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.604+0000 7fdd06ffd640 1 -- 172.21.15.164:0/1274252378 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fde2c04c070 con 0x5630fabecd20 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.604+0000 7fde31437640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdcfc03ce10 0x7fdcfc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde31437640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdcfc03ce10 0x7fdcfc03f2d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde24065fd0 tx=0x7fde24085070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630fac00020 0x5630fac024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac02c30 con 0x5630fac00020 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde28c36640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630fac00020 0x5630fac024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.605+0000 7fde28c36640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630fac00020 0x5630fac024e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde1c00f610 con 0x5630fac00020 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 realm 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fabff370 con 0x5630fac00020 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde1c00f610 con 0x5630fac00020 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac03720 con 0x5630fac00020 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde1c00f610 con 0x5630fac00020 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac03ff0 con 0x5630fac00020 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde1c00f610 con 0x5630fac00020 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fac04a10 0x5630fac06e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac07540 con 0x5630fac04a10 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.606+0000 7fde31c38640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fac04a10 0x5630fac06e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31c38640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fac04a10 0x5630fac06e00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde2c02a070 con 0x5630fac04a10 2024-09-14T10:55:24.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde33946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde33946800 20 searching for the correct realm 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde2c02a070 con 0x5630fac04a10 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31c38640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fde2c04dc20 0x7fde2c045170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.607+0000 7fde31437640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fde2c04dc20 0x7fde2c045170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde31437640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fde2c04dc20 0x7fde2c045170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde31437640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fde24078020 0x7fde2408f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde28c36640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fde24078020 0x7fde2408f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.608+0000 7fde28c36640 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fde24078020 0x7fde2408f5c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c00f610 con 0x7fde24078020 2024-09-14T10:55:24.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c00f610 con 0x5630fac00020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x7fde24078020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.609+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x7fde24078020 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c02a070 con 0x5630fac04a10 2024-09-14T10:55:24.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.610+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x7fde24078020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c02a070 con 0x5630fac04a10 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.611+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x7fde24078020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.612+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x7fde24078020 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.613+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c02b040 con 0x5630fac00020 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.614+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac04a10 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde24078020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x5630fac00020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08e30 con 0x7fde2c04dc20 2024-09-14T10:55:24.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.615+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac07f30 con 0x5630fac00020 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac08780 con 0x5630fac00020 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac092b0 con 0x5630fac00020 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 zone default found 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 4 Realm: () 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 zonegroup default 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.616+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac092b0 con 0x7fde24078020 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0b090 con 0x5630fac04a10 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0b560 con 0x5630fac04a10 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 started sync module instance, tier type = 2024-09-14T10:55:24.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.617+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0a530 con 0x7fde2c04dc20 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.618+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.618+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768365349152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0a190 con 0x7fde2c04dc20 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.618+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0c490 con 0x5630fac00020 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.619+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768365349152] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.619+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.619+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768365354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0c8b0 con 0x5630fac00020 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.619+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0d270 con 0x5630fac04a10 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.620+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768365354976] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.620+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.620+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768365356512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0d270 con 0x5630fac04a10 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.620+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0dc70 con 0x7fde2c04dc20 2024-09-14T10:55:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.623+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768365356512] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.623+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.623+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768365358528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0d1e0 con 0x7fde2c04dc20 2024-09-14T10:55:24.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.623+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0eb30 con 0x5630fac00020 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.626+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.626+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768365365376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0f3d0 con 0x5630fac00020 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.626+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0fec0 con 0x7fde24078020 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.627+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768365358528] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.629+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768365365376] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.630+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.630+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768365369744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0eed0 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.630+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac10760 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.632+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768365369744] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.632+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.632+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768365363296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0eed0 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.632+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac10d80 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768365363296] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768365372000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac10d80 con 0x7fde24078020 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=0 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=1 2024-09-14T10:55:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=2 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=3 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=4 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=5 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.633+0000 7fde33946800 20 add_watcher() i=6 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.634+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768365372000] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.634+0000 7fde33946800 20 add_watcher() i=7 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.634+0000 7fde33946800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.634+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac14080 con 0x5630fac00020 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.634+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.635+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768365374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac11310 con 0x5630fac00020 2024-09-14T10:55:24.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.635+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768365374016] v35'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fdce77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 5 note: GC not initialized 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fdce67e4640 20 reqs_thread_entry: start 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 20 Filter name: none 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fdc57fff640 20 reqs_thread_entry: start 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.636+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac47430 con 0x5630fac00020 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde33946800 20 rados_obj.operate() r=0 bl.length=502 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde33946800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde33946800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde33946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.637+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac4da10 con 0x5630fac00020 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde33946800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde33946800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde33946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94768365622224 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac49050 con 0x5630fac00020 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94768365365376 notify 150323855364 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fde1c018040 con 0x5630fac00020 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fdd14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94768365365376 notifier 4367 bl.length()=567 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fdd14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fdd14ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94768365622224 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fdd14ff9640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fdcf4003ea0 con 0x5630fac00020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94768365622224 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fde1c009050 con 0x5630fac00020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.638+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac4d3d0 con 0x7fde24078020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde33946800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94768365622224 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5630fac48ba0 con 0x5630fac04a10 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94768365356512 notify 150323855361 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5630fabf5470 con 0x5630fac04a10 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fdd07fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 94768365356512 notifier 4367 bl.length()=170 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 notify.2 [notify cookie 94768365622224 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fdd07fff640 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fdc640032c0 con 0x5630fac04a10 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== watch-notify(notify_complete (2) cookie 94768365622224 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5630fabf4af0 con 0x5630fac04a10 2024-09-14T10:55:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.640+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.651 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.641+0000 7fdce77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.641+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768365374016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac45210 con 0x5630fac00020 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.642+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94768365374016] v35'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.642+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768365349152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac45210 con 0x7fde2c04dc20 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.643+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94768365349152] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.643+0000 7fde33946800 20 remove_watcher() i=0 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.643+0000 7fde33946800 2 removed watcher, disabling cache 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.643+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768365354976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0a920 con 0x5630fac00020 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.644+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94768365354976] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.644+0000 7fde33946800 20 remove_watcher() i=1 2024-09-14T10:55:24.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.644+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768365356512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0bfe0 con 0x5630fac04a10 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.645+0000 7fde31c38640 1 -- 172.21.15.164:0/1274252378 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94768365356512] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c064040 con 0x5630fac04a10 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.645+0000 7fde33946800 20 remove_watcher() i=2 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.645+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768365358528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0a920 con 0x7fde2c04dc20 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.646+0000 7fde31437640 1 -- 172.21.15.164:0/1274252378 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94768365358528] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde24057030 con 0x7fde2c04dc20 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.646+0000 7fde33946800 20 remove_watcher() i=3 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.646+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768365365376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0bfe0 con 0x5630fac00020 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.647+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94768365365376] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x5630fac00020 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.647+0000 7fde33946800 20 remove_watcher() i=4 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.647+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768365369744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0cdc0 con 0x7fde24078020 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.648+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94768365369744] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.648+0000 7fde33946800 20 remove_watcher() i=5 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.648+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768365363296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0a920 con 0x7fde24078020 2024-09-14T10:55:24.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.649+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94768365363296] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.649+0000 7fde33946800 20 remove_watcher() i=6 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.649+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768365372000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5630fac0e880 con 0x7fde24078020 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94768365372000] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c03b040 con 0x7fde24078020 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 20 remove_watcher() i=7 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fde24078020 msgr2=0x7fde2408f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fde24078020 0x7fde2408f5c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630fac00020 msgr2=0x5630fac024e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630fac00020 0x5630fac024e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fde2c04dc20 msgr2=0x7fde2c045170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fde2c04dc20 0x7fde2c045170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fac04a10 msgr2=0x5630fac06e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fac04a10 0x5630fac06e00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdcfc03ce10 msgr2=0x7fdcfc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdcfc03ce10 0x7fdcfc03f2d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde24065fd0 tx=0x7fde24085070 comp rx=0 tx=0).stop 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 msgr2=0x5630fabf4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 --2- 172.21.15.164:0/1274252378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabecd20 0x5630fabf4300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde2c022f70 tx=0x7fde2c054580 comp rx=0 tx=0).stop 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 reap_dead start 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde28c36640 1 -- 172.21.15.164:0/1274252378 reap_dead start 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 shutdown_connections 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 >> 172.21.15.164:0/1274252378 conn(0x5630fabe9120 msgr2=0x5630fabe7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 shutdown_connections 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.650+0000 7fde33946800 1 -- 172.21.15.164:0/1274252378 wait complete. 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 msgr2=0x7fdd0803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 0x7fdd0803f2d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5630fabc7380 tx=0x7fde240966f0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 msgr2=0x5630fabe0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00a2a0 tx=0x7fde2c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 shutdown_connections 2024-09-14T10:55:24.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd0803ce10 0x7fdd0803f2d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/4158647348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630fabe0260 0x5630fabe0680 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 >> 172.21.15.164:0/4158647348 conn(0x5630fabd4610 msgr2=0x5630fabd49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 shutdown_connections 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/4158647348 wait complete. 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 msgr2=0x5630fabcc8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 0x5630fabcc8c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 msgr2=0x5630fabd1140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 0x5630fabd1140 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 msgr2=0x7fdd1803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 0x7fdd1803f2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001e30 tx=0x7fde1c001390 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 msgr2=0x5630fabc5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fde240460d0 tx=0x7fde24002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 shutdown_connections 2024-09-14T10:55:24.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5630fabceca0 0x5630fabd1140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5630faad09e0 0x5630fabcc8c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdd1803ce10 0x7fdd1803f2d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 --2- 172.21.15.164:0/334859742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5630faa40fb0 0x5630fabc5270 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 >> 172.21.15.164:0/334859742 conn(0x5630faac7fa0 msgr2=0x5630fabbebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 shutdown_connections 2024-09-14T10:55:24.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.651+0000 7fde33946800 1 -- 172.21.15.164:0/334859742 wait complete. 2024-09-14T10:55:24.662 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-14T10:55:24.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-14T10:55:24.662 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-14T10:55:24.711 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.711 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a5faf800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558278375e00 0x558278376200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a5faf800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5582783798e0 con 0x558278378c30 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a5faf800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5582782027d0 con 0x558278375e00 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a3a99640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558278375e00 0x558278376200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a3a99640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558278375e00 0x558278376200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32794/0 (socket says 172.21.15.164:32794) 2024-09-14T10:55:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f21a3a99640 1 -- 172.21.15.164:0/2024246875 learned_addr learned my addr 172.21.15.164:0/2024246875 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.714+0000 7f219bfff640 1 --1- 172.21.15.164:0/2024246875 >> v1:172.21.15.116:6789/0 conn(0x558278378c30 0x5582783790e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38608/0 (socket says 172.21.15.164:38608) 2024-09-14T10:55:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.715+0000 7f21a3a99640 1 -- 172.21.15.164:0/2024246875 >> v1:172.21.15.116:6789/0 conn(0x558278378c30 legacy=0x5582783790e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.715+0000 7f21a3a99640 1 -- 172.21.15.164:0/2024246875 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827837fca0 con 0x558278375e00 2024-09-14T10:55:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.716+0000 7f21a3a99640 1 --2- 172.21.15.164:0/2024246875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278376200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f219400a520 tx=0x7f2194045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7ceab2f238e46c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a3298640 1 -- 172.21.15.164:0/2024246875 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194055070 con 0x558278375e00 2024-09-14T10:55:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a3298640 1 -- 172.21.15.164:0/2024246875 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21940515b0 con 0x558278375e00 2024-09-14T10:55:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a3298640 1 -- 172.21.15.164:0/2024246875 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21940518d0 con 0x558278375e00 2024-09-14T10:55:24.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 -- 172.21.15.164:0/2024246875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 msgr2=0x558278376200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2024246875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278376200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f219400a520 tx=0x7f2194045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 -- 172.21.15.164:0/2024246875 shutdown_connections 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2024246875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278376200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 -- 172.21.15.164:0/2024246875 >> 172.21.15.164:0/2024246875 conn(0x558278371700 msgr2=0x558278373b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 -- 172.21.15.164:0/2024246875 shutdown_connections 2024-09-14T10:55:24.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.717+0000 7f21a5faf800 1 -- 172.21.15.164:0/2024246875 wait complete. 2024-09-14T10:55:24.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.731+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.731+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.731+0000 7f21a5faf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.731+0000 7f21a5faf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55827820fdd0 con 0x558278375e00 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f21a3a99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f21a3a99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32802/0 (socket says 172.21.15.164:32802) 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f21a3a99640 1 -- 172.21.15.164:0/3073175443 learned_addr learned my addr 172.21.15.164:0/3073175443 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f21a3a99640 1 -- 172.21.15.164:0/3073175443 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558278468000 con 0x558278375e00 2024-09-14T10:55:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3073175443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21940460d0 tx=0x7f2194051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a473f84ce1a2a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f2091e0b640 1 -- 172.21.15.164:0/3073175443 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21940519d0 con 0x558278375e00 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f2091e0b640 1 -- 172.21.15.164:0/3073175443 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194051b70 con 0x558278375e00 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.732+0000 7f2091e0b640 1 -- 172.21.15.164:0/3073175443 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194051e50 con 0x558278375e00 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- 172.21.15.164:0/3073175443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 msgr2=0x558278467a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3073175443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21940460d0 tx=0x7f2194051000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- 172.21.15.164:0/3073175443 shutdown_connections 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3073175443 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x558278467a10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- 172.21.15.164:0/3073175443 >> 172.21.15.164:0/3073175443 conn(0x558278371700 msgr2=0x558278463390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- 172.21.15.164:0/3073175443 shutdown_connections 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- 172.21.15.164:0/3073175443 wait complete. 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.733+0000 7f21a5faf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55827837ef30 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a3a99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a3a99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32818/0 (socket says 172.21.15.164:32818) 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a3a99640 1 -- 172.21.15.164:0/984020873 learned_addr learned my addr 172.21.15.164:0/984020873 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a3a99640 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827846f950 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a3a99640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f21940460d0 tx=0x7f2194002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f208bfff640 1 -- 172.21.15.164:0/984020873 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2194073020 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f208bfff640 1 -- 172.21.15.164:0/984020873 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219406f580 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827846fbe0 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f208bfff640 1 -- 172.21.15.164:0/984020873 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219406f8a0 con 0x558278375e00 2024-09-14T10:55:24.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.734+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582784707f0 con 0x558278375e00 2024-09-14T10:55:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f208bfff640 1 -- 172.21.15.164:0/984020873 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2194076020 con 0x558278375e00 2024-09-14T10:55:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f208bfff640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 0x7f208c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f208bfff640 1 -- 172.21.15.164:0/984020873 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f219406b040 con 0x558278375e00 2024-09-14T10:55:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f219bfff640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 0x7f208c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 0x558278476a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.735+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558278476f80 con 0x558278378c30 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a429a640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 0x558278476a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f219bfff640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 0x7f208c03f320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f218c001e30 tx=0x7f218c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a429a640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 0x558278476a40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a429a640 1 -- 172.21.15.164:0/984020873 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f219c00a4d0 con 0x558278378c30 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558278477320 con 0x558278378c30 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a429a640 1 -- 172.21.15.164:0/984020873 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f219c00a4d0 con 0x558278378c30 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 0x55827847b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.736+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55827847ba50 con 0x558278478e20 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.737+0000 7f21a3a99640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 0x55827847b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.737+0000 7f21a3a99640 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 0x55827847b2c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.737+0000 7f21a3a99640 1 -- 172.21.15.164:0/984020873 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2194057030 con 0x558278478e20 2024-09-14T10:55:24.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.737+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558278477b70 con 0x558278378c30 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.737+0000 7f21a429a640 1 -- 172.21.15.164:0/984020873 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f219c00a4d0 con 0x558278378c30 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558278477fd0 con 0x558278378c30 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a429a640 1 -- 172.21.15.164:0/984020873 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f219c00a4d0 con 0x558278378c30 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a5faf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.738+0000 7f21a5faf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55827826e4a0 con 0x55827848a4c0 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32830/0 (socket says 172.21.15.164:32830) 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a429a640 1 -- 172.21.15.164:0/2220922334 learned_addr learned my addr 172.21.15.164:0/2220922334 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a429a640 1 -- 172.21.15.164:0/2220922334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827848af20 con 0x55827848a4c0 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a429a640 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5582784703f0 tx=0x7f219c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f20897fa640 1 -- 172.21.15.164:0/2220922334 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c014450 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f20897fa640 1 -- 172.21.15.164:0/2220922334 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c014610 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827848b750 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f20897fa640 1 -- 172.21.15.164:0/2220922334 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c014930 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.739+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827848bcf0 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.740+0000 7f20897fa640 1 -- 172.21.15.164:0/2220922334 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f219c011040 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.740+0000 7f20897fa640 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 0x7f207c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.740+0000 7f20897fa640 1 -- 172.21.15.164:0/2220922334 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f219c01e070 con 0x55827848a4c0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.740+0000 7f21a3a99640 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 0x7f207c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a3a99640 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 0x7f207c03f320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5582784714f0 tx=0x7f2194067040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a5faf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a5faf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558278468370 con 0x558278496f20 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32836/0 (socket says 172.21.15.164:32836) 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a429a640 1 -- 172.21.15.164:0/994237568 learned_addr learned my addr 172.21.15.164:0/994237568 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a429a640 1 -- 172.21.15.164:0/994237568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558278497910 con 0x558278496f20 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f21a429a640 1 --2- 172.21.15.164:0/994237568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f219c018430 tx=0x7f219c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682bb3fc79be72f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f2082ffd640 1 -- 172.21.15.164:0/994237568 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c04b070 con 0x558278496f20 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f2082ffd640 1 -- 172.21.15.164:0/994237568 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c051070 con 0x558278496f20 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.741+0000 7f2082ffd640 1 -- 172.21.15.164:0/994237568 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c011da0 con 0x558278496f20 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- 172.21.15.164:0/994237568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 msgr2=0x558278497320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 --2- 172.21.15.164:0/994237568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f219c018430 tx=0x7f219c014ea0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- 172.21.15.164:0/994237568 shutdown_connections 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 --2- 172.21.15.164:0/994237568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x558278497320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- 172.21.15.164:0/994237568 >> 172.21.15.164:0/994237568 conn(0x558278493320 msgr2=0x558278491560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- 172.21.15.164:0/994237568 shutdown_connections 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- 172.21.15.164:0/994237568 wait complete. 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 Processor -- start 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- start start 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.742+0000 7f21a5faf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558278497f30 con 0x558278496f20 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a429a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32848/0 (socket says 172.21.15.164:32848) 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 learned_addr learned my addr 172.21.15.164:0/3474218380 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55827849ead0 con 0x558278496f20 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a429a640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f219c02bfd0 tx=0x7f219c0544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f20817fa640 1 -- 172.21.15.164:0/3474218380 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c04b040 con 0x558278496f20 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f20817fa640 1 -- 172.21.15.164:0/3474218380 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219c031030 con 0x558278496f20 2024-09-14T10:55:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55827849ed60 con 0x558278496f20 2024-09-14T10:55:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f20817fa640 1 -- 172.21.15.164:0/3474218380 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f219c011330 con 0x558278496f20 2024-09-14T10:55:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.743+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55827849f6e0 con 0x558278496f20 2024-09-14T10:55:24.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.744+0000 7f20817fa640 1 -- 172.21.15.164:0/3474218380 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f219c001770 con 0x558278496f20 2024-09-14T10:55:24.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.744+0000 7f20817fa640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f206c03ce10 0x7f206c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.744+0000 7f20817fa640 1 -- 172.21.15.164:0/3474218380 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f219c00e040 con 0x558278496f20 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.744+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f206c03ce10 0x7f206c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.744+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f206c03ce10 0x7f206c03f2d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f21940514a0 tx=0x7f219406ff90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5582784aa300 0x5582784ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784acf10 con 0x5582784aa300 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f219bfff640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5582784aa300 0x5582784ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f219bfff640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5582784aa300 0x5582784ac7c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f218c00f610 con 0x5582784aa300 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 20 realm 2024-09-14T10:55:24.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784a9650 con 0x5582784aa300 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.745+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f218c00f610 con 0x5582784aa300 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784ada00 con 0x5582784aa300 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f218c00f610 con 0x5582784aa300 2024-09-14T10:55:24.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784ae2d0 con 0x5582784aa300 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f218c00f610 con 0x5582784aa300 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5582784aecf0 0x5582784b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b1820 con 0x5582784aecf0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a429a640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5582784aecf0 0x5582784b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.746+0000 7f21a429a640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5582784aecf0 0x5582784b10e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f219c03e070 con 0x5582784aecf0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a5faf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a5faf800 20 searching for the correct realm 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f219c03e070 con 0x5582784aecf0 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a429a640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f219c014070 0x7f219c05a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f219c014070 0x7f219c05a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f219c014070 0x7f219c05a7b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.747+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.748+0000 7f21a3a99640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f219408f070 0x7f2194077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.748+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.748+0000 7f219bfff640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f219408f070 0x7f2194077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.748+0000 7f219bfff640 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f219408f070 0x7f2194077590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c00f610 con 0x7f219408f070 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c00f610 con 0x5582784aa300 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x7f219408f070 2024-09-14T10:55:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x7f219408f070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.749+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c03e070 con 0x5582784aecf0 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x7f219408f070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.750+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c03e070 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.751+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x7f219408f070 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.752+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.753+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x7f219408f070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.753+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.753+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.753+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c02b040 con 0x5582784aa300 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.754+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aecf0 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219408f070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x5582784aa300 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.755+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3110 con 0x7f219c014070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b2210 con 0x5582784aa300 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b2a60 con 0x5582784aa300 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3590 con 0x5582784aa300 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.756+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 zone default found 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 4 Realm: () 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 zonegroup default 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b3590 con 0x7f219408f070 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b5430 con 0x5582784aecf0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784b57d0 con 0x5582784aecf0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 started sync module instance, tier type = 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.757+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b4870 con 0x7f219c014070 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.758+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.758+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94018852310160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b6020 con 0x7f219c014070 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.758+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b6870 con 0x5582784aa300 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.759+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94018852310160] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.760+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.760+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94018852313968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b6870 con 0x5582784aa300 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.760+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b7340 con 0x5582784aecf0 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.761+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.761+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94018852318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b7340 con 0x5582784aecf0 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.761+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b8340 con 0x7f219c014070 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.761+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94018852313968] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.762+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94018852318768] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.762+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.762+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94018852322864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b7730 con 0x7f219c014070 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.762+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b8d50 con 0x5582784aa300 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.763+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.763+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94018852325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b9440 con 0x5582784aa300 2024-09-14T10:55:24.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.763+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b9f60 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.764+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94018852322864] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.764+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94018852325808] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.764+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.764+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94018852330032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b9f20 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.764+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ba800 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.765+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94018852330032] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.765+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.765+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94018852316096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784b9f20 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.765+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784badd0 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94018852316096] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94018852332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784badd0 con 0x7f219408f070 2024-09-14T10:55:24.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=0 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=1 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=2 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=3 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=4 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=5 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.766+0000 7f21a5faf800 20 add_watcher() i=6 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.767+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94018852332288] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.767+0000 7f21a5faf800 20 add_watcher() i=7 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.767+0000 7f21a5faf800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.767+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784be1d0 con 0x5582784aa300 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.768+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.768+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94018852334320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784bb6c0 con 0x5582784aa300 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.768+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94018852334320] v35'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f2059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 5 note: GC not initialized 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f2058fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 20 Filter name: none 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f1fd27fc640 20 reqs_thread_entry: start 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.769+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784f1530 con 0x5582784aa300 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:24.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784f0f80 con 0x5582784aa300 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.770+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784f7c20 con 0x5582784aa300 2024-09-14T10:55:24.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f21a5faf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f21a5faf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f21a5faf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94018852582880 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784f3380 con 0x5582784aa300 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify (1) cookie 94018852325808 notify 150323855365 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f218c018040 con 0x5582784aa300 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.771+0000 7f2082ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94018852325808 notifier 4374 bl.length()=732 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f2082ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f2082ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify cookie 94018852582880 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f2082ffd640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f2068003ea0 con 0x5582784aa300 2024-09-14T10:55:24.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== watch-notify(notify_complete (2) cookie 94018852582880 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f218c009050 con 0x5582784aa300 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.772+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784f75e0 con 0x5582784aa300 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a5faf800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a5faf800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a5faf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94018852582880 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5582784f3330 con 0x7f219c014070 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== watch-notify(notify (1) cookie 94018852310160 notify 150323855362 ret 0) ==== 208+0+0 (crc 0 0 0) 0x5582784707f0 con 0x7f219c014070 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f20827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94018852310160 notifier 4374 bl.length()=166 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f20827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-14T10:55:24.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f20827fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-14T10:55:24.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f20827fc640 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1fd8003400 con 0x7f219c014070 2024-09-14T10:55:24.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.773+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(68 notify.0 [notify cookie 94018852582880 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.774+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== watch-notify(notify_complete (2) cookie 94018852582880 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55827846fbe0 con 0x7f219c014070 2024-09-14T10:55:24.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.774+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.788 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"kBNNXxhqnxs0YNGLtswBXeU15C0P4sFKyVENwfFM","active":true,"create_date":"2024-09-14T10:55:24.771398Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.775+0000 7f2059fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.775+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94018852334320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784f6e80 con 0x5582784aa300 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.776+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94018852334320] v35'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.776+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94018852310160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784f6e80 con 0x7f219c014070 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.777+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94018852310160] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.777+0000 7f21a5faf800 20 remove_watcher() i=0 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.777+0000 7f21a5faf800 2 removed watcher, disabling cache 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.777+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94018852313968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784f6e80 con 0x5582784aa300 2024-09-14T10:55:24.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.778+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94018852313968] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.778+0000 7f21a5faf800 20 remove_watcher() i=1 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.778+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94018852318768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x5582784aecf0 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.779+0000 7f21a429a640 1 -- 172.21.15.164:0/3474218380 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94018852318768] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f219c063040 con 0x5582784aecf0 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.779+0000 7f21a5faf800 20 remove_watcher() i=2 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.779+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94018852322864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x7f219c014070 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.780+0000 7f21a3a99640 1 -- 172.21.15.164:0/3474218380 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94018852322864] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2194057030 con 0x7f219c014070 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.780+0000 7f21a5faf800 20 remove_watcher() i=3 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.780+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94018852325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x5582784aa300 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.781+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94018852325808] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x5582784aa300 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.781+0000 7f21a5faf800 20 remove_watcher() i=4 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.781+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94018852330032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x7f219408f070 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.782+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94018852330032] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.782+0000 7f21a5faf800 20 remove_watcher() i=5 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.782+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94018852316096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x7f219408f070 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.783+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94018852316096] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.783+0000 7f21a5faf800 20 remove_watcher() i=6 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.783+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94018852332288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5582784ef340 con 0x7f219408f070 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.783+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94018852332288] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f218c03b040 con 0x7f219408f070 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.783+0000 7f21a5faf800 20 remove_watcher() i=7 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f219408f070 msgr2=0x7f2194077590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f219408f070 0x7f2194077590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5582784aa300 msgr2=0x5582784ac7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5582784aa300 0x5582784ac7c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f219c014070 msgr2=0x7f219c05a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f219c014070 0x7f219c05a7b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5582784aecf0 msgr2=0x5582784b10e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5582784aecf0 0x5582784b10e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f206c03ce10 msgr2=0x7f206c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f206c03ce10 0x7f206c03f2d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f21940514a0 tx=0x7f219406ff90 comp rx=0 tx=0).stop 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 msgr2=0x55827849e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f219bfff640 1 -- 172.21.15.164:0/3474218380 reap_dead start 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f219c02bfd0 tx=0x7f219c0544e0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 shutdown_connections 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/3474218380 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278496f20 0x55827849e570 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 >> 172.21.15.164:0/3474218380 conn(0x558278493320 msgr2=0x558278491530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 shutdown_connections 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/3474218380 wait complete. 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 msgr2=0x7f207c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 0x7f207c03f320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5582784714f0 tx=0x7f2194067040 comp rx=0 tx=0).stop 2024-09-14T10:55:24.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 msgr2=0x55827848a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5582784703f0 tx=0x7f219c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 shutdown_connections 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f207c03ce60 0x7f207c03f320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 --2- 172.21.15.164:0/2220922334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55827848a4c0 0x55827848a8e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 >> 172.21.15.164:0/2220922334 conn(0x55827847e870 msgr2=0x55827847ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 shutdown_connections 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.784+0000 7f21a5faf800 1 -- 172.21.15.164:0/2220922334 wait complete. 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 msgr2=0x558278476a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 0x558278476a40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 msgr2=0x55827847b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 0x55827847b2c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 msgr2=0x7f208c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 0x7f208c03f320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f218c001e30 tx=0x7f218c001390 comp rx=0 tx=0).stop 2024-09-14T10:55:24.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 msgr2=0x55827846f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f21940460d0 tx=0x7f2194002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 shutdown_connections 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558278478e20 0x55827847b2c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558278378c30 0x558278476a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f208c03ce60 0x7f208c03f320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 --2- 172.21.15.164:0/984020873 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558278375e00 0x55827846f3f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 >> 172.21.15.164:0/984020873 conn(0x558278371700 msgr2=0x558278468d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 shutdown_connections 2024-09-14T10:55:24.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.785+0000 7f21a5faf800 1 -- 172.21.15.164:0/984020873 wait complete. 2024-09-14T10:55:24.801 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'kBNNXxhqnxs0YNGLtswBXeU15C0P4sFKyVENwfFM', 'active': True, 'create_date': '2024-09-14T10:55:24.771398Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-14T10:55:24.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-14T10:55:24.801 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-14T10:55:24.850 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.850 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52e0a40800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ee2c101710 0x55ee2c1928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52e0a40800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee2c1968f0 con 0x55ee2c192de0 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52e0a40800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55ee2c0187d0 con 0x55ee2c101710 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52de52a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ee2c101710 0x55ee2c1928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52ddd29640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55ee2c192de0 0x55ee2c1951d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38618/0 (socket says 172.21.15.164:38618) 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.854+0000 7f52ddd29640 1 -- 172.21.15.164:0/3625551736 learned_addr learned my addr 172.21.15.164:0/3625551736 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.853+0000 7f52de52a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ee2c101710 0x55ee2c1928a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32858/0 (socket says 172.21.15.164:32858) 2024-09-14T10:55:24.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.854+0000 7f52de52a640 1 -- 172.21.15.164:0/3625551736 >> v1:172.21.15.116:6789/0 conn(0x55ee2c192de0 legacy=0x55ee2c1951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.854+0000 7f52de52a640 1 -- 172.21.15.164:0/3625551736 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c197b20 con 0x55ee2c101710 2024-09-14T10:55:24.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.855+0000 7f52de52a640 1 --2- 172.21.15.164:0/3625551736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c1928a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52d0005fd0 tx=0x7f52d0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f75298b4d62ff server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52dd528640 1 -- 172.21.15.164:0/3625551736 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d0058530 con 0x55ee2c101710 2024-09-14T10:55:24.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52dd528640 1 -- 172.21.15.164:0/3625551736 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d00586d0 con 0x55ee2c101710 2024-09-14T10:55:24.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52dd528640 1 -- 172.21.15.164:0/3625551736 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d00589d0 con 0x55ee2c101710 2024-09-14T10:55:24.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 -- 172.21.15.164:0/3625551736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 msgr2=0x55ee2c1928a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3625551736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c1928a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52d0005fd0 tx=0x7f52d0045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 -- 172.21.15.164:0/3625551736 shutdown_connections 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3625551736 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c1928a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 -- 172.21.15.164:0/3625551736 >> 172.21.15.164:0/3625551736 conn(0x55ee2c187f90 msgr2=0x55ee2c18a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 -- 172.21.15.164:0/3625551736 shutdown_connections 2024-09-14T10:55:24.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.856+0000 7f52e0a40800 1 -- 172.21.15.164:0/3625551736 wait complete. 2024-09-14T10:55:24.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.870+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.870+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.870+0000 7f52e0a40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.870+0000 7f52e0a40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee2c025dd0 con 0x55ee2c101710 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f52de52a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f52de52a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32868/0 (socket says 172.21.15.164:32868) 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f52de52a640 1 -- 172.21.15.164:0/1176344691 learned_addr learned my addr 172.21.15.164:0/1176344691 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f52de52a640 1 -- 172.21.15.164:0/1176344691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c2800a0 con 0x55ee2c101710 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f52de52a640 1 --2- 172.21.15.164:0/1176344691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52d0025a60 tx=0x7f52d0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a70e7634b0ce52a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f51cc608640 1 -- 172.21.15.164:0/1176344691 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d00589b0 con 0x55ee2c101710 2024-09-14T10:55:24.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f51cc608640 1 -- 172.21.15.164:0/1176344691 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d0068070 con 0x55ee2c101710 2024-09-14T10:55:24.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.871+0000 7f51cc608640 1 -- 172.21.15.164:0/1176344691 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d0058c80 con 0x55ee2c101710 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- 172.21.15.164:0/1176344691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 msgr2=0x55ee2c27fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 --2- 172.21.15.164:0/1176344691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52d0025a60 tx=0x7f52d0051000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- 172.21.15.164:0/1176344691 shutdown_connections 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 --2- 172.21.15.164:0/1176344691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c27fab0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- 172.21.15.164:0/1176344691 >> 172.21.15.164:0/1176344691 conn(0x55ee2c187f90 msgr2=0x55ee2c27b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- 172.21.15.164:0/1176344691 shutdown_connections 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- 172.21.15.164:0/1176344691 wait complete. 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.872+0000 7f52e0a40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee2c196dc0 con 0x55ee2c101710 2024-09-14T10:55:24.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52de52a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52de52a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32884/0 (socket says 172.21.15.164:32884) 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52de52a640 1 -- 172.21.15.164:0/3172789405 learned_addr learned my addr 172.21.15.164:0/3172789405 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52de52a640 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c287a60 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52de52a640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52d0025a60 tx=0x7f52d0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f51cae05640 1 -- 172.21.15.164:0/3172789405 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d0063650 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f51cae05640 1 -- 172.21.15.164:0/3172789405 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d00637f0 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee2c287cf0 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f51cae05640 1 -- 172.21.15.164:0/3172789405 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d0063af0 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.873+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2c288900 con 0x55ee2c101710 2024-09-14T10:55:24.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f51cae05640 1 -- 172.21.15.164:0/3172789405 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f52d0063c90 con 0x55ee2c101710 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f51cae05640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 0x7f51c403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f51cae05640 1 -- 172.21.15.164:0/3172789405 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f52d0098640 con 0x55ee2c101710 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f52ddd29640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 0x7f51c403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 0x55ee2c28eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.874+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c28f090 con 0x55ee2c192de0 2024-09-14T10:55:24.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52ded2b640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 0x55ee2c28eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52ddd29640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 0x7f51c403f2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001d70 tx=0x7f52d40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52ded2b640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 0x55ee2c28eb50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52ded2b640 1 -- 172.21.15.164:0/3172789405 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c192de0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c28f430 con 0x55ee2c192de0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52ded2b640 1 -- 172.21.15.164:0/3172789405 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c192de0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 0x55ee2c2933e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.875+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c293b70 con 0x55ee2c290f70 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52de52a640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 0x55ee2c2933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52de52a640 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 0x55ee2c2933e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52de52a640 1 -- 172.21.15.164:0/3172789405 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52d00743e0 con 0x55ee2c290f70 2024-09-14T10:55:24.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c28fc80 con 0x55ee2c192de0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52ded2b640 1 -- 172.21.15.164:0/3172789405 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c192de0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.876+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c290120 con 0x55ee2c192de0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52ded2b640 1 -- 172.21.15.164:0/3172789405 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c192de0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52e0a40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52e0a40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee2c0844a0 con 0x55ee2c2a25b0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32886/0 (socket says 172.21.15.164:32886) 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.877+0000 7f52ded2b640 1 -- 172.21.15.164:0/2765814928 learned_addr learned my addr 172.21.15.164:0/2765814928 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f52ded2b640 1 -- 172.21.15.164:0/2765814928 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c2a3010 con 0x55ee2c2a25b0 2024-09-14T10:55:24.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55ee2c289440 tx=0x7f52d800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f51c3fff640 1 -- 172.21.15.164:0/2765814928 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8007d60 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f51c3fff640 1 -- 172.21.15.164:0/2765814928 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d801e020 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee2c2a3840 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f51c3fff640 1 -- 172.21.15.164:0/2765814928 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8019590 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.878+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2c2a3de0 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f51c3fff640 1 -- 172.21.15.164:0/2765814928 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f52d8016040 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f51c3fff640 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 0x7f51b803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f51c3fff640 1 -- 172.21.15.164:0/2765814928 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f52d801f030 con 0x55ee2c2a25b0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f52de52a640 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 0x7f51b803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f52de52a640 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 0x7f51b803f2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55ee2c289620 tx=0x7f52d0091040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.879+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52e0a40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52e0a40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee2c280410 con 0x55ee2c2aeff0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32900/0 (socket says 172.21.15.164:32900) 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52ded2b640 1 -- 172.21.15.164:0/2630233934 learned_addr learned my addr 172.21.15.164:0/2630233934 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52ded2b640 1 -- 172.21.15.164:0/2630233934 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c2af9e0 con 0x55ee2c2aeff0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2630233934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f52d8054440 tx=0x7f52d8045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8250eca114a5e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f51c1ffb640 1 -- 172.21.15.164:0/2630233934 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d801d040 con 0x55ee2c2aeff0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f51c1ffb640 1 -- 172.21.15.164:0/2630233934 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d804b070 con 0x55ee2c2aeff0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.880+0000 7f51c1ffb640 1 -- 172.21.15.164:0/2630233934 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d80183b0 con 0x55ee2c2aeff0 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- 172.21.15.164:0/2630233934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 msgr2=0x55ee2c2af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2630233934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f52d8054440 tx=0x7f52d8045490 comp rx=0 tx=0).stop 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- 172.21.15.164:0/2630233934 shutdown_connections 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2630233934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2af3f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- 172.21.15.164:0/2630233934 >> 172.21.15.164:0/2630233934 conn(0x55ee2c2ab3f0 msgr2=0x55ee2c2a9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- 172.21.15.164:0/2630233934 shutdown_connections 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- 172.21.15.164:0/2630233934 wait complete. 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 Processor -- start 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- start start 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52e0a40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ee2c2b0000 con 0x55ee2c2aeff0 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52ded2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32906/0 (socket says 172.21.15.164:32906) 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.881+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 learned_addr learned my addr 172.21.15.164:0/2369828061 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee2c2b6b10 con 0x55ee2c2aeff0 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52d8056060 tx=0x7f52d80543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f51affff640 1 -- 172.21.15.164:0/2369828061 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d801d070 con 0x55ee2c2aeff0 2024-09-14T10:55:24.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f51affff640 1 -- 172.21.15.164:0/2369828061 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d80173b0 con 0x55ee2c2aeff0 2024-09-14T10:55:24.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee2c2b6da0 con 0x55ee2c2aeff0 2024-09-14T10:55:24.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f51affff640 1 -- 172.21.15.164:0/2369828061 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8016330 con 0x55ee2c2aeff0 2024-09-14T10:55:24.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.882+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee2c2b7930 con 0x55ee2c2aeff0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.883+0000 7f51affff640 1 -- 172.21.15.164:0/2369828061 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f52d80164d0 con 0x55ee2c2aeff0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.883+0000 7f51affff640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51a803cdf0 0x7f51a803f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.883+0000 7f51affff640 1 -- 172.21.15.164:0/2369828061 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f52d8033030 con 0x55ee2c2aeff0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.883+0000 7f52de52a640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51a803cdf0 0x7f51a803f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.883+0000 7f52de52a640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51a803cdf0 0x7f51a803f2b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52d007e750 tx=0x7f52d0084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c2c2250 0x55ee2c2c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2c4e60 con 0x55ee2c2c2250 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52ddd29640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c2c2250 0x55ee2c2c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52ddd29640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c2c2250 0x55ee2c2c4710 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52d4009050 con 0x55ee2c2c2250 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 20 realm 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.884+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2c15a0 con 0x55ee2c2c2250 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52d4009050 con 0x55ee2c2c2250 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2c5950 con 0x55ee2c2c2250 2024-09-14T10:55:24.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52d4009050 con 0x55ee2c2c2250 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2c6220 con 0x55ee2c2c2250 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52d4009050 con 0x55ee2c2c2250 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c2c6c40 0x55ee2c2c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2c9770 con 0x55ee2c2c6c40 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c2c6c40 0x55ee2c2c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.885+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c2c6c40 0x55ee2c2c9030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52e0a40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:24.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52e0a40800 20 searching for the correct realm 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cb060 con 0x55ee2c2c6c40 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52ded2b640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f52d8019040 0x7f52d80239d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52de52a640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f52d8019040 0x7f52d80239d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.886+0000 7f52de52a640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f52d8019040 0x7f52d80239d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52de52a640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f52d0073380 0x7f52d0099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52ddd29640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f52d0073380 0x7f52d0099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52ddd29640 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f52d0073380 0x7f52d0099970 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4009050 con 0x7f52d0073380 2024-09-14T10:55:24.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.887+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4009050 con 0x55ee2c2c2250 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.888+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.889+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.890+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.891+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.892+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.893+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f52d805b3f0 con 0x7f52d8019040 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.894+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ca030 con 0x55ee2c2c2250 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ca3d0 con 0x55ee2c2c2250 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ca7f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 zone default found 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 4 Realm: () 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:24.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 zonegroup default 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cb4e0 con 0x7f52d0073380 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.895+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cd2c0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cd740 con 0x55ee2c2c6c40 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 started sync module instance, tier type = 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.896+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cc760 con 0x7f52d8019040 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.897+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.897+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94481431708336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cdba0 con 0x7f52d8019040 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.897+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ce3f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.898+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94481431708336] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.899+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.899+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94481431715648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ce810 con 0x55ee2c2c2250 2024-09-14T10:55:24.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.899+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cf0a0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.900+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94481431715648] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.900+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.900+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94481431716704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cec30 con 0x55ee2c2c6c40 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.900+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2cfb10 con 0x7f52d8019040 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.901+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94481431716704] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.901+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.901+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94481431717760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2ceba0 con 0x7f52d8019040 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.901+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d09d0 con 0x55ee2c2c2250 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.902+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.902+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94481431725856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d1270 con 0x55ee2c2c2250 2024-09-14T10:55:24.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.902+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d1d60 con 0x7f52d0073380 2024-09-14T10:55:24.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.903+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94481431717760] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.904+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94481431725856] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.904+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.904+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94481431730224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d0d70 con 0x7f52d0073380 2024-09-14T10:55:24.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.904+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d2600 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.905+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94481431730224] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.905+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.905+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94481431723776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d0d70 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.905+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d2c20 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94481431723776] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94481431732480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d2c20 con 0x7f52d0073380 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=0 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=1 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=2 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=3 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=4 2024-09-14T10:55:24.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=5 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.906+0000 7f52e0a40800 20 add_watcher() i=6 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94481431732480] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52e0a40800 20 add_watcher() i=7 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52e0a40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d6040 con 0x55ee2c2c2250 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.907+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94481431734640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c2d3490 con 0x55ee2c2c2250 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94481431734640] v35'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f5194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f52e0a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f52e0a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f52e0a40800 5 note: GC not initialized 2024-09-14T10:55:24.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f510f7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.908+0000 7f52e0a40800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 20 Filter name: none 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f510d7fa640 20 reqs_thread_entry: start 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c3092f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:24.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.909+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c30f9b0 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.910+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.910+0000 7f52e0a40800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.910+0000 7f52e0a40800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.910+0000 7f52e0a40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.910+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94481431982960 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c30aff0 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94481431725856 notify 150323855366 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55ee2c1968f0 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f51c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94481431725856 notifier 4381 bl.length()=732 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94481431982960 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f51c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f51c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f51c1ffb640 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f51a4003ea0 con 0x55ee2c2c2250 2024-09-14T10:55:24.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== watch-notify(notify_complete (2) cookie 94481431982960 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f52d403b800 con 0x55ee2c2c2250 2024-09-14T10:55:24.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.911+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.923 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.912+0000 7f5194fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.912+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94481431734640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c30ab40 con 0x55ee2c2c2250 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.913+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94481431734640] v35'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.913+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94481431708336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x7f52d8019040 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.914+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94481431708336] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.914+0000 7f52e0a40800 20 remove_watcher() i=0 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.914+0000 7f52e0a40800 2 removed watcher, disabling cache 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.914+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94481431715648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x55ee2c2c2250 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.915+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94481431715648] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.915+0000 7f52e0a40800 20 remove_watcher() i=1 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.915+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94481431716704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x55ee2c2c6c40 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.916+0000 7f52ded2b640 1 -- 172.21.15.164:0/2369828061 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94481431716704] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d80083e0 con 0x55ee2c2c6c40 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.916+0000 7f52e0a40800 20 remove_watcher() i=2 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.916+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94481431717760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x7f52d8019040 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.917+0000 7f52de52a640 1 -- 172.21.15.164:0/2369828061 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94481431717760] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d00743e0 con 0x7f52d8019040 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.917+0000 7f52e0a40800 20 remove_watcher() i=3 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.917+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94481431725856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x55ee2c2c2250 2024-09-14T10:55:24.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.920+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94481431725856] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x55ee2c2c2250 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.920+0000 7f52e0a40800 20 remove_watcher() i=4 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.920+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94481431730224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.921+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94481431730224] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.921+0000 7f52e0a40800 20 remove_watcher() i=5 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.921+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94481431723776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.922+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94481431723776] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.922+0000 7f52e0a40800 20 remove_watcher() i=6 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.922+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94481431732480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ee2c307060 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94481431732480] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52d4029040 con 0x7f52d0073380 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 20 remove_watcher() i=7 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f52d0073380 msgr2=0x7f52d0099970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f52d0073380 0x7f52d0099970 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c2c2250 msgr2=0x55ee2c2c4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c2c2250 0x55ee2c2c4710 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f52d8019040 msgr2=0x7f52d80239d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f52d8019040 0x7f52d80239d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c2c6c40 msgr2=0x55ee2c2c9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c2c6c40 0x55ee2c2c9030 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51a803cdf0 msgr2=0x7f51a803f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51a803cdf0 0x7f51a803f2b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52d007e750 tx=0x7f52d0084000 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 msgr2=0x55ee2c2b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52ddd29640 1 -- 172.21.15.164:0/2369828061 reap_dead start 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f52d8056060 tx=0x7f52d80543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 shutdown_connections 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2369828061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2aeff0 0x55ee2c2b65b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 >> 172.21.15.164:0/2369828061 conn(0x55ee2c2ab3f0 msgr2=0x55ee2c2a9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 shutdown_connections 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.923+0000 7f52e0a40800 1 -- 172.21.15.164:0/2369828061 wait complete. 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 msgr2=0x7f51b803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 0x7f51b803f2d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55ee2c289620 tx=0x7f52d0091040 comp rx=0 tx=0).stop 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 msgr2=0x55ee2c2a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55ee2c289440 tx=0x7f52d800af20 comp rx=0 tx=0).stop 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 shutdown_connections 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51b803ce10 0x7f51b803f2d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/2765814928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c2a25b0 0x55ee2c2a29d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 >> 172.21.15.164:0/2765814928 conn(0x55ee2c296960 msgr2=0x55ee2c296d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 shutdown_connections 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/2765814928 wait complete. 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 msgr2=0x55ee2c28eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 0x55ee2c28eb50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 msgr2=0x55ee2c2933e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 0x55ee2c2933e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 msgr2=0x7f51c403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 0x7f51c403f2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001d70 tx=0x7f52d40012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 msgr2=0x55ee2c287500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52d0025a60 tx=0x7f52d0003330 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 shutdown_connections 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ee2c290f70 0x55ee2c2933e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ee2c192de0 0x55ee2c28eb50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51c403ce10 0x7f51c403f2d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 --2- 172.21.15.164:0/3172789405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ee2c101710 0x55ee2c287500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 >> 172.21.15.164:0/3172789405 conn(0x55ee2c187f90 msgr2=0x55ee2c279c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 shutdown_connections 2024-09-14T10:55:24.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.924+0000 7f52e0a40800 1 -- 172.21.15.164:0/3172789405 wait complete. 2024-09-14T10:55:24.934 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:24.935 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:24.935 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:24.979 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:24.979 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.982+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.982+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.982+0000 7f4aaec92800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e78979f710 0x55e78982e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.982+0000 7f4aaec92800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e7898326f0 con 0x55e78982ea40 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.982+0000 7f4aaec92800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e7896b67d0 con 0x55e78979f710 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.983+0000 7f4aac77c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e78979f710 0x55e78982e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.983+0000 7f4aac77c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e78979f710 0x55e78982e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32908/0 (socket says 172.21.15.164:32908) 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.983+0000 7f4aac77c640 1 -- 172.21.15.164:0/1499169379 learned_addr learned my addr 172.21.15.164:0/1499169379 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.983+0000 7f4aac77c640 1 -- 172.21.15.164:0/1499169379 >> v1:172.21.15.116:6789/0 conn(0x55e78982ea40 legacy=0x55e789830e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.983+0000 7f4aac77c640 1 -- 172.21.15.164:0/1499169379 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e789833920 con 0x55e78979f710 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1499169379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78982e500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ad519b8cdde64c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aab77a640 1 -- 172.21.15.164:0/1499169379 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c04e600 con 0x55e78979f710 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aab77a640 1 -- 172.21.15.164:0/1499169379 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c04e7a0 con 0x55e78979f710 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aab77a640 1 -- 172.21.15.164:0/1499169379 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c04eaa0 con 0x55e78979f710 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 -- 172.21.15.164:0/1499169379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 msgr2=0x55e78982e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:24.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1499169379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78982e500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c045cf0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 -- 172.21.15.164:0/1499169379 shutdown_connections 2024-09-14T10:55:24.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1499169379 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78982e500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:24.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 -- 172.21.15.164:0/1499169379 >> 172.21.15.164:0/1499169379 conn(0x55e789825fb0 msgr2=0x55e7898283f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:24.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 -- 172.21.15.164:0/1499169379 shutdown_connections 2024-09-14T10:55:24.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.985+0000 7f4aaec92800 1 -- 172.21.15.164:0/1499169379 wait complete. 2024-09-14T10:55:24.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.999+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.999+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.999+0000 7f4aaec92800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:24.999+0000 7f4aaec92800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7896c3dd0 con 0x55e78979f710 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f4aac77c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f4aac77c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32918/0 (socket says 172.21.15.164:32918) 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f4aac77c640 1 -- 172.21.15.164:0/762325838 learned_addr learned my addr 172.21.15.164:0/762325838 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f4aac77c640 1 -- 172.21.15.164:0/762325838 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78991bdb0 con 0x55e78979f710 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f4aac77c640 1 --2- 172.21.15.164:0/762325838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1804faff7e1e2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f499a60c640 1 -- 172.21.15.164:0/762325838 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c04eb40 con 0x55e78979f710 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f499a60c640 1 -- 172.21.15.164:0/762325838 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c066070 con 0x55e78979f710 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.000+0000 7f499a60c640 1 -- 172.21.15.164:0/762325838 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c04ee50 con 0x55e78979f710 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- 172.21.15.164:0/762325838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 msgr2=0x55e78991b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 --2- 172.21.15.164:0/762325838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c050000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- 172.21.15.164:0/762325838 shutdown_connections 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 --2- 172.21.15.164:0/762325838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e78991b7c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- 172.21.15.164:0/762325838 >> 172.21.15.164:0/762325838 conn(0x55e789825fb0 msgr2=0x55e789917140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- 172.21.15.164:0/762325838 shutdown_connections 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- 172.21.15.164:0/762325838 wait complete. 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.001+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aaec92800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aaec92800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e789832bc0 con 0x55e78979f710 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aac77c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aac77c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32930/0 (socket says 172.21.15.164:32930) 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aac77c640 1 -- 172.21.15.164:0/1849228660 learned_addr learned my addr 172.21.15.164:0/1849228660 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aac77c640 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e789923740 con 0x55e78979f710 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4998e09640 1 -- 172.21.15.164:0/1849228660 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c06d550 con 0x55e78979f710 2024-09-14T10:55:25.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4998e09640 1 -- 172.21.15.164:0/1849228660 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c071030 con 0x55e78979f710 2024-09-14T10:55:25.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4998e09640 1 -- 172.21.15.164:0/1849228660 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a9c06d820 con 0x55e78979f710 2024-09-14T10:55:25.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7899239d0 con 0x55e78979f710 2024-09-14T10:55:25.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.002+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7899243d0 con 0x55e78979f710 2024-09-14T10:55:25.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.003+0000 7f4998e09640 1 -- 172.21.15.164:0/1849228660 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4a9c06dad0 con 0x55e78979f710 2024-09-14T10:55:25.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.003+0000 7f4998e09640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 0x7f499403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4998e09640 1 -- 172.21.15.164:0/1849228660 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4a9c098b70 con 0x55e78979f710 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 0x7f499403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 0x55e78992a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78992ad70 con 0x55e78982ea40 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 0x55e78992a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 0x7f499403f2d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55e78979fcd0 tx=0x7f4a940013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 0x55e78992a830 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1849228660 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e78982ea40 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.004+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78992b110 con 0x55e78982ea40 2024-09-14T10:55:25.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1849228660 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e78982ea40 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 0x55e78992f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78992f800 con 0x55e78992cbd0 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 0x55e78992f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 0x55e78992f070 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aac77c640 1 -- 172.21.15.164:0/1849228660 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a9c07d070 con 0x55e78992cbd0 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.005+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78992b960 con 0x55e78982ea40 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1849228660 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e78982ea40 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78992bd80 con 0x55e78982ea40 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1849228660 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e78982ea40 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aaec92800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.006+0000 7f4aaec92800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7897224a0 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32946/0 (socket says 172.21.15.164:32946) 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aacf7d640 1 -- 172.21.15.164:0/2447983204 learned_addr learned my addr 172.21.15.164:0/2447983204 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aacf7d640 1 -- 172.21.15.164:0/2447983204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78993ec80 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55e7899250d0 tx=0x7f4aa400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4991ffb640 1 -- 172.21.15.164:0/2447983204 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa4007dc0 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4991ffb640 1 -- 172.21.15.164:0/2447983204 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa401e020 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e78993f4b0 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.007+0000 7f4991ffb640 1 -- 172.21.15.164:0/2447983204 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa4019570 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.008+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e78993fa50 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.008+0000 7f4991ffb640 1 -- 172.21.15.164:0/2447983204 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4aa4016040 con 0x55e78993e220 2024-09-14T10:55:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.008+0000 7f4991ffb640 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 0x7f498403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.008+0000 7f4991ffb640 1 -- 172.21.15.164:0/2447983204 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4aa401f030 con 0x55e78993e220 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aac77c640 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 0x7f498403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aac77c640 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 0x7f498403f2d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e7899252b0 tx=0x7f4a9c082040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aaec92800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aaec92800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e78991c120 con 0x55e78982b5a0 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32958/0 (socket says 172.21.15.164:32958) 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aacf7d640 1 -- 172.21.15.164:0/489989127 learned_addr learned my addr 172.21.15.164:0/489989127 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.009+0000 7f4aacf7d640 1 -- 172.21.15.164:0/489989127 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e78982bee0 con 0x55e78982b5a0 2024-09-14T10:55:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/489989127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4014d90 tx=0x7f4aa4014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e56ccccefe5e418 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f498b7fe640 1 -- 172.21.15.164:0/489989127 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa4051020 con 0x55e78982b5a0 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f498b7fe640 1 -- 172.21.15.164:0/489989127 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa4045260 con 0x55e78982b5a0 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f498b7fe640 1 -- 172.21.15.164:0/489989127 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa401d070 con 0x55e78982b5a0 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 -- 172.21.15.164:0/489989127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 msgr2=0x55e78982b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 --2- 172.21.15.164:0/489989127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4014d90 tx=0x7f4aa4014d00 comp rx=0 tx=0).stop 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 -- 172.21.15.164:0/489989127 shutdown_connections 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 --2- 172.21.15.164:0/489989127 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e78982b9a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 -- 172.21.15.164:0/489989127 >> 172.21.15.164:0/489989127 conn(0x55e789947140 msgr2=0x55e789945380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 -- 172.21.15.164:0/489989127 shutdown_connections 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 -- 172.21.15.164:0/489989127 wait complete. 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.010+0000 7f4aaec92800 1 Processor -- start 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aaec92800 1 -- start start 2024-09-14T10:55:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aaec92800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aaec92800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e78982a460 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aacf7d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32970/0 (socket says 172.21.15.164:32970) 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 learned_addr learned my addr 172.21.15.164:0/1385698446 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e789954aa0 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4014d90 tx=0x7f4aa40543f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4989ffb640 1 -- 172.21.15.164:0/1385698446 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa4030020 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4989ffb640 1 -- 172.21.15.164:0/1385698446 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa4045410 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.011+0000 7f4989ffb640 1 -- 172.21.15.164:0/1385698446 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aa4019a50 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.012+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e789954d30 con 0x55e78982b5a0 2024-09-14T10:55:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.012+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e789954d30 con 0x55e78982b5a0 2024-09-14T10:55:25.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.012+0000 7f4989ffb640 1 -- 172.21.15.164:0/1385698446 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4aa4033020 con 0x55e78982b5a0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.012+0000 7f4989ffb640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f497c03ce60 0x7f497c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.012+0000 7f4989ffb640 1 -- 172.21.15.164:0/1385698446 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f4aa403ebd0 con 0x55e78982b5a0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f497c03ce60 0x7f497c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78995fef0 0x55e7899623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789962b00 con 0x55e78995fef0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78995fef0 0x55e7899623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f497c03ce60 0x7f497c03f320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0971e0 tx=0x7f4a9c084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78995fef0 0x55e7899623b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a94010580 con 0x55e78995fef0 2024-09-14T10:55:25.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 20 realm 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.013+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78995f240 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a94010580 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7899635e0 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a94010580 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789963eb0 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a94010580 con 0x55e78995fef0 2024-09-14T10:55:25.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7899647b0 0x55e789966ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789967310 con 0x55e7899647b0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.014+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7899647b0 0x55e789966ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7899647b0 0x55e789966ba0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e7899647b0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aaec92800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aaec92800 20 searching for the correct realm 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e7899647b0 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aacf7d640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4aa4035020 0x7f4aa4045990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.015+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4aa4035020 0x7f4aa4045990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4aa4035020 0x7f4aa4045990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aac77c640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4a9c0a5040 0x7f4a9c0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4a9c0a5040 0x7f4a9c0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aabf7b640 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4a9c0a5040 0x7f4a9c0753d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a94010580 con 0x7f4a9c0a5040 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.016+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a94010580 con 0x55e78995fef0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.017+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e7899647b0 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.018+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa40083e0 con 0x55e7899647b0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.019+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.020+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.021+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.022+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e7899647b0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4a9c0a5040 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x55e78995fef0 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e789968d00 con 0x7f4aa4035020 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.023+0000 7f4aaec92800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789967df0 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789968690 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789967a30 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 zone default found 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 4 Realm: () 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 zonegroup default 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.024+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7899691b0 con 0x7f4a9c0a5040 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78996ad00 con 0x55e7899647b0 2024-09-14T10:55:25.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e78996b210 con 0x55e7899647b0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 started sync module instance, tier type = 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.025+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996a040 con 0x7f4aa4035020 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.026+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.026+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94452934155152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996b670 con 0x7f4aa4035020 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.026+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996bec0 con 0x55e78995fef0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.027+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94452934155152] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.027+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.027+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94452934162960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996c2e0 con 0x55e78995fef0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.027+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996cb30 con 0x55e7899647b0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.028+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94452934162960] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.029+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.029+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94452934164496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996ca60 con 0x55e7899647b0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.029+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996d5b0 con 0x7f4aa4035020 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.030+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.030+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94452934164496] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.030+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94452934168768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996d9d0 con 0x7f4aa4035020 2024-09-14T10:55:25.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.030+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996e410 con 0x55e78995fef0 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.031+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.031+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94452934172384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996ecb0 con 0x55e78995fef0 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.031+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996f7b0 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.031+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94452934168768] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.032+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.032+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94452934177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996f770 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.032+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7899701c0 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.032+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94452934172384] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.032+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94452934177440] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94452934165744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996fd10 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7899706d0 con 0x7f4a9c0a5040 2024-09-14T10:55:25.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94452934181408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970af0 con 0x7f4a9c0a5040 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=0 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=1 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=2 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=3 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=4 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.033+0000 7f4aaec92800 20 add_watcher() i=5 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94452934165744] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aaec92800 20 add_watcher() i=6 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94452934181408] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aaec92800 20 add_watcher() i=7 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aaec92800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.034+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e789970af0 con 0x55e78995fef0 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.035+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.035+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94452934182464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970a60 con 0x55e78995fef0 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94452934182464] v35'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 5 note: GC not initialized 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4961fe3640 20 reqs_thread_entry: start 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 20 Filter name: none 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f495b7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.036+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7899a68d0 con 0x55e78995fef0 2024-09-14T10:55:25.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.037+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.037+0000 7f4aaec92800 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:55:25.053 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.038+0000 7f4962fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.038+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94452934182464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7899a5380 con 0x55e78995fef0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.039+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94452934182464] v35'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.039+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94452934155152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970640 con 0x7f4aa4035020 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.040+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94452934155152] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.040+0000 7f4aaec92800 20 remove_watcher() i=0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.040+0000 7f4aaec92800 2 removed watcher, disabling cache 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.040+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94452934162960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970640 con 0x55e78995fef0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.041+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94452934162960] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.041+0000 7f4aaec92800 20 remove_watcher() i=1 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.041+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94452934164496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996ba10 con 0x55e7899647b0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.042+0000 7f4aacf7d640 1 -- 172.21.15.164:0/1385698446 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94452934164496] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4aa4064040 con 0x55e7899647b0 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.042+0000 7f4aaec92800 20 remove_watcher() i=2 2024-09-14T10:55:25.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.042+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94452934168768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970640 con 0x7f4aa4035020 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.043+0000 7f4aac77c640 1 -- 172.21.15.164:0/1385698446 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94452934168768] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9c07d070 con 0x7f4aa4035020 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.043+0000 7f4aaec92800 20 remove_watcher() i=3 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.043+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94452934172384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996c010 con 0x55e78995fef0 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.044+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94452934172384] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x55e78995fef0 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.044+0000 7f4aaec92800 20 remove_watcher() i=4 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.044+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94452934177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996ba10 con 0x7f4a9c0a5040 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.045+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94452934177440] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.045+0000 7f4aaec92800 20 remove_watcher() i=5 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.045+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94452934165744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e789970640 con 0x7f4a9c0a5040 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.046+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94452934165744] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.046+0000 7f4aaec92800 20 remove_watcher() i=6 2024-09-14T10:55:25.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.046+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94452934181408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e78996c010 con 0x7f4a9c0a5040 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94452934181408] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a9402a040 con 0x7f4a9c0a5040 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 20 remove_watcher() i=7 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4a9c0a5040 msgr2=0x7f4a9c0753d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4a9c0a5040 0x7f4a9c0753d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78995fef0 msgr2=0x55e7899623b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78995fef0 0x55e7899623b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4aa4035020 msgr2=0x7f4aa4045990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4aa4035020 0x7f4aa4045990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7899647b0 msgr2=0x55e789966ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7899647b0 0x55e789966ba0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f497c03ce60 msgr2=0x7f497c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f497c03ce60 0x7f497c03f320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c0971e0 tx=0x7f4a9c084000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 msgr2=0x55e789954540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4014d90 tx=0x7f4aa40543f0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aabf7b640 1 -- 172.21.15.164:0/1385698446 reap_dead start 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 shutdown_connections 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1385698446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78982b5a0 0x55e789954540 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.047+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 >> 172.21.15.164:0/1385698446 conn(0x55e789947140 msgr2=0x55e789945350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 shutdown_connections 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1385698446 wait complete. 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 msgr2=0x7f498403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 0x7f498403f2d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55e7899252b0 tx=0x7f4a9c082040 comp rx=0 tx=0).stop 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 msgr2=0x55e78993e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55e7899250d0 tx=0x7f4aa400af40 comp rx=0 tx=0).stop 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 shutdown_connections 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f498403ce10 0x7f498403f2d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/2447983204 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78993e220 0x55e78993e640 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 >> 172.21.15.164:0/2447983204 conn(0x55e7899325d0 msgr2=0x55e7899329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 shutdown_connections 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/2447983204 wait complete. 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 msgr2=0x55e78992a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 0x55e78992a830 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 msgr2=0x55e78992f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 0x55e78992f070 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 msgr2=0x7f499403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 0x7f499403f2d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55e78979fcd0 tx=0x7f4a940013d0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 msgr2=0x55e7899231e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c003330 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 shutdown_connections 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e78992cbd0 0x55e78992f070 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e78982ea40 0x55e78992a830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f499403ce10 0x7f499403f2d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 --2- 172.21.15.164:0/1849228660 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e78979f710 0x55e7899231e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.048+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 >> 172.21.15.164:0/1849228660 conn(0x55e789825fb0 msgr2=0x55e78991cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.049+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 shutdown_connections 2024-09-14T10:55:25.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.049+0000 7f4aaec92800 1 -- 172.21.15.164:0/1849228660 wait complete. 2024-09-14T10:55:25.064 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:25.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:25.065 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:25.109 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.109 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372f128800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562c5cf8bb50 0x562c5cf8df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372f128800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c5cf8e5e0 con 0x562c5cf877a0 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372f128800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x562c5ce137d0 con 0x562c5cf8bb50 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372a55c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562c5cf8bb50 0x562c5cf8df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.112+0000 7f372ad5d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x562c5cf877a0 0x562c5cf87ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38624/0 (socket says 172.21.15.164:38624) 2024-09-14T10:55:25.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.113+0000 7f372a55c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562c5cf8bb50 0x562c5cf8df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32982/0 (socket says 172.21.15.164:32982) 2024-09-14T10:55:25.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.113+0000 7f372ad5d640 1 -- 172.21.15.164:0/2400795934 learned_addr learned my addr 172.21.15.164:0/2400795934 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:25.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.113+0000 7f372a55c640 1 -- 172.21.15.164:0/2400795934 >> v1:172.21.15.116:6789/0 conn(0x562c5cf877a0 legacy=0x562c5cf87ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.113+0000 7f372a55c640 1 -- 172.21.15.164:0/2400795934 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5cf8f810 con 0x562c5cf8bb50 2024-09-14T10:55:25.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372a55c640 1 --2- 172.21.15.164:0/2400795934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5cf8df60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f371400a470 tx=0x7f3714045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99cdb20eb7d0cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f3729d5b640 1 -- 172.21.15.164:0/2400795934 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714053570 con 0x562c5cf8bb50 2024-09-14T10:55:25.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f3729d5b640 1 -- 172.21.15.164:0/2400795934 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3714058070 con 0x562c5cf8bb50 2024-09-14T10:55:25.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f3729d5b640 1 -- 172.21.15.164:0/2400795934 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3714053880 con 0x562c5cf8bb50 2024-09-14T10:55:25.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 -- 172.21.15.164:0/2400795934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 msgr2=0x562c5cf8df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 --2- 172.21.15.164:0/2400795934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5cf8df60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f371400a470 tx=0x7f3714045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 -- 172.21.15.164:0/2400795934 shutdown_connections 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 --2- 172.21.15.164:0/2400795934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5cf8df60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 -- 172.21.15.164:0/2400795934 >> 172.21.15.164:0/2400795934 conn(0x562c5cf82fb0 msgr2=0x562c5cf853f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 -- 172.21.15.164:0/2400795934 shutdown_connections 2024-09-14T10:55:25.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.115+0000 7f372f128800 1 -- 172.21.15.164:0/2400795934 wait complete. 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.129+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.129+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.129+0000 7f372f128800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.129+0000 7f372f128800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c5ce20dd0 con 0x562c5cf877a0 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f372ad5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f372ad5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:32992/0 (socket says 172.21.15.164:32992) 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f372ad5d640 1 -- 172.21.15.164:0/1505308286 learned_addr learned my addr 172.21.15.164:0/1505308286 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f372ad5d640 1 -- 172.21.15.164:0/1505308286 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d07b310 con 0x562c5cf877a0 2024-09-14T10:55:25.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1505308286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f371c001e40 tx=0x7f371c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7629f5b8a0e03248 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f3618e09640 1 -- 172.21.15.164:0/1505308286 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c012020 con 0x562c5cf877a0 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f3618e09640 1 -- 172.21.15.164:0/1505308286 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c00e5a0 con 0x562c5cf877a0 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.130+0000 7f3618e09640 1 -- 172.21.15.164:0/1505308286 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c00e8a0 con 0x562c5cf877a0 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- 172.21.15.164:0/1505308286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 msgr2=0x562c5cefc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 --2- 172.21.15.164:0/1505308286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f371c001e40 tx=0x7f371c001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- 172.21.15.164:0/1505308286 shutdown_connections 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 --2- 172.21.15.164:0/1505308286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf877a0 0x562c5cefc5a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- 172.21.15.164:0/1505308286 >> 172.21.15.164:0/1505308286 conn(0x562c5cf82fb0 msgr2=0x562c5d072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- 172.21.15.164:0/1505308286 shutdown_connections 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- 172.21.15.164:0/1505308286 wait complete. 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.131+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372f128800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372f128800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c5cf8eab0 con 0x562c5cf8bb50 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372ad5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372ad5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33000/0 (socket says 172.21.15.164:33000) 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372ad5d640 1 -- 172.21.15.164:0/4154677737 learned_addr learned my addr 172.21.15.164:0/4154677737 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372ad5d640 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d080a30 con 0x562c5cf8bb50 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372ad5d640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c010 tx=0x7f371c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f3617606640 1 -- 172.21.15.164:0/4154677737 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c012030 con 0x562c5cf8bb50 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f3617606640 1 -- 172.21.15.164:0/4154677737 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c0014a0 con 0x562c5cf8bb50 2024-09-14T10:55:25.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c5d080cc0 con 0x562c5cf8bb50 2024-09-14T10:55:25.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.132+0000 7f3617606640 1 -- 172.21.15.164:0/4154677737 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f371c01a700 con 0x562c5cf8bb50 2024-09-14T10:55:25.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.133+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d0816c0 con 0x562c5cf8bb50 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.133+0000 7f3617606640 1 -- 172.21.15.164:0/4154677737 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f371c015020 con 0x562c5cf8bb50 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f3617606640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 0x7f361003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f3617606640 1 -- 172.21.15.164:0/4154677737 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f371c020030 con 0x562c5cf8bb50 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372a55c640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 0x7f361003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 0x562c5d087b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d088060 con 0x562c5d0821e0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372b55e640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 0x562c5d087b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372a55c640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 0x7f361003f320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3714057000 tx=0x7f3714052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372b55e640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 0x562c5d087b20 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372b55e640 1 -- 172.21.15.164:0/4154677737 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f372400a4d0 con 0x562c5d0821e0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.134+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d081b70 con 0x562c5d0821e0 2024-09-14T10:55:25.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372b55e640 1 -- 172.21.15.164:0/4154677737 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f372400a4d0 con 0x562c5d0821e0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 0x562c5d08c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d08ce50 con 0x562c5d08a390 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372ad5d640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 0x562c5d08c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372ad5d640 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 0x562c5d08c780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372ad5d640 1 -- 172.21.15.164:0/4154677737 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f371c0187b0 con 0x562c5d08a390 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.135+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d089230 con 0x562c5d0821e0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372b55e640 1 -- 172.21.15.164:0/4154677737 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f372400a4d0 con 0x562c5d0821e0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0896b0 con 0x562c5d0821e0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372b55e640 1 -- 172.21.15.164:0/4154677737 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f372400a4d0 con 0x562c5d0821e0 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372f128800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.136+0000 7f372f128800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c5ce7f4a0 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33006/0 (socket says 172.21.15.164:33006) 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372b55e640 1 -- 172.21.15.164:0/80689439 learned_addr learned my addr 172.21.15.164:0/80689439 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372b55e640 1 -- 172.21.15.164:0/80689439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d09c280 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372b55e640 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x562c5d088440 tx=0x7f3724018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f3614e01640 1 -- 172.21.15.164:0/80689439 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724014450 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f3614e01640 1 -- 172.21.15.164:0/80689439 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37240145f0 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c5d09cab0 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f3614e01640 1 -- 172.21.15.164:0/80689439 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724014910 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.137+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d09d050 con 0x562c5d09b820 2024-09-14T10:55:25.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.138+0000 7f3614e01640 1 -- 172.21.15.164:0/80689439 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3724011040 con 0x562c5d09b820 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.138+0000 7f3614e01640 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 0x7f360403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.138+0000 7f3614e01640 1 -- 172.21.15.164:0/80689439 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f372401e070 con 0x562c5d09b820 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.138+0000 7f372ad5d640 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 0x7f360403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372ad5d640 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 0x7f360403f2d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x562c5d0884e0 tx=0x7f371c04d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372f128800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372f128800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c5d07b5f0 con 0x562c5d0783b0 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33010/0 (socket says 172.21.15.164:33010) 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372b55e640 1 -- 172.21.15.164:0/4289122408 learned_addr learned my addr 172.21.15.164:0/4289122408 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372b55e640 1 -- 172.21.15.164:0/4289122408 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d078cf0 con 0x562c5d0783b0 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f372b55e640 1 --2- 172.21.15.164:0/4289122408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3724016fd0 tx=0x7f3724011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3557f827ef6aed94 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f360e7fc640 1 -- 172.21.15.164:0/4289122408 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372404b070 con 0x562c5d0783b0 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f360e7fc640 1 -- 172.21.15.164:0/4289122408 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3724051070 con 0x562c5d0783b0 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.139+0000 7f360e7fc640 1 -- 172.21.15.164:0/4289122408 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724022db0 con 0x562c5d0783b0 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- 172.21.15.164:0/4289122408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 msgr2=0x562c5d0787b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 --2- 172.21.15.164:0/4289122408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3724016fd0 tx=0x7f3724011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- 172.21.15.164:0/4289122408 shutdown_connections 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 --2- 172.21.15.164:0/4289122408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0787b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- 172.21.15.164:0/4289122408 >> 172.21.15.164:0/4289122408 conn(0x562c5d0a46c0 msgr2=0x562c5d0a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- 172.21.15.164:0/4289122408 shutdown_connections 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- 172.21.15.164:0/4289122408 wait complete. 2024-09-14T10:55:25.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 Processor -- start 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- start start 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.140+0000 7f372f128800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562c5d077270 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372b55e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33016/0 (socket says 172.21.15.164:33016) 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 learned_addr learned my addr 172.21.15.164:0/1544294613 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c5d0b20d0 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372b55e640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3724053400 tx=0x7f3724054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f360cff9640 1 -- 172.21.15.164:0/1544294613 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f372404b040 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f360cff9640 1 -- 172.21.15.164:0/1544294613 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3724031030 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c5d0b2360 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f360cff9640 1 -- 172.21.15.164:0/1544294613 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3724016910 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.141+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c5d0b2ef0 con 0x562c5d0783b0 2024-09-14T10:55:25.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.142+0000 7f360cff9640 1 -- 172.21.15.164:0/1544294613 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3724011330 con 0x562c5d0783b0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.142+0000 7f360cff9640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f35f403cdc0 0x7f35f403f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.142+0000 7f360cff9640 1 -- 172.21.15.164:0/1544294613 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f372400e040 con 0x562c5d0783b0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f35f403cdc0 0x7f35f403f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0bd870 0x562c5d0bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c0480 con 0x562c5d0bd870 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372a55c640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0bd870 0x562c5d0bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f35f403cdc0 0x7f35f403f280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f371c01af90 tx=0x7f371c046040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372a55c640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0bd870 0x562c5d0bfd30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 20 realm 2024-09-14T10:55:25.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.143+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c08b0 con 0x562c5d0bd870 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c1180 con 0x562c5d0bd870 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c1520 con 0x562c5d0bd870 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d0c2280 0x562c5d0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c4bb0 con 0x562c5d0c2280 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372b55e640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d0c2280 0x562c5d0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.144+0000 7f372b55e640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d0c2280 0x562c5d0c4670 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f372403e070 con 0x562c5d0c2280 2024-09-14T10:55:25.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372f128800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372f128800 20 searching for the correct realm 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f372403e070 con 0x562c5d0c2280 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372b55e640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3724014070 0x7f3724001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3724014070 0x7f3724001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.145+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3724014070 0x7f3724001770 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372ad5d640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f371c017050 0x7f371c00d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372a55c640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f371c017050 0x7f371c00d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372a55c640 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f371c017050 0x7f371c00d3d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.146+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.147+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372403e070 con 0x562c5d0c2280 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.148+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f372403e070 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.149+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.150+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.151+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.152+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0c2280 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x562c5d0bd870 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.153+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c6500 con 0x7f3724014070 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c5620 con 0x562c5d0bd870 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c5ec0 con 0x562c5d0bd870 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c5260 con 0x562c5d0bd870 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 zone default found 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 4 Realm: () 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 zonegroup default 2024-09-14T10:55:25.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.154+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c5af0 con 0x7f371c017050 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c88d0 con 0x562c5d0c2280 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c8f40 con 0x562c5d0c2280 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 started sync module instance, tier type = 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.155+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c7d40 con 0x7f3724014070 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.156+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.156+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748539648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c93a0 con 0x7f3724014070 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.156+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c9d60 con 0x562c5d0bd870 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.157+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94748539648144] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.158+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.158+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748539656368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c9cd0 con 0x562c5d0bd870 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.158+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cac20 con 0x562c5d0c2280 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.159+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.159+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748539660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cabd0 con 0x562c5d0c2280 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.159+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cbbc0 con 0x7f3724014070 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.159+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94748539656368] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.160+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94748539660144] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.160+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.160+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748539664016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cb010 con 0x7f3724014070 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.160+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cc5d0 con 0x562c5d0bd870 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.161+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94748539664016] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.161+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.161+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748539666720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cc9f0 con 0x562c5d0bd870 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.161+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cd2a0 con 0x7f371c017050 2024-09-14T10:55:25.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.162+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94748539666720] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.163+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.163+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748539667776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cce10 con 0x7f371c017050 2024-09-14T10:55:25.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.163+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cdcb0 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.164+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.164+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748539672576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0ce0d0 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.164+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cebd0 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94748539667776] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748539676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0ceb90 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94748539672576] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=0 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=1 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=2 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=3 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=4 2024-09-14T10:55:25.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=5 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.165+0000 7f372f128800 20 add_watcher() i=6 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94748539676352] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372f128800 20 add_watcher() i=7 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372f128800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0d1bc0 con 0x562c5d0bd870 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.166+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748539668832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cf040 con 0x562c5d0bd870 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.167+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94748539668832] v35'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f35e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 5 note: GC not initialized 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f355bfff640 20 reqs_thread_entry: start 2024-09-14T10:55:25.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 20 Filter name: none 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f3559ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.168+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562c5d1048d0 con 0x562c5d0bd870 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.169+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.169+0000 7f372f128800 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:55:25.179 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.169+0000 7f35e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.169+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748539668832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d1033e0 con 0x562c5d0bd870 2024-09-14T10:55:25.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.170+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94748539668832] v35'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.170+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748539648144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cc960 con 0x7f3724014070 2024-09-14T10:55:25.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.171+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94748539648144] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.171+0000 7f372f128800 20 remove_watcher() i=0 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.171+0000 7f372f128800 2 removed watcher, disabling cache 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.171+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748539656368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cc960 con 0x562c5d0bd870 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.172+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94748539656368] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.172+0000 7f372f128800 20 remove_watcher() i=1 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.172+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748539660144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c98b0 con 0x562c5d0c2280 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.173+0000 7f372b55e640 1 -- 172.21.15.164:0/1544294613 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94748539660144] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3724066040 con 0x562c5d0c2280 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.173+0000 7f372f128800 20 remove_watcher() i=2 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.173+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748539664016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0cc960 con 0x7f3724014070 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.174+0000 7f372ad5d640 1 -- 172.21.15.164:0/1544294613 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94748539664016] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f371c0187b0 con 0x7f3724014070 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.174+0000 7f372f128800 20 remove_watcher() i=3 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.174+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748539666720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0ca770 con 0x562c5d0bd870 2024-09-14T10:55:25.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.175+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94748539666720] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x562c5d0bd870 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.175+0000 7f372f128800 20 remove_watcher() i=4 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.175+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748539667776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c98b0 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.176+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94748539667776] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.176+0000 7f372f128800 20 remove_watcher() i=5 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.176+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748539672576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c98b0 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.177+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94748539672576] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.177+0000 7f372f128800 20 remove_watcher() i=6 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.177+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748539676352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562c5d0c98b0 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.178+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94748539676352] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3714051070 con 0x7f371c017050 2024-09-14T10:55:25.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.178+0000 7f372f128800 20 remove_watcher() i=7 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.178+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f371c017050 msgr2=0x7f371c00d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.178+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f371c017050 0x7f371c00d3d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0bd870 msgr2=0x562c5d0bfd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0bd870 0x562c5d0bfd30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3724014070 msgr2=0x7f3724001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3724014070 0x7f3724001770 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d0c2280 msgr2=0x562c5d0c4670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d0c2280 0x562c5d0c4670 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f35f403cdc0 msgr2=0x7f35f403f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f35f403cdc0 0x7f35f403f280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f371c01af90 tx=0x7f371c046040 comp rx=0 tx=0).stop 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 msgr2=0x562c5d0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372a55c640 1 -- 172.21.15.164:0/1544294613 reap_dead start 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3724053400 tx=0x7f3724054510 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 shutdown_connections 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/1544294613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d0783b0 0x562c5d0b1b70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 >> 172.21.15.164:0/1544294613 conn(0x562c5d0a46c0 msgr2=0x562c5d0a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 shutdown_connections 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/1544294613 wait complete. 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 msgr2=0x7f360403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 0x7f360403f2d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x562c5d0884e0 tx=0x7f371c04d040 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 msgr2=0x562c5d09bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x562c5d088440 tx=0x7f3724018830 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 shutdown_connections 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f360403ce10 0x7f360403f2d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 --2- 172.21.15.164:0/80689439 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5d09b820 0x562c5d09bc40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 >> 172.21.15.164:0/80689439 conn(0x562c5d08fbd0 msgr2=0x562c5d08ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 shutdown_connections 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.179+0000 7f372f128800 1 -- 172.21.15.164:0/80689439 wait complete. 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 msgr2=0x562c5d087b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 0x562c5d087b20 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 msgr2=0x562c5d08c780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 0x562c5d08c780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 msgr2=0x7f361003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 0x7f361003f320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3714057000 tx=0x7f3714052000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 msgr2=0x562c5d0804d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c010 tx=0x7f371c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 shutdown_connections 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562c5d08a390 0x562c5d08c780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562c5d0821e0 0x562c5d087b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f361003ce60 0x7f361003f320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 --2- 172.21.15.164:0/4154677737 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562c5cf8bb50 0x562c5d0804d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 >> 172.21.15.164:0/4154677737 conn(0x562c5cf82fb0 msgr2=0x562c5d0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 shutdown_connections 2024-09-14T10:55:25.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.180+0000 7f372f128800 1 -- 172.21.15.164:0/4154677737 wait complete. 2024-09-14T10:55:25.193 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-14T10:55:25.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-14T10:55:25.194 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-14T10:55:25.242 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.243 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.245+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.245+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f376a898800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562596d99fc0 0x562596d9c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f376a898800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562596d9c980 con 0x562596d07730 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f376a898800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x562596c1e7d0 con 0x562596d99fc0 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3767b81640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562596d99fc0 0x562596d9c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3768382640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x562596d07730 0x562596d988a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38634/0 (socket says 172.21.15.164:38634) 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3768382640 1 -- 172.21.15.164:0/2239659611 learned_addr learned my addr 172.21.15.164:0/2239659611 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3767380640 1 -- 172.21.15.164:0/2239659611 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906142460 0 0) 0x562596d9c980 con 0x562596d07730 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3767380640 1 -- 172.21.15.164:0/2239659611 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3750001e10 con 0x562596d07730 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3767b81640 1 -- 172.21.15.164:0/2239659611 >> v1:172.21.15.116:6789/0 conn(0x562596d07730 legacy=0x562596d988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.246+0000 7f3767b81640 1 -- 172.21.15.164:0/2239659611 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596d9db60 con 0x562596d99fc0 2024-09-14T10:55:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.248+0000 7f3767b81640 1 --2- 172.21.15.164:0/2239659611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d99fc0 0x562596d9c3b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a470 tx=0x7f375c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2ca1ca99b57d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.248+0000 7f3767380640 1 -- 172.21.15.164:0/2239659611 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c059070 con 0x562596d99fc0 2024-09-14T10:55:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.248+0000 7f3767380640 1 -- 172.21.15.164:0/2239659611 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c054570 con 0x562596d99fc0 2024-09-14T10:55:25.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.248+0000 7f3767380640 1 -- 172.21.15.164:0/2239659611 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375c054870 con 0x562596d99fc0 2024-09-14T10:55:25.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 -- 172.21.15.164:0/2239659611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d99fc0 msgr2=0x562596d9c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 --2- 172.21.15.164:0/2239659611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d99fc0 0x562596d9c3b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f375c00a470 tx=0x7f375c045920 comp rx=0 tx=0).stop 2024-09-14T10:55:25.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 -- 172.21.15.164:0/2239659611 shutdown_connections 2024-09-14T10:55:25.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 --2- 172.21.15.164:0/2239659611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d99fc0 0x562596d9c3b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 -- 172.21.15.164:0/2239659611 >> 172.21.15.164:0/2239659611 conn(0x562596d8dfd0 msgr2=0x562596d90410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 -- 172.21.15.164:0/2239659611 shutdown_connections 2024-09-14T10:55:25.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.249+0000 7f376a898800 1 -- 172.21.15.164:0/2239659611 wait complete. 2024-09-14T10:55:25.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f376a898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f376a898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562596c2bdd0 con 0x562596d07730 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f3768382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f3768382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33030/0 (socket says 172.21.15.164:33030) 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f3768382640 1 -- 172.21.15.164:0/999969626 learned_addr learned my addr 172.21.15.164:0/999969626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.263+0000 7f3768382640 1 -- 172.21.15.164:0/999969626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596e85ea0 con 0x562596d07730 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f3768382640 1 --2- 172.21.15.164:0/999969626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3758001e30 tx=0x7f375800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec9f4d91eae2fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f365660c640 1 -- 172.21.15.164:0/999969626 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3758012020 con 0x562596d07730 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f365660c640 1 -- 172.21.15.164:0/999969626 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375800e470 con 0x562596d07730 2024-09-14T10:55:25.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f365660c640 1 -- 172.21.15.164:0/999969626 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375800e790 con 0x562596d07730 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 -- 172.21.15.164:0/999969626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 msgr2=0x562596e858b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 --2- 172.21.15.164:0/999969626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3758001e30 tx=0x7f375800b780 comp rx=0 tx=0).stop 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 -- 172.21.15.164:0/999969626 shutdown_connections 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 --2- 172.21.15.164:0/999969626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e858b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 -- 172.21.15.164:0/999969626 >> 172.21.15.164:0/999969626 conn(0x562596d8dfd0 msgr2=0x562596e81230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 -- 172.21.15.164:0/999969626 shutdown_connections 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.264+0000 7f376a898800 1 -- 172.21.15.164:0/999969626 wait complete. 2024-09-14T10:55:25.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f376a898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f376a898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562596d9ce50 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f3768382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f3768382640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33032/0 (socket says 172.21.15.164:33032) 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f3768382640 1 -- 172.21.15.164:0/1371230538 learned_addr learned my addr 172.21.15.164:0/1371230538 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f3768382640 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596e8d950 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.265+0000 7f3768382640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x562596e86840 tx=0x7f37580040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f3654e09640 1 -- 172.21.15.164:0/1371230538 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3758012030 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f3654e09640 1 -- 172.21.15.164:0/1371230538 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375801a7a0 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f3654e09640 1 -- 172.21.15.164:0/1371230538 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375801aaa0 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562596e8dbe0 con 0x562596d07730 2024-09-14T10:55:25.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562596e8e5e0 con 0x562596d07730 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.266+0000 7f3654e09640 1 -- 172.21.15.164:0/1371230538 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3758015020 con 0x562596d07730 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3654e09640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 0x7f365003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3654e09640 1 -- 172.21.15.164:0/1371230538 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3758020070 con 0x562596d07730 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3767b81640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 0x7f365003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 0x562596e94a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596e94f80 con 0x562596d99fc0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3768b83640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 0x562596e94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3767b81640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 0x7f365003f2d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562596d06cb0 tx=0x7f375c050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.267+0000 7f3768b83640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 0x562596e94a40 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f3768b83640 1 -- 172.21.15.164:0/1371230538 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f376000a4d0 con 0x562596d99fc0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596e95320 con 0x562596d99fc0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f3768b83640 1 -- 172.21.15.164:0/1371230538 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f376000a4d0 con 0x562596d99fc0 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 0x562596e99290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596e99a20 con 0x562596e96e20 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f3768382640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 0x562596e99290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.268+0000 7f3768382640 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 0x562596e99290 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f3768382640 1 -- 172.21.15.164:0/1371230538 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3758018950 con 0x562596e96e20 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596e95b70 con 0x562596d99fc0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f3768b83640 1 -- 172.21.15.164:0/1371230538 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f376000a4d0 con 0x562596d99fc0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596e95fc0 con 0x562596d99fc0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f3768b83640 1 -- 172.21.15.164:0/1371230538 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f376000a4d0 con 0x562596d99fc0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.269+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f376a898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f376a898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562596c8a4a0 con 0x562596ea8400 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33046/0 (socket says 172.21.15.164:33046) 2024-09-14T10:55:25.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f3768b83640 1 -- 172.21.15.164:0/1484194978 learned_addr learned my addr 172.21.15.164:0/1484194978 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f3768b83640 1 -- 172.21.15.164:0/1484194978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596ea8e60 con 0x562596ea8400 2024-09-14T10:55:25.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.270+0000 7f3768b83640 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f376000a2a0 tx=0x7f3760018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f364dffb640 1 -- 172.21.15.164:0/1484194978 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760014450 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f364dffb640 1 -- 172.21.15.164:0/1484194978 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37600145f0 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562596ea9690 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f364dffb640 1 -- 172.21.15.164:0/1484194978 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760014910 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562596ea9c30 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.271+0000 7f364dffb640 1 -- 172.21.15.164:0/1484194978 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3760011040 con 0x562596ea8400 2024-09-14T10:55:25.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f364dffb640 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 0x7f364003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f364dffb640 1 -- 172.21.15.164:0/1484194978 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f376001e070 con 0x562596ea8400 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f3768382640 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 0x7f364003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f3768382640 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 0x7f364003f2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x562596e8f4d0 tx=0x7f3758052950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f376a898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f376a898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562596e862d0 con 0x562596eb4ea0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33054/0 (socket says 172.21.15.164:33054) 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.272+0000 7f3768b83640 1 -- 172.21.15.164:0/1661966900 learned_addr learned my addr 172.21.15.164:0/1661966900 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f3768b83640 1 -- 172.21.15.164:0/1661966900 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596eb5890 con 0x562596eb4ea0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f3768b83640 1 --2- 172.21.15.164:0/1661966900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3760016fd0 tx=0x7f3760011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285ce94b363f8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f36477fe640 1 -- 172.21.15.164:0/1661966900 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376004b070 con 0x562596eb4ea0 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f36477fe640 1 -- 172.21.15.164:0/1661966900 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760051070 con 0x562596eb4ea0 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f36477fe640 1 -- 172.21.15.164:0/1661966900 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3760011da0 con 0x562596eb4ea0 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 -- 172.21.15.164:0/1661966900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 msgr2=0x562596eb52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 --2- 172.21.15.164:0/1661966900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3760016fd0 tx=0x7f3760011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 -- 172.21.15.164:0/1661966900 shutdown_connections 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 --2- 172.21.15.164:0/1661966900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596eb52a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 -- 172.21.15.164:0/1661966900 >> 172.21.15.164:0/1661966900 conn(0x562596eb12a0 msgr2=0x562596eaf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 -- 172.21.15.164:0/1661966900 shutdown_connections 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.273+0000 7f376a898800 1 -- 172.21.15.164:0/1661966900 wait complete. 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f376a898800 1 Processor -- start 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f376a898800 1 -- start start 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f376a898800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f376a898800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562596eb5eb0 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3768b83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33068/0 (socket says 172.21.15.164:33068) 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 learned_addr learned my addr 172.21.15.164:0/1375081085 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562596ebc9c0 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3768b83640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37600014d0 tx=0x7f3760054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3645ffb640 1 -- 172.21.15.164:0/1375081085 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f376004b030 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3645ffb640 1 -- 172.21.15.164:0/1375081085 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3760011330 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562596ebcc50 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.274+0000 7f3645ffb640 1 -- 172.21.15.164:0/1375081085 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37600457a0 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.275+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562596ebd5d0 con 0x562596eb4ea0 2024-09-14T10:55:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.275+0000 7f3645ffb640 1 -- 172.21.15.164:0/1375081085 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3760045940 con 0x562596eb4ea0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.275+0000 7f3645ffb640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f363803ce60 0x7f363803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.275+0000 7f3645ffb640 1 -- 172.21.15.164:0/1375081085 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f376004c070 con 0x562596eb4ea0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f3768382640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f363803ce60 0x7f363803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f3768382640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f363803ce60 0x7f363803f320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3758052ce0 tx=0x7f3758046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596ec8180 0x562596eca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecad90 con 0x562596ec8180 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.276+0000 7f3767b81640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596ec8180 0x562596eca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f3767b81640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596ec8180 0x562596eca640 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 realm 2024-09-14T10:55:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecb160 con 0x562596ec8180 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecba30 con 0x562596ec8180 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.277+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecbdd0 con 0x562596ec8180 2024-09-14T10:55:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596eccb30 0x562596ecef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecf4e0 con 0x562596eccb30 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f3768b83640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596eccb30 0x562596ecef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f3768b83640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596eccb30 0x562596ecef20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 20 searching for the correct realm 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.278+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0df0 con 0x562596eccb30 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768b83640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3760014070 0x7f376003fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0df0 con 0x7f3760014070 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768382640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3760014070 0x7f376003fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768382640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3760014070 0x7f376003fa40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768382640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3758017050 0x7f3758042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.279+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0df0 con 0x7f3758017050 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3758017050 0x7f3758042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3758017050 0x7f3758042130 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0df0 con 0x562596ec8180 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.280+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0df0 con 0x562596ec8180 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3760014070 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.281+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.282+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3760014070 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.283+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.284+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3760014070 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x562596ec8180 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.285+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c061430 con 0x7f3758017050 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3760014070 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.286+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596eccb30 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3758017050 2024-09-14T10:55:25.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x562596ec8180 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f375c078040 con 0x7f3760014070 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.287+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ecfed0 con 0x562596ec8180 2024-09-14T10:55:25.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed0770 con 0x562596ec8180 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed1270 con 0x562596ec8180 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 zone default found 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 4 Realm: () 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 zonegroup default 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed1270 con 0x7f3758017050 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.288+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed3050 con 0x562596eccb30 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed3530 con 0x562596eccb30 2024-09-14T10:55:25.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 20 started sync module instance, tier type = 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.289+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed24f0 con 0x7f3760014070 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.290+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.290+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94719445903584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed2150 con 0x7f3760014070 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.290+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed4460 con 0x562596ec8180 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.291+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94719445903584] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.292+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.292+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94719445909424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed4880 con 0x562596ec8180 2024-09-14T10:55:25.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.292+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed5240 con 0x562596eccb30 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.293+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.293+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94719445912976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed56c0 con 0x562596eccb30 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.293+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed61e0 con 0x7f3760014070 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.293+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94719445909424] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.294+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.294+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94719445916848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed6580 con 0x7f3760014070 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.294+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed7000 con 0x562596ec8180 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.294+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94719445912976] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.295+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.295+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94719445920496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed73f0 con 0x562596ec8180 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.295+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed7e10 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.295+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94719445916848] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.296+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94719445920496] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.296+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.296+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94719445914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed43d0 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.296+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed83f0 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.297+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94719445914032] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.297+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.297+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94719445924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed83f0 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.297+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed8ce0 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94719445926896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed8810 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=0 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=1 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=2 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=3 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=4 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=5 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94719445924096] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.298+0000 7f376a898800 20 add_watcher() i=6 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.299+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94719445926896] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.299+0000 7f376a898800 20 add_watcher() i=7 2024-09-14T10:55:25.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.299+0000 7f376a898800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.299+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596ed7f40 con 0x562596ec8180 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.300+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.300+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94719445930112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596ed7f40 con 0x562596ec8180 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94719445930112] v35'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f361e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 5 note: GC not initialized 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f361d7e2640 20 reqs_thread_entry: start 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 20 Filter name: none 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f358effd640 20 reqs_thread_entry: start 2024-09-14T10:55:25.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.301+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596f0f4a0 con 0x562596ec8180 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596f10010 con 0x7f3760014070 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-14T10:55:25.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.302+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f15e60 con 0x562596ec8180 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f376a898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f376a898800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f376a898800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94719446177856 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596f12900 con 0x562596ec8180 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94719445920496 notify 150323855367 ret 0) ==== 891+0+0 (crc 0 0 0) 0x562596d9db60 con 0x562596ec8180 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f36477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94719445920496 notifier 4402 bl.length()=849 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f36477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f36477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(65 notify.4 [notify cookie 94719446177856 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.303+0000 7f36477fe640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f362c003ea0 con 0x562596ec8180 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.304+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.304+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94719446177856 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f375c061ab0 con 0x562596ec8180 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.304+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f15840 con 0x7f3760014070 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f376a898800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f376a898800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f376a898800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94719446177856 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562596f10430 con 0x7f3760014070 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== watch-notify(notify (1) cookie 94719445903584 notify 150323855363 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f375805c060 con 0x7f3760014070 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f36477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94719445903584 notifier 4402 bl.length()=166 2024-09-14T10:55:25.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f36477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f36477fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(68 notify.0 [notify cookie 94719446177856 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f36477fe640 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f362c003ea0 con 0x7f3760014070 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.305+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== watch-notify(notify_complete (2) cookie 94719446177856 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562596e8e5e0 con 0x7f3760014070 2024-09-14T10:55:25.319 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:55:25.303303Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.306+0000 7f361e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.306+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94719445930112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x562596ec8180 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.307+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94719445930112] v35'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.307+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94719445903584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x7f3760014070 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.308+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94719445903584] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.308+0000 7f376a898800 20 remove_watcher() i=0 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.308+0000 7f376a898800 2 removed watcher, disabling cache 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.308+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94719445909424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x562596ec8180 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.309+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94719445909424] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.309+0000 7f376a898800 20 remove_watcher() i=1 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.309+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94719445912976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x562596eccb30 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.310+0000 7f3768b83640 1 -- 172.21.15.164:0/1375081085 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94719445912976] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f376002a070 con 0x562596eccb30 2024-09-14T10:55:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.310+0000 7f376a898800 20 remove_watcher() i=2 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.310+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94719445916848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x7f3760014070 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.311+0000 7f3768382640 1 -- 172.21.15.164:0/1375081085 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94719445916848] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3758018950 con 0x7f3760014070 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.311+0000 7f376a898800 20 remove_watcher() i=3 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.311+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94719445920496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x562596ec8180 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.312+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94719445920496] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x562596ec8180 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.312+0000 7f376a898800 20 remove_watcher() i=4 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.312+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94719445914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x7f3758017050 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.313+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94719445914032] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.313+0000 7f376a898800 20 remove_watcher() i=5 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.313+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94719445924096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x7f3758017050 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.314+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94719445924096] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.314+0000 7f376a898800 20 remove_watcher() i=6 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.314+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94719445926896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562596f0d210 con 0x7f3758017050 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94719445926896] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f375c081040 con 0x7f3758017050 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 20 remove_watcher() i=7 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3758017050 msgr2=0x7f3758042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3758017050 0x7f3758042130 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596ec8180 msgr2=0x562596eca640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596ec8180 0x562596eca640 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3760014070 msgr2=0x7f376003fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3760014070 0x7f376003fa40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596eccb30 msgr2=0x562596ecef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596eccb30 0x562596ecef20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f363803ce60 msgr2=0x7f363803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f363803ce60 0x7f363803f320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3758052ce0 tx=0x7f3758046000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 msgr2=0x562596ebc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f3767b81640 1 -- 172.21.15.164:0/1375081085 reap_dead start 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.315+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37600014d0 tx=0x7f3760054560 comp rx=0 tx=0).stop 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 shutdown_connections 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1375081085 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596eb4ea0 0x562596ebc460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 >> 172.21.15.164:0/1375081085 conn(0x562596eb12a0 msgr2=0x562596eaf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 shutdown_connections 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1375081085 wait complete. 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 msgr2=0x7f364003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 0x7f364003f2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x562596e8f4d0 tx=0x7f3758052950 comp rx=0 tx=0).stop 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 msgr2=0x562596ea8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f376000a2a0 tx=0x7f3760018830 comp rx=0 tx=0).stop 2024-09-14T10:55:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 shutdown_connections 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f364003ce10 0x7f364003f2d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1484194978 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596ea8400 0x562596ea8820 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 >> 172.21.15.164:0/1484194978 conn(0x562596e9c7b0 msgr2=0x562596e9cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 shutdown_connections 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1484194978 wait complete. 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 msgr2=0x562596e94a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 0x562596e94a40 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 msgr2=0x562596e99290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 0x562596e99290 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 msgr2=0x7f365003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 0x7f365003f2d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562596d06cb0 tx=0x7f375c050000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 msgr2=0x562596e8d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.316+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x562596e86840 tx=0x7f37580040e0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 shutdown_connections 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562596e96e20 0x562596e99290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562596d99fc0 0x562596e94a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f365003ce10 0x7f365003f2d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 --2- 172.21.15.164:0/1371230538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562596d07730 0x562596e8d3f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 >> 172.21.15.164:0/1371230538 conn(0x562596d8dfd0 msgr2=0x562596e86da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 shutdown_connections 2024-09-14T10:55:25.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.317+0000 7f376a898800 1 -- 172.21.15.164:0/1371230538 wait complete. 2024-09-14T10:55:25.331 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:55:25.303303Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:55:25.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:55:25.331 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:55:25.376 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.376 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.379+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.379+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.379+0000 7f3e4650c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5576e4ed66f0 0x5576e4f678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.379+0000 7f3e4650c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576e4f6b8f0 con 0x5576e4f67de0 2024-09-14T10:55:25.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.379+0000 7f3e4650c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5576e4ded7d0 con 0x5576e4ed66f0 2024-09-14T10:55:25.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e43ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5576e4ed66f0 0x5576e4f678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e437fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5576e4f67de0 0x5576e4f6a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38638/0 (socket says 172.21.15.164:38638) 2024-09-14T10:55:25.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e43ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5576e4ed66f0 0x5576e4f678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33072/0 (socket says 172.21.15.164:33072) 2024-09-14T10:55:25.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e437fc640 1 -- 172.21.15.164:0/650544511 learned_addr learned my addr 172.21.15.164:0/650544511 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:25.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e42ffb640 1 -- 172.21.15.164:0/650544511 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396452288 0 0) 0x5576e4f6b8f0 con 0x5576e4f67de0 2024-09-14T10:55:25.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e42ffb640 1 -- 172.21.15.164:0/650544511 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e30001e10 con 0x5576e4f67de0 2024-09-14T10:55:25.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e43ffd640 1 -- 172.21.15.164:0/650544511 >> v1:172.21.15.116:6789/0 conn(0x5576e4f67de0 legacy=0x5576e4f6a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.380+0000 7f3e43ffd640 1 -- 172.21.15.164:0/650544511 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e4f6cb20 con 0x5576e4ed66f0 2024-09-14T10:55:25.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/650544511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e4f678a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166da3e0968d990d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e42ffb640 1 -- 172.21.15.164:0/650544511 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c055070 con 0x5576e4ed66f0 2024-09-14T10:55:25.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e42ffb640 1 -- 172.21.15.164:0/650544511 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c051540 con 0x5576e4ed66f0 2024-09-14T10:55:25.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e42ffb640 1 -- 172.21.15.164:0/650544511 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c051840 con 0x5576e4ed66f0 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 -- 172.21.15.164:0/650544511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 msgr2=0x5576e4f678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 --2- 172.21.15.164:0/650544511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e4f678a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c045b30 comp rx=0 tx=0).stop 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 -- 172.21.15.164:0/650544511 shutdown_connections 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 --2- 172.21.15.164:0/650544511 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e4f678a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 -- 172.21.15.164:0/650544511 >> 172.21.15.164:0/650544511 conn(0x5576e4f5cfb0 msgr2=0x5576e4f5f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 -- 172.21.15.164:0/650544511 shutdown_connections 2024-09-14T10:55:25.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.382+0000 7f3e4650c800 1 -- 172.21.15.164:0/650544511 wait complete. 2024-09-14T10:55:25.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.396+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.396+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.396+0000 7f3e4650c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.396+0000 7f3e4650c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5576e4dfadd0 con 0x5576e4ed66f0 2024-09-14T10:55:25.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3e43ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3e43ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33088/0 (socket says 172.21.15.164:33088) 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3e43ffd640 1 -- 172.21.15.164:0/309700214 learned_addr learned my addr 172.21.15.164:0/309700214 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3e43ffd640 1 -- 172.21.15.164:0/309700214 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e5054da0 con 0x5576e4ed66f0 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/309700214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db64d11402251d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3d31e0b640 1 -- 172.21.15.164:0/309700214 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c069070 con 0x5576e4ed66f0 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3d31e0b640 1 -- 172.21.15.164:0/309700214 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c0518e0 con 0x5576e4ed66f0 2024-09-14T10:55:25.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.397+0000 7f3d31e0b640 1 -- 172.21.15.164:0/309700214 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c055040 con 0x5576e4ed66f0 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- 172.21.15.164:0/309700214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 msgr2=0x5576e50547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 --2- 172.21.15.164:0/309700214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c051000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- 172.21.15.164:0/309700214 shutdown_connections 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 --2- 172.21.15.164:0/309700214 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e50547b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- 172.21.15.164:0/309700214 >> 172.21.15.164:0/309700214 conn(0x5576e4f5cfb0 msgr2=0x5576e5050130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- 172.21.15.164:0/309700214 shutdown_connections 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- 172.21.15.164:0/309700214 wait complete. 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.398+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e4650c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e4650c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5576e4f6bdc0 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e43ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e43ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33096/0 (socket says 172.21.15.164:33096) 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3248634949 learned_addr learned my addr 172.21.15.164:0/3248634949 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e505c7c0 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3d2bfff640 1 -- 172.21.15.164:0/3248634949 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c069040 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3d2bfff640 1 -- 172.21.15.164:0/3248634949 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c072070 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576e505ca50 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.399+0000 7f3d2bfff640 1 -- 172.21.15.164:0/3248634949 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3c055040 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.400+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e505d3d0 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.400+0000 7f3d2bfff640 1 -- 172.21.15.164:0/3248634949 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3e3c058070 con 0x5576e4ed66f0 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3d2bfff640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 0x7f3d2c03f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3d2bfff640 1 -- 172.21.15.164:0/3248634949 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3e3c061030 con 0x5576e4ed66f0 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 0x7f3d2c03f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 0x5576e50638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e5063df0 con 0x5576e4f67de0 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 0x5576e50638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 0x7f3d2c03f370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001db0 tx=0x7f3e2c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 0x5576e50638b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e447fe640 1 -- 172.21.15.164:0/3248634949 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e4f67de0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.401+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e5064190 con 0x5576e4f67de0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e447fe640 1 -- 172.21.15.164:0/3248634949 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e4f67de0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 0x5576e50680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e5068840 con 0x5576e5065c10 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 0x5576e50680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 0x5576e50680b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.402+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3248634949 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3e3c057030 con 0x5576e5065c10 2024-09-14T10:55:25.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50649e0 con 0x5576e4f67de0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e447fe640 1 -- 172.21.15.164:0/3248634949 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e4f67de0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e5064d80 con 0x5576e4f67de0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e447fe640 1 -- 172.21.15.164:0/3248634949 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e4f67de0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.403+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e4650c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e4650c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5576e4e594a0 con 0x5576e5077250 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33110/0 (socket says 172.21.15.164:33110) 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e447fe640 1 -- 172.21.15.164:0/571072759 learned_addr learned my addr 172.21.15.164:0/571072759 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e447fe640 1 -- 172.21.15.164:0/571072759 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e5077cb0 con 0x5576e5077250 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e447fe640 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5576e505e130 tx=0x7f3e3400af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3d297fa640 1 -- 172.21.15.164:0/571072759 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34007d60 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3d297fa640 1 -- 172.21.15.164:0/571072759 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3401e020 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576e50784e0 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3d297fa640 1 -- 172.21.15.164:0/571072759 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34019590 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.404+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e5078a80 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.405+0000 7f3d297fa640 1 -- 172.21.15.164:0/571072759 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3e34016040 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.405+0000 7f3d297fa640 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 0x7f3d1c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3d297fa640 1 -- 172.21.15.164:0/571072759 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3e3401f030 con 0x5576e5077250 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 0x7f3d1c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 0x7f3d1c03f2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0960a0 tx=0x7f3e3c06c470 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e4650c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e4650c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5576e5055110 con 0x5576e5083c70 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33112/0 (socket says 172.21.15.164:33112) 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e447fe640 1 -- 172.21.15.164:0/1036218961 learned_addr learned my addr 172.21.15.164:0/1036218961 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.406+0000 7f3e447fe640 1 -- 172.21.15.164:0/1036218961 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e5084660 con 0x5576e5083c70 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e447fe640 1 --2- 172.21.15.164:0/1036218961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e34054440 tx=0x7f3e34045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebb0dcbba23dfbe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3d22ffd640 1 -- 172.21.15.164:0/1036218961 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3401d040 con 0x5576e5083c70 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3d22ffd640 1 -- 172.21.15.164:0/1036218961 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3404b070 con 0x5576e5083c70 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3d22ffd640 1 -- 172.21.15.164:0/1036218961 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e340183b0 con 0x5576e5083c70 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 -- 172.21.15.164:0/1036218961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 msgr2=0x5576e5084070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 --2- 172.21.15.164:0/1036218961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e34054440 tx=0x7f3e34045490 comp rx=0 tx=0).stop 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 -- 172.21.15.164:0/1036218961 shutdown_connections 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 --2- 172.21.15.164:0/1036218961 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e5084070 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 -- 172.21.15.164:0/1036218961 >> 172.21.15.164:0/1036218961 conn(0x5576e5080070 msgr2=0x5576e507e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 -- 172.21.15.164:0/1036218961 shutdown_connections 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.407+0000 7f3e4650c800 1 -- 172.21.15.164:0/1036218961 wait complete. 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e4650c800 1 Processor -- start 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e4650c800 1 -- start start 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e4650c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e4650c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5576e5084c80 con 0x5576e5083c70 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e447fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33120/0 (socket says 172.21.15.164:33120) 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 learned_addr learned my addr 172.21.15.164:0/3391626210 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e508b7a0 con 0x5576e5083c70 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.408+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3e34014ca0 tx=0x7f3e340543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3d217fa640 1 -- 172.21.15.164:0/3391626210 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e3401d070 con 0x5576e5083c70 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3d217fa640 1 -- 172.21.15.164:0/3391626210 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e340173b0 con 0x5576e5083c70 2024-09-14T10:55:25.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576e508ba30 con 0x5576e5083c70 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3d217fa640 1 -- 172.21.15.164:0/3391626210 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34016330 con 0x5576e5083c70 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e508c5c0 con 0x5576e5083c70 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3d217fa640 1 -- 172.21.15.164:0/3391626210 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3e340164d0 con 0x5576e5083c70 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.409+0000 7f3d217fa640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d0c03ce60 0x7f3d0c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3d217fa640 1 -- 172.21.15.164:0/3391626210 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3e34033030 con 0x5576e5083c70 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d0c03ce60 0x7f3d0c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e5096d90 0x5576e5099250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50999a0 con 0x5576e5096d90 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e5096d90 0x5576e5099250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d0c03ce60 0x7f3d0c03f320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c059940 tx=0x7f3e3c089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.410+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e5096d90 0x5576e5099250 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2c009050 con 0x5576e5096d90 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 realm 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50960e0 con 0x5576e5096d90 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2c009050 con 0x5576e5096d90 2024-09-14T10:55:25.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509a480 con 0x5576e5096d90 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2c009050 con 0x5576e5096d90 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509ad50 con 0x5576e5096d90 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3e2c009050 con 0x5576e5096d90 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e509b690 0x5576e509da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509e1c0 con 0x5576e509b690 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.411+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e509b690 0x5576e509da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e509b690 0x5576e509da80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e4650c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e4650c800 20 searching for the correct realm 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e447fe640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3e34019040 0x7f3e3401ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.412+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3e34019040 0x7f3e3401ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3e34019040 0x7f3e3401ba80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e43ffd640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3e3c0a4040 0x7f3e3c080740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3e3c0a4040 0x7f3e3c080740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.413+0000 7f3e437fc640 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3e3c0a4040 0x7f3e3c080740 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c009050 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c009050 con 0x5576e5096d90 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.414+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.415+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.416+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.417+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.418+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.419+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e509b690 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e3c0a4040 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.420+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x5576e5096d90 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5576e509fb80 con 0x7f3e34019040 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509ec70 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509f510 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509e8b0 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 zone default found 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 4 Realm: () 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 zonegroup default 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.421+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e509f0f0 con 0x7f3e3c0a4040 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a1f20 con 0x5576e509b690 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a2400 con 0x5576e509b690 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 started sync module instance, tier type = 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.422+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a13c0 con 0x7f3e34019040 2024-09-14T10:55:25.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.423+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.423+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969137143568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a2860 con 0x7f3e34019040 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.423+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a30b0 con 0x5576e5096d90 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.424+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969137143568] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.424+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.424+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969137150976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a34d0 con 0x5576e5096d90 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.424+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a3e90 con 0x5576e509b690 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.425+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969137150976] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.425+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.425+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969137152512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a3e90 con 0x5576e509b690 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.426+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a4850 con 0x7f3e34019040 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.426+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969137152512] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.427+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.427+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969137154528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a3e00 con 0x7f3e34019040 2024-09-14T10:55:25.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.427+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a5710 con 0x5576e5096d90 2024-09-14T10:55:25.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.428+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969137154528] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.428+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.428+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969137159232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a5710 con 0x5576e5096d90 2024-09-14T10:55:25.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.428+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a6190 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.429+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.429+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969137159232] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.429+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969137163424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a65d0 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.429+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a6b90 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.430+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969137163424] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.430+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.430+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969137160800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a6b90 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.430+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a75a0 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969137160800] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969137168624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a79c0 con 0x7f3e3c0a4040 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=0 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=1 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=2 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=3 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=4 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=5 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.431+0000 7f3e4650c800 20 add_watcher() i=6 2024-09-14T10:55:25.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969137168624] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e4650c800 20 add_watcher() i=7 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e4650c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a79c0 con 0x5576e5096d90 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.432+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969137169680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a7930 con 0x5576e5096d90 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969137169680] v35'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3e4650c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3e4650c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3e4650c800 5 note: GC not initialized 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.433+0000 7f3cf8fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e4650c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e4650c800 20 Filter name: none 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3c727fc640 20 reqs_thread_entry: start 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e4650c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5576e50dd720 con 0x5576e5096d90 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.434+0000 7f3e4650c800 20 rados_obj.operate() r=0 bl.length=673 2024-09-14T10:55:25.445 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:55:25.303303Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.435+0000 7f3cf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.435+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969137169680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50ddb00 con 0x5576e5096d90 2024-09-14T10:55:25.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.436+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93969137169680] v35'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.436+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969137143568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50ddb00 con 0x7f3e34019040 2024-09-14T10:55:25.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.437+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93969137143568] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.437+0000 7f3e4650c800 20 remove_watcher() i=0 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.437+0000 7f3e4650c800 2 removed watcher, disabling cache 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.437+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969137150976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a0f10 con 0x5576e5096d90 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.438+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93969137150976] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.438+0000 7f3e4650c800 20 remove_watcher() i=1 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.438+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969137152512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a0f10 con 0x5576e509b690 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.439+0000 7f3e447fe640 1 -- 172.21.15.164:0/3391626210 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93969137152512] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e340083e0 con 0x5576e509b690 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.439+0000 7f3e4650c800 20 remove_watcher() i=2 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.439+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969137154528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a3200 con 0x7f3e34019040 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.440+0000 7f3e43ffd640 1 -- 172.21.15.164:0/3391626210 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93969137154528] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e3c057030 con 0x7f3e34019040 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.440+0000 7f3e4650c800 20 remove_watcher() i=3 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.440+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969137159232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a0f10 con 0x5576e5096d90 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.441+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93969137159232] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x5576e5096d90 2024-09-14T10:55:25.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.441+0000 7f3e4650c800 20 remove_watcher() i=4 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.441+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969137163424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a39e0 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.442+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93969137163424] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.442+0000 7f3e4650c800 20 remove_watcher() i=5 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.442+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969137160800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a4c40 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.443+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93969137160800] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.443+0000 7f3e4650c800 20 remove_watcher() i=6 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.443+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969137168624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5576e50a4c40 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93969137168624] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3e2c029040 con 0x7f3e3c0a4040 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 20 remove_watcher() i=7 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3e3c0a4040 msgr2=0x7f3e3c080740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3e3c0a4040 0x7f3e3c080740 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e5096d90 msgr2=0x5576e5099250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e5096d90 0x5576e5099250 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3e34019040 msgr2=0x7f3e3401ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3e34019040 0x7f3e3401ba80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e509b690 msgr2=0x5576e509da80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e509b690 0x5576e509da80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d0c03ce60 msgr2=0x7f3d0c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d0c03ce60 0x7f3d0c03f320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c059940 tx=0x7f3e3c089000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 msgr2=0x5576e508b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e437fc640 1 -- 172.21.15.164:0/3391626210 reap_dead start 2024-09-14T10:55:25.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3e34014ca0 tx=0x7f3e340543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 shutdown_connections 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3391626210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5083c70 0x5576e508b240 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 >> 172.21.15.164:0/3391626210 conn(0x5576e5080070 msgr2=0x5576e507e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 shutdown_connections 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/3391626210 wait complete. 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 msgr2=0x7f3d1c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 0x7f3d1c03f2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0960a0 tx=0x7f3e3c06c470 comp rx=0 tx=0).stop 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 msgr2=0x5576e5077670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.444+0000 7f3e4650c800 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5576e505e130 tx=0x7f3e3400af20 comp rx=0 tx=0).stop 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 shutdown_connections 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d1c03ce10 0x7f3d1c03f2d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/571072759 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e5077250 0x5576e5077670 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 >> 172.21.15.164:0/571072759 conn(0x5576e506b600 msgr2=0x5576e506b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 shutdown_connections 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/571072759 wait complete. 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 msgr2=0x5576e50638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 0x5576e50638b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 msgr2=0x5576e50680b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 0x5576e50680b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 msgr2=0x7f3d2c03f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 0x7f3d2c03f370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001db0 tx=0x7f3e2c001310 comp rx=0 tx=0).stop 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 msgr2=0x5576e505c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c005fd0 tx=0x7f3e3c003330 comp rx=0 tx=0).stop 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 shutdown_connections 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5576e5065c10 0x5576e50680b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5576e4f67de0 0x5576e50638b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3d2c03ceb0 0x7f3d2c03f370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 --2- 172.21.15.164:0/3248634949 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5576e4ed66f0 0x5576e505c260 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 >> 172.21.15.164:0/3248634949 conn(0x5576e4f5cfb0 msgr2=0x5576e5055ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 shutdown_connections 2024-09-14T10:55:25.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.445+0000 7f3e4650c800 1 -- 172.21.15.164:0/3248634949 wait complete. 2024-09-14T10:55:25.457 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:55:25.303303Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.457 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-14T10:55:25.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-14T10:55:25.458 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-14T10:55:25.504 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.504 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f0024930800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f0e877abd0 0x55f0e877d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f0024930800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0e877d6f0 con 0x55f0e86ea030 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f0024930800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55f0e86017d0 con 0x55f0e877abd0 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f001feaf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f0e877abd0 0x55f0e877d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f001feaf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f0e877abd0 0x55f0e877d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33136/0 (socket says 172.21.15.164:33136) 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f001feaf640 1 -- 172.21.15.164:0/1092113176 learned_addr learned my addr 172.21.15.164:0/1092113176 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.507+0000 7f00206b0640 1 --1- 172.21.15.164:0/1092113176 >> v1:172.21.15.116:6789/0 conn(0x55f0e86ea030 0x55f0e87793f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38650/0 (socket says 172.21.15.164:38650) 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.508+0000 7f001feaf640 1 -- 172.21.15.164:0/1092113176 >> v1:172.21.15.116:6789/0 conn(0x55f0e86ea030 legacy=0x55f0e87793f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.508+0000 7f001feaf640 1 -- 172.21.15.164:0/1092113176 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e877e920 con 0x55f0e877abd0 2024-09-14T10:55:25.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.509+0000 7f001feaf640 1 --2- 172.21.15.164:0/1092113176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e877abd0 0x55f0e877d070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f001400a520 tx=0x7f0014045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d573be33f10b5d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f001f6ae640 1 -- 172.21.15.164:0/1092113176 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0014055070 con 0x55f0e877abd0 2024-09-14T10:55:25.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f001f6ae640 1 -- 172.21.15.164:0/1092113176 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00140515b0 con 0x55f0e877abd0 2024-09-14T10:55:25.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f001f6ae640 1 -- 172.21.15.164:0/1092113176 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00140518d0 con 0x55f0e877abd0 2024-09-14T10:55:25.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 -- 172.21.15.164:0/1092113176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e877abd0 msgr2=0x55f0e877d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 --2- 172.21.15.164:0/1092113176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e877abd0 0x55f0e877d070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f001400a520 tx=0x7f0014045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 -- 172.21.15.164:0/1092113176 shutdown_connections 2024-09-14T10:55:25.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 --2- 172.21.15.164:0/1092113176 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e877abd0 0x55f0e877d070 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 -- 172.21.15.164:0/1092113176 >> 172.21.15.164:0/1092113176 conn(0x55f0e8770fa0 msgr2=0x55f0e8773400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 -- 172.21.15.164:0/1092113176 shutdown_connections 2024-09-14T10:55:25.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.510+0000 7f0024930800 1 -- 172.21.15.164:0/1092113176 wait complete. 2024-09-14T10:55:25.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.524+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.524+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.524+0000 7f0024930800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.524+0000 7f0024930800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0e860edd0 con 0x55f0e86ea030 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7f00206b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7f00206b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33140/0 (socket says 172.21.15.164:33140) 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7f00206b0640 1 -- 172.21.15.164:0/3010883410 learned_addr learned my addr 172.21.15.164:0/3010883410 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7f00206b0640 1 -- 172.21.15.164:0/3010883410 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e8866df0 con 0x55f0e86ea030 2024-09-14T10:55:25.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7f00206b0640 1 --2- 172.21.15.164:0/3010883410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f001000b260 tx=0x7f001000b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf43792f70a017f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7eff0e60c640 1 -- 172.21.15.164:0/3010883410 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001000be60 con 0x55f0e86ea030 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7eff0e60c640 1 -- 172.21.15.164:0/3010883410 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010006070 con 0x55f0e86ea030 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.525+0000 7eff0e60c640 1 -- 172.21.15.164:0/3010883410 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001000e710 con 0x55f0e86ea030 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- 172.21.15.164:0/3010883410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 msgr2=0x55f0e8866800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 --2- 172.21.15.164:0/3010883410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f001000b260 tx=0x7f001000b660 comp rx=0 tx=0).stop 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- 172.21.15.164:0/3010883410 shutdown_connections 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 --2- 172.21.15.164:0/3010883410 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e8866800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- 172.21.15.164:0/3010883410 >> 172.21.15.164:0/3010883410 conn(0x55f0e8770fa0 msgr2=0x55f0e8862180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- 172.21.15.164:0/3010883410 shutdown_connections 2024-09-14T10:55:25.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- 172.21.15.164:0/3010883410 wait complete. 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.526+0000 7f0024930800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0e877dbc0 con 0x55f0e86ea030 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f00206b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f00206b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33156/0 (socket says 172.21.15.164:33156) 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f00206b0640 1 -- 172.21.15.164:0/1178275114 learned_addr learned my addr 172.21.15.164:0/1178275114 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f00206b0640 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e886e8b0 con 0x55f0e86ea030 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f00206b0640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55f0e8867790 tx=0x7f0010000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7eff0ce09640 1 -- 172.21.15.164:0/1178275114 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001000ee10 con 0x55f0e86ea030 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7eff0ce09640 1 -- 172.21.15.164:0/1178275114 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001000fa30 con 0x55f0e86ea030 2024-09-14T10:55:25.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e886eb40 con 0x55f0e86ea030 2024-09-14T10:55:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7eff0ce09640 1 -- 172.21.15.164:0/1178275114 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001000fd30 con 0x55f0e86ea030 2024-09-14T10:55:25.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.527+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e886f540 con 0x55f0e86ea030 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.528+0000 7eff0ce09640 1 -- 172.21.15.164:0/1178275114 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0010017070 con 0x55f0e86ea030 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.528+0000 7eff0ce09640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 0x7eff0803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.528+0000 7eff0ce09640 1 -- 172.21.15.164:0/1178275114 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0010015020 con 0x55f0e86ea030 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.528+0000 7f001feaf640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 0x7eff0803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 0x55f0e88759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e8875ee0 con 0x55f0e877abd0 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0020eb1640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 0x55f0e88759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f001feaf640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 0x7eff0803f2d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0014057000 tx=0x7f0014052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0020eb1640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 0x55f0e88759a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0020eb1640 1 -- 172.21.15.164:0/1178275114 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f001800a4d0 con 0x55f0e877abd0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e8876280 con 0x55f0e877abd0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0020eb1640 1 -- 172.21.15.164:0/1178275114 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f001800a4d0 con 0x55f0e877abd0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.529+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 0x55f0e887a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e887a990 con 0x55f0e8877d80 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f00206b0640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 0x55f0e887a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f00206b0640 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 0x55f0e887a200 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f00206b0640 1 -- 172.21.15.164:0/1178275114 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f001002e070 con 0x55f0e8877d80 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e8876ad0 con 0x55f0e877abd0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f0020eb1640 1 -- 172.21.15.164:0/1178275114 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f001800a4d0 con 0x55f0e877abd0 2024-09-14T10:55:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.530+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e8876f20 con 0x55f0e877abd0 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0020eb1640 1 -- 172.21.15.164:0/1178275114 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f001800a4d0 con 0x55f0e877abd0 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0024930800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0024930800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0e866d4a0 con 0x55f0e8889370 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.531+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33162/0 (socket says 172.21.15.164:33162) 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0020eb1640 1 -- 172.21.15.164:0/2990916837 learned_addr learned my addr 172.21.15.164:0/2990916837 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0020eb1640 1 -- 172.21.15.164:0/2990916837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e8889dd0 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0020eb1640 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f001800a2a0 tx=0x7f0018018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7eff05ffb640 1 -- 172.21.15.164:0/2990916837 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0018014450 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7eff05ffb640 1 -- 172.21.15.164:0/2990916837 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00180145f0 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e888a600 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7eff05ffb640 1 -- 172.21.15.164:0/2990916837 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0018014910 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.532+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e888aba0 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.533+0000 7eff05ffb640 1 -- 172.21.15.164:0/2990916837 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0018011040 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.533+0000 7eff05ffb640 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 0x7efef803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.533+0000 7eff05ffb640 1 -- 172.21.15.164:0/2990916837 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f001801e070 con 0x55f0e8889370 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.533+0000 7f00206b0640 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 0x7efef803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f00206b0640 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 0x7efef803f2d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f0e8870440 tx=0x7f001000ff50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0024930800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0024930800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0e8867220 con 0x55f0e8895df0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33176/0 (socket says 172.21.15.164:33176) 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0020eb1640 1 -- 172.21.15.164:0/28172218 learned_addr learned my addr 172.21.15.164:0/28172218 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.534+0000 7f0020eb1640 1 -- 172.21.15.164:0/28172218 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e88967e0 con 0x55f0e8895df0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0020eb1640 1 --2- 172.21.15.164:0/28172218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0018016fd0 tx=0x7f0018011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39211b07f467a636 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7efeff7fe640 1 -- 172.21.15.164:0/28172218 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001804b070 con 0x55f0e8895df0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7efeff7fe640 1 -- 172.21.15.164:0/28172218 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0018051070 con 0x55f0e8895df0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7efeff7fe640 1 -- 172.21.15.164:0/28172218 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0018011da0 con 0x55f0e8895df0 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 -- 172.21.15.164:0/28172218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 msgr2=0x55f0e88961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 --2- 172.21.15.164:0/28172218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0018016fd0 tx=0x7f0018011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:25.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 -- 172.21.15.164:0/28172218 shutdown_connections 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 --2- 172.21.15.164:0/28172218 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e88961f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 -- 172.21.15.164:0/28172218 >> 172.21.15.164:0/28172218 conn(0x55f0e8892210 msgr2=0x55f0e8890450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 -- 172.21.15.164:0/28172218 shutdown_connections 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 -- 172.21.15.164:0/28172218 wait complete. 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.535+0000 7f0024930800 1 Processor -- start 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0024930800 1 -- start start 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0024930800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e889d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0024930800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f0e8896e00 con 0x55f0e8895df0 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e889d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0020eb1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e889d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33184/0 (socket says 172.21.15.164:33184) 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 learned_addr learned my addr 172.21.15.164:0/2894009250 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e889d960 con 0x55f0e8895df0 2024-09-14T10:55:25.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.536+0000 7f0020eb1640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e889d400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00180014d0 tx=0x7f0018054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7efefdffb640 1 -- 172.21.15.164:0/2894009250 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f001804b030 con 0x55f0e8895df0 2024-09-14T10:55:25.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7efefdffb640 1 -- 172.21.15.164:0/2894009250 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0018011330 con 0x55f0e8895df0 2024-09-14T10:55:25.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0e889dbf0 con 0x55f0e8895df0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7efefdffb640 1 -- 172.21.15.164:0/2894009250 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00180457a0 con 0x55f0e8895df0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e889e570 con 0x55f0e8895df0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.537+0000 7efefdffb640 1 -- 172.21.15.164:0/2894009250 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0018045940 con 0x55f0e8895df0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7efefdffb640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef003ce60 0x7efef003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7efefdffb640 1 -- 172.21.15.164:0/2894009250 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f001804c070 con 0x55f0e8895df0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f00206b0640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef003ce60 0x7efef003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f00206b0640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef003ce60 0x7efef003f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00100176b0 tx=0x7f0010032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e88a9120 0x55f0e88ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88abd30 con 0x55f0e88a9120 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.538+0000 7f001feaf640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e88a9120 0x55f0e88ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f001feaf640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e88a9120 0x55f0e88ab5e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 realm 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ac160 con 0x55f0e88a9120 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88aca30 con 0x55f0e88a9120 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.539+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88acdd0 con 0x55f0e88a9120 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e88adb30 0x55f0e88aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b0530 con 0x55f0e88adb30 2024-09-14T10:55:25.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0020eb1640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e88adb30 0x55f0e88aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0020eb1640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e88adb30 0x55f0e88aff20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 20 searching for the correct realm 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.540+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88adb30 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f0020eb1640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0018014070 0x7f001803fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f0018014070 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f00206b0640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0018014070 0x7f001803fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f00206b0640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0018014070 0x7f001803fa40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f00206b0640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f001000f070 0x7f001001b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.541+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f001000f070 0x7f001001b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f001000f070 0x7f001001b760 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88a9120 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.542+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88a9120 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f0018014070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88adb30 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.543+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88a9120 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f001000f070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x55f0e88a9120 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1e40 con 0x7f0018014070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.544+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f001000f070 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.545+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88a9120 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88a9120 2024-09-14T10:55:25.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f001000f070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.546+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f0018014070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88a9120 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x55f0e88a9120 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f001000f070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.547+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f001000f070 2024-09-14T10:55:25.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014057030 con 0x7f001000f070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f0018014070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88adb30 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f001000f070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.548+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x55f0e88a9120 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f0010061060 con 0x7f0018014070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b0f20 con 0x55f0e88a9120 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b1770 con 0x55f0e88a9120 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.549+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b22c0 con 0x55f0e88a9120 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 zone default found 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 4 Realm: () 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 zonegroup default 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b2660 con 0x7f001000f070 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b4460 con 0x55f0e88adb30 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b4980 con 0x55f0e88adb30 2024-09-14T10:55:25.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 started sync module instance, tier type = 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.550+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b3900 con 0x7f0018014070 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.551+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.551+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493181951216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b3560 con 0x7f0018014070 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.551+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b58b0 con 0x55f0e88a9120 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.552+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94493181951216] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.553+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.553+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493181957120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b5cd0 con 0x55f0e88a9120 2024-09-14T10:55:25.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.553+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b6690 con 0x55f0e88adb30 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.554+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94493181957120] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.554+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.554+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493181958656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b6690 con 0x55f0e88adb30 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.554+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b70d0 con 0x7f0018014070 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.555+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94493181958656] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.555+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.555+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493181960672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b6600 con 0x7f0018014070 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.555+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b7f90 con 0x55f0e88a9120 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.556+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.556+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493181967552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b8830 con 0x55f0e88a9120 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.556+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b92e0 con 0x7f001000f070 2024-09-14T10:55:25.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.556+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94493181960672] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.557+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94493181967552] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.557+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.557+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493181965504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b8280 con 0x7f001000f070 2024-09-14T10:55:25.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.557+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b9b80 con 0x7f001000f070 2024-09-14T10:55:25.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.558+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94493181965504] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.558+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.558+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493181971904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b8280 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.558+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ba1a0 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493181975792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ba5c0 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=0 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=1 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=2 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=3 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=4 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=5 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94493181971904] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.559+0000 7f0024930800 20 add_watcher() i=6 2024-09-14T10:55:25.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94493181975792] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f0024930800 20 add_watcher() i=7 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f0024930800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b96d0 con 0x55f0e88a9120 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.560+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493181976848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88b9680 con 0x55f0e88a9120 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.561+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94493181976848] v35'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.561+0000 7efed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.561+0000 7f0024930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.561+0000 7f0024930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.561+0000 7f0024930800 5 note: GC not initialized 2024-09-14T10:55:25.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7efed57e2640 20 reqs_thread_entry: start 2024-09-14T10:55:25.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 20 Filter name: none 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7efe46ffd640 20 reqs_thread_entry: start 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f07a0 con 0x55f0e88a9120 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 20 rados_obj.operate() r=0 bl.length=673 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.562+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f72e0 con 0x55f0e88a9120 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.563+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.563+0000 7f0024930800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.563+0000 7f0024930800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.563+0000 7f0024930800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.563+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94493182225568 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f2940 con 0x55f0e88a9120 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94493181967552 notify 150323855368 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55f0e877e920 con 0x55f0e88a9120 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7efeff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94493181967552 notifier 4416 bl.length()=758 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94493182225568 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7efeff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7efeff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7efeff7fe640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7efee4003ea0 con 0x55f0e88a9120 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94493182225568 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f001405bb90 con 0x55f0e88a9120 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.564+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f6ca0 con 0x55f0e88a9120 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(66 foo:foo1 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7f0024930800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94493182225568 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f2490 con 0x7f0018014070 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== watch-notify(notify (1) cookie 94493181951216 notify 150323855364 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f001005b040 con 0x7f0018014070 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7efeff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94493181951216 notifier 4416 bl.length()=159 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [notify cookie 94493182225568 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.565+0000 7efeff7fe640 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7efee4003ea0 con 0x7f0018014070 2024-09-14T10:55:25.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.566+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== watch-notify(notify_complete (2) cookie 94493182225568 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0010046040 con 0x7f0018014070 2024-09-14T10:55:25.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.566+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.583 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:55:25.303303Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.566+0000 7efed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.566+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493181976848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88f2490 con 0x55f0e88a9120 2024-09-14T10:55:25.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.567+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94493181976848] v35'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.567+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493181951216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x7f0018014070 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.568+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94493181951216] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.568+0000 7f0024930800 20 remove_watcher() i=0 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.568+0000 7f0024930800 2 removed watcher, disabling cache 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.568+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493181957120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x55f0e88a9120 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.570+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94493181957120] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.570+0000 7f0024930800 20 remove_watcher() i=1 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.570+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493181958656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x55f0e88adb30 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.571+0000 7f0020eb1640 1 -- 172.21.15.164:0/2894009250 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94493181958656] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001802a070 con 0x55f0e88adb30 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.571+0000 7f0024930800 20 remove_watcher() i=2 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.571+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493181960672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x7f0018014070 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.572+0000 7f00206b0640 1 -- 172.21.15.164:0/2894009250 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94493181960672] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f001002e070 con 0x7f0018014070 2024-09-14T10:55:25.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.572+0000 7f0024930800 20 remove_watcher() i=3 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.572+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493181967552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x55f0e88a9120 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.573+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94493181967552] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x55f0e88a9120 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.573+0000 7f0024930800 20 remove_watcher() i=4 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.573+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493181965504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.574+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94493181965504] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.574+0000 7f0024930800 20 remove_watcher() i=5 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.574+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493181971904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.575+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94493181971904] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.575+0000 7f0024930800 20 remove_watcher() i=6 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.575+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493181975792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0e88ee550 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94493181975792] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0014089040 con 0x7f001000f070 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 20 remove_watcher() i=7 2024-09-14T10:55:25.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f001000f070 msgr2=0x7f001001b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f001000f070 0x7f001001b760 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e88a9120 msgr2=0x55f0e88ab5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e88a9120 0x55f0e88ab5e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0018014070 msgr2=0x7f001803fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0018014070 0x7f001803fa40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e88adb30 msgr2=0x55f0e88aff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e88adb30 0x55f0e88aff20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef003ce60 msgr2=0x7efef003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef003ce60 0x7efef003f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f00100176b0 tx=0x7f0010032000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 msgr2=0x55f0e889d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2894009250 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8895df0 0x55f0e889d400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f00180014d0 tx=0x7f0018054560 comp rx=0 tx=0).stop 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 reap_dead start 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f001feaf640 1 -- 172.21.15.164:0/2894009250 reap_dead start 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 shutdown_connections 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 >> 172.21.15.164:0/2894009250 conn(0x55f0e8892210 msgr2=0x55f0e8890420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 shutdown_connections 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2894009250 wait complete. 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 msgr2=0x7efef803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 0x7efef803f2d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f0e8870440 tx=0x7f001000ff50 comp rx=0 tx=0).stop 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 msgr2=0x55f0e8889790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f001800a2a0 tx=0x7f0018018830 comp rx=0 tx=0).stop 2024-09-14T10:55:25.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 shutdown_connections 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efef803ce10 0x7efef803f2d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 --2- 172.21.15.164:0/2990916837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e8889370 0x55f0e8889790 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 >> 172.21.15.164:0/2990916837 conn(0x55f0e887d720 msgr2=0x55f0e887db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 shutdown_connections 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.576+0000 7f0024930800 1 -- 172.21.15.164:0/2990916837 wait complete. 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 msgr2=0x55f0e88759a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 0x55f0e88759a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 msgr2=0x55f0e887a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 0x55f0e887a200 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 msgr2=0x7eff0803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 0x7eff0803f2d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0014057000 tx=0x7f0014052000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 msgr2=0x55f0e886e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55f0e8867790 tx=0x7f0010000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 shutdown_connections 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f0e8877d80 0x55f0e887a200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f0e877abd0 0x55f0e88759a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7eff0803ce10 0x7eff0803f2d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 --2- 172.21.15.164:0/1178275114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f0e86ea030 0x55f0e886e350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 >> 172.21.15.164:0/1178275114 conn(0x55f0e8770fa0 msgr2=0x55f0e8867cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 shutdown_connections 2024-09-14T10:55:25.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.577+0000 7f0024930800 1 -- 172.21.15.164:0/1178275114 wait complete. 2024-09-14T10:55:25.594 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:55:25.303303Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.595 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-14T10:55:25.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-14T10:55:25.595 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-14T10:55:25.639 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.639 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.642+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.642+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae86887800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555a01131f90 0x555a01134380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae86887800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a01134950 con 0x555a0109eef0 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae86887800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555a00fb67d0 con 0x555a01131f90 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae83b70640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555a01131f90 0x555a01134380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae84371640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x555a0109eef0 0x555a01130870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38660/0 (socket says 172.21.15.164:38660) 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae83b70640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555a01131f90 0x555a01134380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33196/0 (socket says 172.21.15.164:33196) 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae84371640 1 -- 172.21.15.164:0/1250001072 learned_addr learned my addr 172.21.15.164:0/1250001072 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae83b70640 1 -- 172.21.15.164:0/1250001072 >> v1:172.21.15.116:6789/0 conn(0x555a0109eef0 legacy=0x555a01130870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.643+0000 7fae83b70640 1 -- 172.21.15.164:0/1250001072 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a01135b30 con 0x555a01131f90 2024-09-14T10:55:25.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae83b70640 1 --2- 172.21.15.164:0/1250001072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a01131f90 0x555a01134380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae7800a470 tx=0x7fae78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f0eecd83dbfb3c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae8336f640 1 -- 172.21.15.164:0/1250001072 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae78053570 con 0x555a01131f90 2024-09-14T10:55:25.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae8336f640 1 -- 172.21.15.164:0/1250001072 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae78058070 con 0x555a01131f90 2024-09-14T10:55:25.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae8336f640 1 -- 172.21.15.164:0/1250001072 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae78053880 con 0x555a01131f90 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 -- 172.21.15.164:0/1250001072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a01131f90 msgr2=0x555a01134380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 --2- 172.21.15.164:0/1250001072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a01131f90 0x555a01134380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae7800a470 tx=0x7fae78045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 -- 172.21.15.164:0/1250001072 shutdown_connections 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 --2- 172.21.15.164:0/1250001072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a01131f90 0x555a01134380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 -- 172.21.15.164:0/1250001072 >> 172.21.15.164:0/1250001072 conn(0x555a01125f80 msgr2=0x555a011283e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 -- 172.21.15.164:0/1250001072 shutdown_connections 2024-09-14T10:55:25.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.645+0000 7fae86887800 1 -- 172.21.15.164:0/1250001072 wait complete. 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae86887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae86887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555a00fc3dd0 con 0x555a0109eef0 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae84371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae84371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33206/0 (socket says 172.21.15.164:33206) 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae84371640 1 -- 172.21.15.164:0/348578202 learned_addr learned my addr 172.21.15.164:0/348578202 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.660+0000 7fae84371640 1 -- 172.21.15.164:0/348578202 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a0121dfe0 con 0x555a0109eef0 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae84371640 1 --2- 172.21.15.164:0/348578202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae74001e40 tx=0x7fae74001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a813661d82df569f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fad7260c640 1 -- 172.21.15.164:0/348578202 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74012020 con 0x555a0109eef0 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fad7260c640 1 -- 172.21.15.164:0/348578202 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7400e5a0 con 0x555a0109eef0 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fad7260c640 1 -- 172.21.15.164:0/348578202 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7400e8a0 con 0x555a0109eef0 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae86887800 1 -- 172.21.15.164:0/348578202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 msgr2=0x555a0121d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae86887800 1 --2- 172.21.15.164:0/348578202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae74001e40 tx=0x7fae74001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae86887800 1 -- 172.21.15.164:0/348578202 shutdown_connections 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae86887800 1 --2- 172.21.15.164:0/348578202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a0121d9f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.661+0000 7fae86887800 1 -- 172.21.15.164:0/348578202 >> 172.21.15.164:0/348578202 conn(0x555a01125f80 msgr2=0x555a01219370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 -- 172.21.15.164:0/348578202 shutdown_connections 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 -- 172.21.15.164:0/348578202 wait complete. 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae86887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555a01134e20 con 0x555a0109eef0 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae84371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae84371640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33220/0 (socket says 172.21.15.164:33220) 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.662+0000 7fae84371640 1 -- 172.21.15.164:0/163900582 learned_addr learned my addr 172.21.15.164:0/163900582 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fae84371640 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a01225aa0 con 0x555a0109eef0 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fae84371640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c010 tx=0x7fae74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fad70e09640 1 -- 172.21.15.164:0/163900582 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae74012030 con 0x555a0109eef0 2024-09-14T10:55:25.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fad70e09640 1 -- 172.21.15.164:0/163900582 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae740014a0 con 0x555a0109eef0 2024-09-14T10:55:25.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a01225d30 con 0x555a0109eef0 2024-09-14T10:55:25.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fad70e09640 1 -- 172.21.15.164:0/163900582 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7401a7a0 con 0x555a0109eef0 2024-09-14T10:55:25.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.663+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a01226730 con 0x555a0109eef0 2024-09-14T10:55:25.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fad70e09640 1 -- 172.21.15.164:0/163900582 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae74015020 con 0x555a0109eef0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fad70e09640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 0x7fad6c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fad70e09640 1 -- 172.21.15.164:0/163900582 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fae74020030 con 0x555a0109eef0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fae83b70640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 0x7fad6c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 0x555a0122cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a012272c0 con 0x555a01131f90 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.664+0000 7fae84b72640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 0x555a0122cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae83b70640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 0x7fad6c03f320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae78057000 tx=0x7fae78052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae84b72640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 0x555a0122cb90 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae84b72640 1 -- 172.21.15.164:0/163900582 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae7c00a4d0 con 0x555a01131f90 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01226bc0 con 0x555a01131f90 2024-09-14T10:55:25.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae84b72640 1 -- 172.21.15.164:0/163900582 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae7c00a4d0 con 0x555a01131f90 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 0x555a012313f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01231ac0 con 0x555a0122f000 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.665+0000 7fae84371640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 0x555a012313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.666+0000 7fae84371640 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 0x555a012313f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.666+0000 7fae84371640 1 -- 172.21.15.164:0/163900582 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae740187b0 con 0x555a0122f000 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.666+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a0122dea0 con 0x555a01131f90 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.666+0000 7fae84b72640 1 -- 172.21.15.164:0/163900582 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae7c00a4d0 con 0x555a01131f90 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.666+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a0122e340 con 0x555a01131f90 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae84b72640 1 -- 172.21.15.164:0/163900582 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae7c00a4d0 con 0x555a01131f90 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae86887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae86887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555a010224a0 con 0x555a012404a0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33228/0 (socket says 172.21.15.164:33228) 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.667+0000 7fae84b72640 1 -- 172.21.15.164:0/627144371 learned_addr learned my addr 172.21.15.164:0/627144371 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fae84b72640 1 -- 172.21.15.164:0/627144371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a01240f00 con 0x555a012404a0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fae84b72640 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555a0122d0d0 tx=0x7fae7c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fad69ffb640 1 -- 172.21.15.164:0/627144371 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c014450 con 0x555a012404a0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fad69ffb640 1 -- 172.21.15.164:0/627144371 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c0145f0 con 0x555a012404a0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a01241730 con 0x555a012404a0 2024-09-14T10:55:25.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fad69ffb640 1 -- 172.21.15.164:0/627144371 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c014910 con 0x555a012404a0 2024-09-14T10:55:25.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.668+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a01241cd0 con 0x555a012404a0 2024-09-14T10:55:25.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.669+0000 7fad69ffb640 1 -- 172.21.15.164:0/627144371 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae7c011040 con 0x555a012404a0 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.669+0000 7fad69ffb640 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 0x7fad5c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.669+0000 7fad69ffb640 1 -- 172.21.15.164:0/627144371 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fae7c01e070 con 0x555a012404a0 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.669+0000 7fae84371640 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 0x7fad5c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84371640 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 0x7fad5c03f2d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x555a0122d170 tx=0x7fae74052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae86887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae86887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555a0121e410 con 0x555a0124cf60 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33230/0 (socket says 172.21.15.164:33230) 2024-09-14T10:55:25.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84b72640 1 -- 172.21.15.164:0/2101580155 learned_addr learned my addr 172.21.15.164:0/2101580155 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84b72640 1 -- 172.21.15.164:0/2101580155 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a0124d930 con 0x555a0124cf60 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fae84b72640 1 --2- 172.21.15.164:0/2101580155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fae7c016fd0 tx=0x7fae7c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46967a43e81172a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.670+0000 7fad637fe640 1 -- 172.21.15.164:0/2101580155 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c04b070 con 0x555a0124cf60 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fad637fe640 1 -- 172.21.15.164:0/2101580155 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c051070 con 0x555a0124cf60 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fad637fe640 1 -- 172.21.15.164:0/2101580155 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c022db0 con 0x555a0124cf60 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- 172.21.15.164:0/2101580155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 msgr2=0x555a0124d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 --2- 172.21.15.164:0/2101580155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fae7c016fd0 tx=0x7fae7c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- 172.21.15.164:0/2101580155 shutdown_connections 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 --2- 172.21.15.164:0/2101580155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a0124d340 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- 172.21.15.164:0/2101580155 >> 172.21.15.164:0/2101580155 conn(0x555a01249360 msgr2=0x555a012475a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- 172.21.15.164:0/2101580155 shutdown_connections 2024-09-14T10:55:25.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- 172.21.15.164:0/2101580155 wait complete. 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 Processor -- start 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- start start 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a01254540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.671+0000 7fae86887800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555a0124df70 con 0x555a0124cf60 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a01254540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae84b72640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a01254540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33240/0 (socket says 172.21.15.164:33240) 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 learned_addr learned my addr 172.21.15.164:0/4017183641 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a01254aa0 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae84b72640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a01254540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fae7c053400 tx=0x7fae7c054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fad61ffb640 1 -- 172.21.15.164:0/4017183641 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c04b040 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fad61ffb640 1 -- 172.21.15.164:0/4017183641 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c031030 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a01254d30 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fad61ffb640 1 -- 172.21.15.164:0/4017183641 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae7c016910 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.672+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a012558c0 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.673+0000 7fad61ffb640 1 -- 172.21.15.164:0/4017183641 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae7c011330 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.673+0000 7fad61ffb640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5403ce10 0x7fad5403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.673+0000 7fad61ffb640 1 -- 172.21.15.164:0/4017183641 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fae7c00e040 con 0x555a0124cf60 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.673+0000 7fae84371640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5403ce10 0x7fad5403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae84371640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5403ce10 0x7fad5403f2d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae74018ac0 tx=0x7fae74048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01260300 0x555a012627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01262f10 con 0x555a01260300 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae83b70640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01260300 0x555a012627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.674+0000 7fae83b70640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01260300 0x555a012627c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 realm 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01263340 con 0x555a01260300 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01263c10 con 0x555a01260300 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01263fb0 con 0x555a01260300 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a01264d10 0x555a01267100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01267710 con 0x555a01264d10 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.675+0000 7fae84b72640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a01264d10 0x555a01267100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84b72640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a01264d10 0x555a01267100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae7c03e070 con 0x555a01264d10 2024-09-14T10:55:25.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae86887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae86887800 20 searching for the correct realm 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae7c03e070 con 0x555a01264d10 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84b72640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae7c014070 0x7fae7c001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.676+0000 7fae84371640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae7c014070 0x7fae7c001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae84371640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae7c014070 0x7fae7c001770 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae84371640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae74017050 0x7fae7404b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae83b70640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae74017050 0x7fae7404b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.677+0000 7fae83b70640 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae74017050 0x7fae7404b640 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.678+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c03e070 con 0x555a01264d10 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.679+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c03e070 con 0x555a01264d10 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.680+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.681+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.682+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.683+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01264d10 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae74017050 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x555a01260300 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555a01269000 con 0x7fae7c014070 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.684+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a012680d0 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01268920 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01269480 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 zone default found 2024-09-14T10:55:25.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 4 Realm: () 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 zonegroup default 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01269820 con 0x7fae74017050 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.685+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a0126b600 con 0x555a01264d10 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a0126bae0 con 0x555a01264d10 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 20 started sync module instance, tier type = 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.686+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126aaa0 con 0x7fae7c014070 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.687+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.687+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845054729872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126a700 con 0x7fae7c014070 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.687+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126ca10 con 0x555a01260300 2024-09-14T10:55:25.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.688+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845054729872] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.688+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.688+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845054735712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126c980 con 0x555a01260300 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.688+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126d8d0 con 0x555a01264d10 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.690+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845054735712] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.690+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.690+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845054737920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126d8d0 con 0x555a01264d10 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.690+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126e340 con 0x7fae7c014070 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.691+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845054737920] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.691+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.691+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845054739488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126d840 con 0x7fae7c014070 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.691+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126f200 con 0x555a01260300 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.692+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.692+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845054746416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a0126f9c0 con 0x555a01260300 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.692+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012704e0 con 0x7fae74017050 2024-09-14T10:55:25.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.692+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845054739488] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.693+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845054746416] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.693+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.693+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845054750640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012704a0 con 0x7fae74017050 2024-09-14T10:55:25.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.693+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a01270d80 con 0x7fae74017050 2024-09-14T10:55:25.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.694+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.694+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845054752896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012704a0 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.694+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012718b0 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.694+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845054750640] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845054755744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a01271870 con 0x7fae74017050 2024-09-14T10:55:25.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=0 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=1 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=2 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=3 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=4 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=5 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845054752896] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.695+0000 7fae86887800 20 add_watcher() i=6 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845054755744] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae86887800 20 add_watcher() i=7 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae86887800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a01270ca0 con 0x555a01260300 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.696+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845054744368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a01270ca0 con 0x555a01260300 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845054744368] v35'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fad3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae86887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae86887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae86887800 5 note: GC not initialized 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fad397e2640 20 reqs_thread_entry: start 2024-09-14T10:55:25.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae86887800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.697+0000 7fae86887800 20 Filter name: none 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7facaaffd640 20 reqs_thread_entry: start 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a012a79f0 con 0x555a01260300 2024-09-14T10:55:25.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 20 rados_obj.operate() r=0 bl.length=582 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.698+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012adff0 con 0x555a01260300 2024-09-14T10:55:25.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae86887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae86887800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae86887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93845055003056 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555a012a98a0 con 0x555a01260300 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 93845054746416 notify 150323855369 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fae78081040 con 0x555a01260300 2024-09-14T10:55:25.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fad637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 93845054746416 notifier 4423 bl.length()=732 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fad637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fad637fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 93845055003056 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.699+0000 7fad637fe640 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fad48003ea0 con 0x555a01260300 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.700+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.700+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 93845055003056 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a01135b30 con 0x555a01260300 2024-09-14T10:55:25.717 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-14T10:55:25.303303Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.701+0000 7fad3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.701+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845054744368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x555a01260300 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.702+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93845054744368] v35'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.702+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845054729872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x7fae7c014070 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.703+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93845054729872] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.703+0000 7fae86887800 20 remove_watcher() i=0 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.703+0000 7fae86887800 2 removed watcher, disabling cache 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.703+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845054735712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x555a01260300 2024-09-14T10:55:25.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.704+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93845054735712] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.704+0000 7fae86887800 20 remove_watcher() i=1 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.704+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845054737920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x555a01264d10 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.705+0000 7fae84b72640 1 -- 172.21.15.164:0/4017183641 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93845054737920] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae7c066040 con 0x555a01264d10 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.705+0000 7fae86887800 20 remove_watcher() i=2 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.705+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845054739488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x7fae7c014070 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.706+0000 7fae84371640 1 -- 172.21.15.164:0/4017183641 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93845054739488] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae740187b0 con 0x7fae7c014070 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.706+0000 7fae86887800 20 remove_watcher() i=3 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.706+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845054746416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x555a01260300 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.707+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93845054746416] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x555a01260300 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.707+0000 7fae86887800 20 remove_watcher() i=4 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.707+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845054750640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x7fae74017050 2024-09-14T10:55:25.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.708+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93845054750640] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.708+0000 7fae86887800 20 remove_watcher() i=5 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.708+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845054752896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a8ec0 con 0x7fae74017050 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.709+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93845054752896] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.709+0000 7fae86887800 20 remove_watcher() i=6 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.709+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845054755744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555a012a57a0 con 0x7fae74017050 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93845054755744] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae78051070 con 0x7fae74017050 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 20 remove_watcher() i=7 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae74017050 msgr2=0x7fae7404b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae74017050 0x7fae7404b640 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01260300 msgr2=0x555a012627c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01260300 0x555a012627c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae7c014070 msgr2=0x7fae7c001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae7c014070 0x7fae7c001770 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a01264d10 msgr2=0x555a01267100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a01264d10 0x555a01267100 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5403ce10 msgr2=0x7fad5403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5403ce10 0x7fad5403f2d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae74018ac0 tx=0x7fae74048000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 msgr2=0x555a01254540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/4017183641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0124cf60 0x555a01254540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fae7c053400 tx=0x7fae7c054510 comp rx=0 tx=0).stop 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 reap_dead start 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae83b70640 1 -- 172.21.15.164:0/4017183641 reap_dead start 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 shutdown_connections 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 >> 172.21.15.164:0/4017183641 conn(0x555a01249360 msgr2=0x555a01247570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 shutdown_connections 2024-09-14T10:55:25.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/4017183641 wait complete. 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 msgr2=0x7fad5c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 0x7fad5c03f2d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x555a0122d170 tx=0x7fae74052770 comp rx=0 tx=0).stop 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 msgr2=0x555a012408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.710+0000 7fae86887800 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x555a0122d0d0 tx=0x7fae7c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 shutdown_connections 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad5c03ce10 0x7fad5c03f2d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/627144371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a012404a0 0x555a012408c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 >> 172.21.15.164:0/627144371 conn(0x555a01234850 msgr2=0x555a01234c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 shutdown_connections 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/627144371 wait complete. 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 msgr2=0x555a0122cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 0x555a0122cb90 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 msgr2=0x555a012313f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 0x555a012313f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 msgr2=0x7fad6c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 0x7fad6c03f320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae78057000 tx=0x7fae78052000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 msgr2=0x555a01225540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fae7400c010 tx=0x7fae74000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 shutdown_connections 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555a0122f000 0x555a012313f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555a01131f90 0x555a0122cb90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad6c03ce60 0x7fad6c03f320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 --2- 172.21.15.164:0/163900582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555a0109eef0 0x555a01225540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 >> 172.21.15.164:0/163900582 conn(0x555a01125f80 msgr2=0x555a0121eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 shutdown_connections 2024-09-14T10:55:25.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.711+0000 7fae86887800 1 -- 172.21.15.164:0/163900582 wait complete. 2024-09-14T10:55:25.729 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-14T10:55:25.303303Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.729 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-14T10:55:25.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-14T10:55:25.729 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-14T10:55:25.777 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.777 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebef22800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eb33f17b0 0x557eb33f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebef22800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557eb33f3490 con 0x557eb33f28d0 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebef22800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x557eb327d7d0 con 0x557eb33f17b0 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebab02640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eb33f17b0 0x557eb33f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebab02640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eb33f17b0 0x557eb33f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33254/0 (socket says 172.21.15.164:33254) 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feeb2301640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x557eb33f28d0 0x557eb33f2d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38676/0 (socket says 172.21.15.164:38676) 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.780+0000 7feebab02640 1 -- 172.21.15.164:0/3110857555 learned_addr learned my addr 172.21.15.164:0/3110857555 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.781+0000 7feebab02640 1 -- 172.21.15.164:0/3110857555 >> v1:172.21.15.116:6789/0 conn(0x557eb33f28d0 legacy=0x557eb33f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.781+0000 7feebab02640 1 -- 172.21.15.164:0/3110857555 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb33f3660 con 0x557eb33f17b0 2024-09-14T10:55:25.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.781+0000 7feeba301640 1 -- 172.21.15.164:0/3110857555 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160330662 0 0) 0x557eb33f3490 con 0x557eb33f28d0 2024-09-14T10:55:25.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.782+0000 7feebab02640 1 --2- 172.21.15.164:0/3110857555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb33f1bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeac00a520 tx=0x7feeac045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dedcff47829f32e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.782+0000 7feeba301640 1 -- 172.21.15.164:0/3110857555 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac055070 con 0x557eb33f17b0 2024-09-14T10:55:25.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feeba301640 1 -- 172.21.15.164:0/3110857555 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac0515b0 con 0x557eb33f17b0 2024-09-14T10:55:25.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feeba301640 1 -- 172.21.15.164:0/3110857555 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac0518d0 con 0x557eb33f17b0 2024-09-14T10:55:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 -- 172.21.15.164:0/3110857555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 msgr2=0x557eb33f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 --2- 172.21.15.164:0/3110857555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb33f1bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feeac00a520 tx=0x7feeac045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 -- 172.21.15.164:0/3110857555 shutdown_connections 2024-09-14T10:55:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 --2- 172.21.15.164:0/3110857555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb33f1bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 -- 172.21.15.164:0/3110857555 >> 172.21.15.164:0/3110857555 conn(0x557eb33ecfa0 msgr2=0x557eb33ef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 -- 172.21.15.164:0/3110857555 shutdown_connections 2024-09-14T10:55:25.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.783+0000 7feebef22800 1 -- 172.21.15.164:0/3110857555 wait complete. 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebef22800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebef22800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eb328add0 con 0x557eb33f17b0 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebab02640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebab02640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33260/0 (socket says 172.21.15.164:33260) 2024-09-14T10:55:25.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.797+0000 7feebab02640 1 -- 172.21.15.164:0/76986156 learned_addr learned my addr 172.21.15.164:0/76986156 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.798+0000 7feebab02640 1 -- 172.21.15.164:0/76986156 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb34de750 con 0x557eb33f17b0 2024-09-14T10:55:25.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.798+0000 7feebab02640 1 --2- 172.21.15.164:0/76986156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feeac025da0 tx=0x7feeac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad781d5c9bcc984 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.798+0000 7feda8e09640 1 -- 172.21.15.164:0/76986156 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac051950 con 0x557eb33f17b0 2024-09-14T10:55:25.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.798+0000 7feda8e09640 1 -- 172.21.15.164:0/76986156 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac051af0 con 0x557eb33f17b0 2024-09-14T10:55:25.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.798+0000 7feda8e09640 1 -- 172.21.15.164:0/76986156 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac051dd0 con 0x557eb33f17b0 2024-09-14T10:55:25.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- 172.21.15.164:0/76986156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 msgr2=0x557eb34de160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 --2- 172.21.15.164:0/76986156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feeac025da0 tx=0x7feeac051000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- 172.21.15.164:0/76986156 shutdown_connections 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 --2- 172.21.15.164:0/76986156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34de160 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- 172.21.15.164:0/76986156 >> 172.21.15.164:0/76986156 conn(0x557eb33ecfa0 msgr2=0x557eb34e0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- 172.21.15.164:0/76986156 shutdown_connections 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- 172.21.15.164:0/76986156 wait complete. 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebef22800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eb33f8dc0 con 0x557eb33f17b0 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.799+0000 7feebab02640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebab02640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33274/0 (socket says 172.21.15.164:33274) 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebab02640 1 -- 172.21.15.164:0/925373209 learned_addr learned my addr 172.21.15.164:0/925373209 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebab02640 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb34ec740 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebab02640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feeac025da0 tx=0x7feeac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feda7606640 1 -- 172.21.15.164:0/925373209 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac05a600 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feda7606640 1 -- 172.21.15.164:0/925373209 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac073070 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb34ec9d0 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feda7606640 1 -- 172.21.15.164:0/925373209 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeac05a910 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.800+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb34ed5e0 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feda7606640 1 -- 172.21.15.164:0/925373209 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7feeac058070 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feda7606640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 0x7feda003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feda7606640 1 -- 172.21.15.164:0/925373209 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7feeac06b040 con 0x557eb33f17b0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feeb2301640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 0x7feda003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 0x557eb34f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb34f3d70 con 0x557eb33f28d0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.801+0000 7feebb303640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 0x557eb34f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feeb2301640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 0x7feda003f320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebb303640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 0x557eb34f3830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebb303640 1 -- 172.21.15.164:0/925373209 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feeb400a4d0 con 0x557eb33f28d0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb34f4110 con 0x557eb33f28d0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebb303640 1 -- 172.21.15.164:0/925373209 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feeb400a4d0 con 0x557eb33f28d0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 0x557eb34f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb34f8840 con 0x557eb34f5c10 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.802+0000 7feebab02640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 0x557eb34f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.803+0000 7feebab02640 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 0x557eb34f80b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.803+0000 7feebab02640 1 -- 172.21.15.164:0/925373209 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feeac057030 con 0x557eb34f5c10 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.803+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb34f4960 con 0x557eb33f28d0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.803+0000 7feebb303640 1 -- 172.21.15.164:0/925373209 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feeb400a4d0 con 0x557eb33f28d0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.803+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb34f4db0 con 0x557eb33f28d0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebb303640 1 -- 172.21.15.164:0/925373209 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feeb400a4d0 con 0x557eb33f28d0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebef22800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebef22800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eb32e94a0 con 0x557eb35071e0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33286/0 (socket says 172.21.15.164:33286) 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.804+0000 7feebb303640 1 -- 172.21.15.164:0/4255220607 learned_addr learned my addr 172.21.15.164:0/4255220607 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feebb303640 1 -- 172.21.15.164:0/4255220607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb3507c40 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feebb303640 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feeb400a2a0 tx=0x7feeb4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feda4e01640 1 -- 172.21.15.164:0/4255220607 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4014450 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feda4e01640 1 -- 172.21.15.164:0/4255220607 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb40145f0 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feda4e01640 1 -- 172.21.15.164:0/4255220607 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4014910 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb3508470 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.805+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb3508a10 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feda4e01640 1 -- 172.21.15.164:0/4255220607 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7feeb4011040 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feda4e01640 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 0x7fed9403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feda4e01640 1 -- 172.21.15.164:0/4255220607 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7feeb401e070 con 0x557eb35071e0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feebab02640 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 0x7fed9403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feebab02640 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 0x7fed9403f2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feeac051580 tx=0x7feeac050a60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.806+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebef22800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebef22800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eb34dcab0 con 0x557eb3513c60 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33294/0 (socket says 172.21.15.164:33294) 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebb303640 1 -- 172.21.15.164:0/1446318871 learned_addr learned my addr 172.21.15.164:0/1446318871 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebb303640 1 -- 172.21.15.164:0/1446318871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb3514650 con 0x557eb3513c60 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7feebb303640 1 --2- 172.21.15.164:0/1446318871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feeb4016fd0 tx=0x7feeb4011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264ca4ea4a8c1439 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7fed9e7fc640 1 -- 172.21.15.164:0/1446318871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4028070 con 0x557eb3513c60 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7fed9e7fc640 1 -- 172.21.15.164:0/1446318871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4056070 con 0x557eb3513c60 2024-09-14T10:55:25.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.807+0000 7fed9e7fc640 1 -- 172.21.15.164:0/1446318871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4022dc0 con 0x557eb3513c60 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- 172.21.15.164:0/1446318871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 msgr2=0x557eb3514060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 --2- 172.21.15.164:0/1446318871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feeb4016fd0 tx=0x7feeb4011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- 172.21.15.164:0/1446318871 shutdown_connections 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 --2- 172.21.15.164:0/1446318871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb3514060 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- 172.21.15.164:0/1446318871 >> 172.21.15.164:0/1446318871 conn(0x557eb3510060 msgr2=0x557eb350e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- 172.21.15.164:0/1446318871 shutdown_connections 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- 172.21.15.164:0/1446318871 wait complete. 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 Processor -- start 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- start start 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.808+0000 7feebef22800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eb3514c70 con 0x557eb3513c60 2024-09-14T10:55:25.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebb303640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33302/0 (socket says 172.21.15.164:33302) 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 learned_addr learned my addr 172.21.15.164:0/2688425627 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb351b7e0 con 0x557eb3513c60 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebb303640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feeb4054550 tx=0x7feeb4054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7fed9cff9640 1 -- 172.21.15.164:0/2688425627 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4044050 con 0x557eb3513c60 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7fed9cff9640 1 -- 172.21.15.164:0/2688425627 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4045130 con 0x557eb3513c60 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb351ba70 con 0x557eb3513c60 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7fed9cff9640 1 -- 172.21.15.164:0/2688425627 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeb4045340 con 0x557eb3513c60 2024-09-14T10:55:25.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.809+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb351c3f0 con 0x557eb3513c60 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.810+0000 7fed9cff9640 1 -- 172.21.15.164:0/2688425627 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7feeb4034030 con 0x557eb3513c60 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.810+0000 7fed9cff9640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed8403ce60 0x7fed8403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.810+0000 7fed9cff9640 1 -- 172.21.15.164:0/2688425627 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7feeb4032070 con 0x557eb3513c60 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.810+0000 7feebab02640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed8403ce60 0x7fed8403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feebab02640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed8403ce60 0x7fed8403f320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feeac0966b0 tx=0x7feeac08a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb3526f40 0x557eb3529400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb3529b50 con 0x557eb3526f40 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feeb2301640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb3526f40 0x557eb3529400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feeb2301640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb3526f40 0x557eb3529400 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea400f5f0 con 0x557eb3526f40 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.811+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 realm 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb3526290 con 0x557eb3526f40 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea400f5f0 con 0x557eb3526f40 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb352a640 con 0x557eb3526f40 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea400f5f0 con 0x557eb3526f40 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb352af10 con 0x557eb3526f40 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feea400f5f0 con 0x557eb3526f40 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb352b930 0x557eb352dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb352e490 con 0x557eb352b930 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.812+0000 7feebb303640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb352b930 0x557eb352dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebb303640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb352b930 0x557eb352dd20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebef22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebef22800 20 searching for the correct realm 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb352b930 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebb303640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7feeb404dc20 0x7feeb4035a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeb404dc20 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.813+0000 7feebab02640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7feeb404dc20 0x7feeb4035a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feebab02640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7feeb404dc20 0x7feeb4035a80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feebab02640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7feeac065020 0x7feeac077840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeac065020 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feeb2301640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7feeac065020 0x7feeac077840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.814+0000 7feeb2301640 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7feeac065020 0x7feeac077840 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea400f5f0 con 0x7feeac065020 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb3526f40 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea400f5f0 con 0x557eb3526f40 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb3526f40 2024-09-14T10:55:25.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.815+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeb404dc20 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb352b930 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb3526f40 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x7feeac065020 2024-09-14T10:55:25.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.816+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x557eb3526f40 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557eb352fd80 con 0x7feeb404dc20 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.817+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeac065020 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x7feeac065020 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.818+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeac065020 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x7feeac065020 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeb404dc20 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea402b040 con 0x557eb3526f40 2024-09-14T10:55:25.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.819+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeac065020 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeac065020 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeb404dc20 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.820+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb352b930 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeac065020 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x557eb3526f40 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7feeac0af060 con 0x7feeb404dc20 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.821+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb352ee80 con 0x557eb3526f40 2024-09-14T10:55:25.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb352f720 con 0x557eb3526f40 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb3530200 con 0x557eb3526f40 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 zone default found 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 4 Realm: () 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 zonegroup default 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.822+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb3530200 con 0x7feeac065020 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb3532010 con 0x557eb352b930 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb35325f0 con 0x557eb352b930 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 started sync module instance, tier type = 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.823+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3531480 con 0x7feeb404dc20 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.824+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.824+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002662805456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3532a50 con 0x7feeb404dc20 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.824+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3533300 con 0x557eb3526f40 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.825+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002662805456] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.825+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.825+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002662813168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3533720 con 0x557eb3526f40 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.825+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3534190 con 0x557eb352b930 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.826+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002662813168] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.826+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.826+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002662816864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3534150 con 0x557eb352b930 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.826+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3534cc0 con 0x7feeb404dc20 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.827+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.827+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002662819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3535550 con 0x7feeb404dc20 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.827+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3536040 con 0x557eb3526f40 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.827+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002662816864] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.828+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.828+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002662824720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3536430 con 0x557eb3526f40 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.828+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3536e70 con 0x7feeac065020 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.828+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002662819792] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.829+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.829+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002662828352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3536e30 con 0x7feeac065020 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.829+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb35378a0 con 0x7feeac065020 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.829+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002662824720] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.831+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002662828352] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.831+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.831+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002662821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb35378a0 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.831+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3537d20 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002662821984] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002662807664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3537ce0 con 0x7feeac065020 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=0 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=1 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=2 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=3 2024-09-14T10:55:25.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=4 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=5 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.832+0000 7feebef22800 20 add_watcher() i=6 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002662807664] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feebef22800 20 add_watcher() i=7 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feebef22800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb353b140 con 0x557eb3526f40 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.834+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002662831056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3538690 con 0x557eb3526f40 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002662831056] v35'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7fed717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feebef22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feebef22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feebef22800 5 note: GC not initialized 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7fecebfff640 20 reqs_thread_entry: start 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feebef22800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.835+0000 7feebef22800 20 Filter name: none 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7fece9ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb356e400 con 0x557eb3526f40 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 20 rados_obj.operate() r=0 bl.length=556 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.836+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3574a80 con 0x557eb3526f40 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feebef22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feebef22800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feebef22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94002663081024 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb35700e0 con 0x557eb3526f40 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94002662824720 notify 150323855370 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7feea4018040 con 0x557eb3526f40 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7fed9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94002662824720 notifier 4430 bl.length()=567 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7fed9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.837+0000 7fed9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.838+0000 7fed9e7fc640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fed80003ea0 con 0x557eb3526f40 2024-09-14T10:55:25.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.838+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94002663081024 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.838+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.838+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94002663081024 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feea402fba0 con 0x557eb3526f40 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.838+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb3574440 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 foo:foo2 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebef22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94002663081024 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557eb356fc30 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== watch-notify(notify (1) cookie 94002662805456 notify 150323855365 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7feeac0a9040 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7fed9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94002662805456 notifier 4430 bl.length()=159 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7fed9dffb640 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fecf00032c0 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(67 notify.0 [notify cookie 94002663081024 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.839+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== watch-notify(notify_complete (2) cookie 94002663081024 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557eb34ed5e0 con 0x7feeb404dc20 2024-09-14T10:55:25.850 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:25.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.840+0000 7fed717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.840+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002662831056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x557eb3526f40 2024-09-14T10:55:25.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.841+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94002662831056] v35'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.841+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002662805456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x7feeb404dc20 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.842+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94002662805456] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.842+0000 7feebef22800 20 remove_watcher() i=0 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.842+0000 7feebef22800 2 removed watcher, disabling cache 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.842+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002662813168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x557eb3526f40 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.843+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94002662813168] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.843+0000 7feebef22800 20 remove_watcher() i=1 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.843+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002662816864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x557eb352b930 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.844+0000 7feebb303640 1 -- 172.21.15.164:0/2688425627 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94002662816864] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeb402a070 con 0x557eb352b930 2024-09-14T10:55:25.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.844+0000 7feebef22800 20 remove_watcher() i=2 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.844+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002662819792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x7feeb404dc20 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.845+0000 7feebab02640 1 -- 172.21.15.164:0/2688425627 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94002662819792] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feeac057030 con 0x7feeb404dc20 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.845+0000 7feebef22800 20 remove_watcher() i=3 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.845+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002662824720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x557eb3526f40 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.846+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94002662824720] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x557eb3526f40 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.846+0000 7feebef22800 20 remove_watcher() i=4 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.846+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002662828352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x7feeac065020 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.847+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94002662828352] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.847+0000 7feebef22800 20 remove_watcher() i=5 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.847+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002662821984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x7feeac065020 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.848+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94002662821984] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.848+0000 7feebef22800 20 remove_watcher() i=6 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.848+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002662807664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557eb356c1d0 con 0x7feeac065020 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94002662807664] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feea403b040 con 0x7feeac065020 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 20 remove_watcher() i=7 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7feeac065020 msgr2=0x7feeac077840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7feeac065020 0x7feeac077840 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb3526f40 msgr2=0x557eb3529400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb3526f40 0x557eb3529400 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7feeb404dc20 msgr2=0x7feeb4035a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7feeb404dc20 0x7feeb4035a80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb352b930 msgr2=0x557eb352dd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb352b930 0x557eb352dd20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed8403ce60 msgr2=0x7fed8403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed8403ce60 0x7fed8403f320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feeac0966b0 tx=0x7feeac08a000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 msgr2=0x557eb351b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feeb2301640 1 -- 172.21.15.164:0/2688425627 reap_dead start 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feeb4054550 tx=0x7feeb4054580 comp rx=0 tx=0).stop 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 shutdown_connections 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 --2- 172.21.15.164:0/2688425627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb3513c60 0x557eb351b280 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 >> 172.21.15.164:0/2688425627 conn(0x557eb3510060 msgr2=0x557eb350e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 shutdown_connections 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.849+0000 7feebef22800 1 -- 172.21.15.164:0/2688425627 wait complete. 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 msgr2=0x7fed9403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 0x7fed9403f2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feeac051580 tx=0x7feeac050a60 comp rx=0 tx=0).stop 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 msgr2=0x557eb3507600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feeb400a2a0 tx=0x7feeb4018830 comp rx=0 tx=0).stop 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 shutdown_connections 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fed9403ce10 0x7fed9403f2d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/4255220607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb35071e0 0x557eb3507600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 >> 172.21.15.164:0/4255220607 conn(0x557eb34fb590 msgr2=0x557eb34fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 shutdown_connections 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/4255220607 wait complete. 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 msgr2=0x557eb34f3830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 0x557eb34f3830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 msgr2=0x557eb34f80b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 0x557eb34f80b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 msgr2=0x7feda003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 0x7feda003f320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 msgr2=0x557eb34ec1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7feeac025da0 tx=0x7feeac002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 shutdown_connections 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557eb34f5c10 0x557eb34f80b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557eb33f28d0 0x557eb34f3830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7feda003ce60 0x7feda003f320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 --2- 172.21.15.164:0/925373209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eb33f17b0 0x557eb34ec1e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 >> 172.21.15.164:0/925373209 conn(0x557eb33ecfa0 msgr2=0x557eb34db6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 shutdown_connections 2024-09-14T10:55:25.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.850+0000 7feebef22800 1 -- 172.21.15.164:0/925373209 wait complete. 2024-09-14T10:55:25.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:25.862 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:55:25.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:55:25.863 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-14T10:55:25.907 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:25.908 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.910+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.910+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa08013800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560491f6cb40 0x560491f6ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa08013800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560491f6f5d0 con 0x560491f68790 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa08013800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x560491df47d0 con 0x560491f6cb40 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa02f47640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560491f6cb40 0x560491f6ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa03748640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x560491f68790 0x560491f68b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38684/0 (socket says 172.21.15.164:38684) 2024-09-14T10:55:25.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa03748640 1 -- 172.21.15.164:0/1149537931 learned_addr learned my addr 172.21.15.164:0/1149537931 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:25.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa02f47640 1 -- 172.21.15.164:0/1149537931 >> v1:172.21.15.116:6789/0 conn(0x560491f68790 legacy=0x560491f68b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa02746640 1 -- 172.21.15.164:0/1149537931 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734704761 0 0) 0x560491f6f5d0 con 0x560491f68790 2024-09-14T10:55:25.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.911+0000 7faa02f47640 1 -- 172.21.15.164:0/1149537931 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560491f70800 con 0x560491f6cb40 2024-09-14T10:55:25.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa02f47640 1 --2- 172.21.15.164:0/1149537931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f6cb40 0x560491f6ef50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51896f0be58e97b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa02746640 1 -- 172.21.15.164:0/1149537931 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec053570 con 0x560491f6cb40 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa02746640 1 -- 172.21.15.164:0/1149537931 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec058070 con 0x560491f6cb40 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa02746640 1 -- 172.21.15.164:0/1149537931 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec053880 con 0x560491f6cb40 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 -- 172.21.15.164:0/1149537931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f6cb40 msgr2=0x560491f6ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 --2- 172.21.15.164:0/1149537931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f6cb40 0x560491f6ef50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a470 tx=0x7fa9ec045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 -- 172.21.15.164:0/1149537931 shutdown_connections 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 --2- 172.21.15.164:0/1149537931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f6cb40 0x560491f6ef50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 -- 172.21.15.164:0/1149537931 >> 172.21.15.164:0/1149537931 conn(0x560491f63f80 msgr2=0x560491f663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.913+0000 7faa08013800 1 -- 172.21.15.164:0/1149537931 shutdown_connections 2024-09-14T10:55:25.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.914+0000 7faa08013800 1 -- 172.21.15.164:0/1149537931 wait complete. 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.927+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.927+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.927+0000 7faa08013800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.927+0000 7faa08013800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560491e01dd0 con 0x560491f68790 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7faa03748640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7faa03748640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33324/0 (socket says 172.21.15.164:33324) 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7faa03748640 1 -- 172.21.15.164:0/322535654 learned_addr learned my addr 172.21.15.164:0/322535654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7faa03748640 1 -- 172.21.15.164:0/322535654 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049205be30 con 0x560491f68790 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7faa03748640 1 --2- 172.21.15.164:0/322535654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006fa0 tx=0x7fa9f4001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed860ac4407bcd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7fa8f160a640 1 -- 172.21.15.164:0/322535654 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4003450 con 0x560491f68790 2024-09-14T10:55:25.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7fa8f160a640 1 -- 172.21.15.164:0/322535654 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4003610 con 0x560491f68790 2024-09-14T10:55:25.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.928+0000 7fa8f160a640 1 -- 172.21.15.164:0/322535654 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4003970 con 0x560491f68790 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- 172.21.15.164:0/322535654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 msgr2=0x56049205b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 --2- 172.21.15.164:0/322535654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006fa0 tx=0x7fa9f4001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- 172.21.15.164:0/322535654 shutdown_connections 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 --2- 172.21.15.164:0/322535654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x56049205b840 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- 172.21.15.164:0/322535654 >> 172.21.15.164:0/322535654 conn(0x560491f63f80 msgr2=0x560492052db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- 172.21.15.164:0/322535654 shutdown_connections 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- 172.21.15.164:0/322535654 wait complete. 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.929+0000 7faa08013800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560491f6faa0 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa03748640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa03748640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33328/0 (socket says 172.21.15.164:33328) 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa03748640 1 -- 172.21.15.164:0/4208225837 learned_addr learned my addr 172.21.15.164:0/4208225837 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa03748640 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604920638a0 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa03748640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001330 tx=0x7fa9f4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7fa8efe07640 1 -- 172.21.15.164:0/4208225837 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f4014a10 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7fa8efe07640 1 -- 172.21.15.164:0/4208225837 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4014bb0 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560492063b30 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7fa8efe07640 1 -- 172.21.15.164:0/4208225837 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f401e3f0 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.930+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560492064530 con 0x560491f68790 2024-09-14T10:55:25.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7fa8efe07640 1 -- 172.21.15.164:0/4208225837 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa9f4010070 con 0x560491f68790 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7fa8efe07640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 0x7fa8e803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7fa8efe07640 1 -- 172.21.15.164:0/4208225837 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa9f4018070 con 0x560491f68790 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7faa02f47640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 0x7fa8e803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 0x56049206a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.931+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56049206aed0 con 0x560491f6cb40 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa03f49640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 0x56049206a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa02f47640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 0x7fa8e803f320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec057000 tx=0x7fa9ec052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa03f49640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 0x56049206a990 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa03f49640 1 -- 172.21.15.164:0/4208225837 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x560491f6cb40 2024-09-14T10:55:25.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56049206b270 con 0x560491f6cb40 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa03f49640 1 -- 172.21.15.164:0/4208225837 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9fc0083e0 con 0x560491f6cb40 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.932+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 0x56049206f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56049206f980 con 0x56049206cd70 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa03748640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 0x56049206f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa03748640 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 0x56049206f1f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa03748640 1 -- 172.21.15.164:0/4208225837 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9f401b070 con 0x56049206cd70 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56049206bac0 con 0x560491f6cb40 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa03f49640 1 -- 172.21.15.164:0/4208225837 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9fc0083e0 con 0x560491f6cb40 2024-09-14T10:55:25.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.933+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56049206bf10 con 0x560491f6cb40 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa03f49640 1 -- 172.21.15.164:0/4208225837 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9fc0083e0 con 0x560491f6cb40 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa08013800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa08013800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560491e604a0 con 0x56049207e3c0 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33330/0 (socket says 172.21.15.164:33330) 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.934+0000 7faa03f49640 1 -- 172.21.15.164:0/2987162227 learned_addr learned my addr 172.21.15.164:0/2987162227 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7faa03f49640 1 -- 172.21.15.164:0/2987162227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049207ee20 con 0x56049207e3c0 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7faa03f49640 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x560492065270 tx=0x7fa9fc00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7fa8ed602640 1 -- 172.21.15.164:0/2987162227 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc007dc0 con 0x56049207e3c0 2024-09-14T10:55:25.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7fa8ed602640 1 -- 172.21.15.164:0/2987162227 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc01e020 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7fa8ed602640 1 -- 172.21.15.164:0/2987162227 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc019570 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56049207f650 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.935+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56049207fbf0 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7fa8ed602640 1 -- 172.21.15.164:0/2987162227 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa9fc016040 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7fa8ed602640 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 0x7fa8dc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7fa8ed602640 1 -- 172.21.15.164:0/2987162227 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa9fc01f030 con 0x56049207e3c0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7faa03748640 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 0x7fa8dc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.936+0000 7faa03748640 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 0x7fa8dc03f2d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x560492065430 tx=0x7fa9f4014fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa08013800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa08013800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56049205c260 con 0x56049208aee0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33344/0 (socket says 172.21.15.164:33344) 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa03f49640 1 -- 172.21.15.164:0/1980048224 learned_addr learned my addr 172.21.15.164:0/1980048224 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa03f49640 1 -- 172.21.15.164:0/1980048224 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049208b8d0 con 0x56049208aee0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7faa03f49640 1 --2- 172.21.15.164:0/1980048224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc014d90 tx=0x7fa9fc014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a34cc30b7c0861c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7fa8e6ffd640 1 -- 172.21.15.164:0/1980048224 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc01d070 con 0x56049208aee0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7fa8e6ffd640 1 -- 172.21.15.164:0/1980048224 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc045260 con 0x56049208aee0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.937+0000 7fa8e6ffd640 1 -- 172.21.15.164:0/1980048224 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc04da90 con 0x56049208aee0 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- 172.21.15.164:0/1980048224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 msgr2=0x56049208b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 --2- 172.21.15.164:0/1980048224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc014d90 tx=0x7fa9fc014d00 comp rx=0 tx=0).stop 2024-09-14T10:55:25.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- 172.21.15.164:0/1980048224 shutdown_connections 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 --2- 172.21.15.164:0/1980048224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x56049208b2e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- 172.21.15.164:0/1980048224 >> 172.21.15.164:0/1980048224 conn(0x5604920872e0 msgr2=0x560492085520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- 172.21.15.164:0/1980048224 shutdown_connections 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- 172.21.15.164:0/1980048224 wait complete. 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 Processor -- start 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- start start 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa08013800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56049208bef0 con 0x56049208aee0 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa03f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33354/0 (socket says 172.21.15.164:33354) 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.938+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 learned_addr learned my addr 172.21.15.164:0/2078734254 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:25.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560492092a10 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7faa03f49640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc014d90 tx=0x7fa9fc0543f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7fa8e57fa640 1 -- 172.21.15.164:0/2078734254 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc045410 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7fa8e57fa640 1 -- 172.21.15.164:0/2078734254 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc031070 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560492092ca0 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7fa8e57fa640 1 -- 172.21.15.164:0/2078734254 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9fc019a50 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560492093620 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.939+0000 7fa8e57fa640 1 -- 172.21.15.164:0/2078734254 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa9fc022900 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7fa8e57fa640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8cc03ce60 0x7fa8cc03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7fa8e57fa640 1 -- 172.21.15.164:0/2078734254 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa9fc04d050 con 0x56049208aee0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa03748640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8cc03ce60 0x7fa8cc03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa03748640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8cc03ce60 0x7fa8cc03f320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4010d60 tx=0x7fa9f4047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56049209e040 0x5604920a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a0c50 con 0x56049209e040 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.940+0000 7faa02f47640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56049209e040 0x5604920a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa02f47640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56049209e040 0x5604920a0500 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 realm 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a1080 con 0x56049209e040 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a1950 con 0x56049209e040 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.941+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a1cf0 con 0x56049209e040 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5604920a2a50 0x5604920a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a5380 con 0x5604920a2a50 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa03f49640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5604920a2a50 0x5604920a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa03f49640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5604920a2a50 0x5604920a4e40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 20 searching for the correct realm 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.942+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03f49640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa9fc019040 0x7fa9fc0235d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03748640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa9fc019040 0x7fa9fc0235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03748640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa9fc019040 0x7fa9fc0235d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03748640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa9f4053d10 0x7fa9f401d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:25.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.943+0000 7faa02f47640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa9f4053d10 0x7fa9f401d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:25.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.944+0000 7faa02f47640 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa9f4053d10 0x7fa9f401d770 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:25.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.944+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.944+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.944+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.944+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.945+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.946+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.947+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.948+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.949+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x5604920a2a50 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9f4053d10 2024-09-14T10:55:25.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.950+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x56049209e040 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6cd0 con 0x7fa9fc019040 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a5dc0 con 0x56049209e040 2024-09-14T10:55:25.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6660 con 0x56049209e040 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.951+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a5a00 con 0x56049209e040 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 zone default found 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 4 Realm: () 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 zonegroup default 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a6240 con 0x7fa9f4053d10 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a9050 con 0x5604920a2a50 2024-09-14T10:55:25.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920a9690 con 0x5604920a2a50 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.952+0000 7faa08013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.953+0000 7faa08013800 20 started sync module instance, tier type = 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.953+0000 7faa08013800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.953+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920a8460 con 0x7fa9fc019040 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.954+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.954+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94577630019504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920a9af0 con 0x7fa9fc019040 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.954+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920aa340 con 0x56049209e040 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.954+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94577630019504] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.955+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.955+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94577630027408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920a8960 con 0x56049209e040 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.955+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920aaee0 con 0x5604920a2a50 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.956+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94577630027408] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.956+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.956+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94577630030256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920aaea0 con 0x5604920a2a50 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.956+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ab990 con 0x7fa9fc019040 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.957+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.957+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94577630030256] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.957+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94577630033056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ab990 con 0x7fa9fc019040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.957+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920aa2d0 con 0x56049209e040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.958+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94577630033056] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.958+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.958+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94577630035328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920aa2d0 con 0x56049209e040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.958+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920acf50 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.959+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.959+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94577630038688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ad370 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.959+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920addb0 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.959+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94577630035328] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.960+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94577630038688] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.961+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.961+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94577630042240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920acec0 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.961+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ae440 con 0x7fa9f4053d10 2024-09-14T10:55:25.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.961+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94577630042240] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94577630037120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ae440 con 0x7fa9f4053d10 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=0 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=1 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=2 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=3 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=4 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=5 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=6 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94577630037120] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 20 add_watcher() i=7 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:25.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.962+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920b15e0 con 0x56049209e040 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.963+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.963+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94577630056432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920ae440 con 0x56049209e040 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94577630056432] v35'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 5 note: GC not initialized 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7fa8b8fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 20 Filter name: none 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7fa8327fc640 20 reqs_thread_entry: start 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.964+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920e43f0 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa08013800 20 rados->read ofs=0 len=0 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920e4c80 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa08013800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.965+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5604920e5c90 con 0x7fa9fc019040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.966+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.966+0000 7fa8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.966+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94577630056432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.967+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94577630056432] v35'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.967+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94577630019504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x7fa9fc019040 2024-09-14T10:55:25.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.968+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94577630019504] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.968+0000 7faa08013800 20 remove_watcher() i=0 2024-09-14T10:55:25.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.968+0000 7faa08013800 2 removed watcher, disabling cache 2024-09-14T10:55:25.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.968+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94577630027408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x56049209e040 2024-09-14T10:55:25.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.969+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94577630027408] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.969+0000 7faa08013800 20 remove_watcher() i=1 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.969+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94577630030256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x5604920a2a50 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.970+0000 7faa03f49640 1 -- 172.21.15.164:0/2078734254 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94577630030256] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9fc0083e0 con 0x5604920a2a50 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.970+0000 7faa08013800 20 remove_watcher() i=2 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.971+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94577630033056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x7fa9fc019040 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.971+0000 7faa03748640 1 -- 172.21.15.164:0/2078734254 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94577630033056] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401b070 con 0x7fa9fc019040 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.971+0000 7faa08013800 20 remove_watcher() i=3 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.971+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94577630035328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x56049209e040 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.972+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94577630035328] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x56049209e040 2024-09-14T10:55:25.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.972+0000 7faa08013800 20 remove_watcher() i=4 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.972+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94577630038688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.974+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94577630038688] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.974+0000 7faa08013800 20 remove_watcher() i=5 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.974+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94577630042240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.975+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94577630042240] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.975+0000 7faa08013800 20 remove_watcher() i=6 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.975+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94577630037120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5604920e2260 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.975+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94577630037120] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec051070 con 0x7fa9f4053d10 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.975+0000 7faa08013800 20 remove_watcher() i=7 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa9f4053d10 msgr2=0x7fa9f401d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa9f4053d10 0x7fa9f401d770 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56049209e040 msgr2=0x5604920a0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56049209e040 0x5604920a0500 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa9fc019040 msgr2=0x7fa9fc0235d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa9fc019040 0x7fa9fc0235d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5604920a2a50 msgr2=0x5604920a4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5604920a2a50 0x5604920a4e40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8cc03ce60 msgr2=0x7fa8cc03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8cc03ce60 0x7fa8cc03f320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4010d60 tx=0x7fa9f4047000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 msgr2=0x5604920924b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa02f47640 1 -- 172.21.15.164:0/2078734254 reap_dead start 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc014d90 tx=0x7fa9fc0543f0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 shutdown_connections 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2078734254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049208aee0 0x5604920924b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 >> 172.21.15.164:0/2078734254 conn(0x5604920872e0 msgr2=0x5604920854f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 shutdown_connections 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2078734254 wait complete. 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 msgr2=0x7fa8dc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 0x7fa8dc03f2d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x560492065430 tx=0x7fa9f4014fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 msgr2=0x56049207e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x560492065270 tx=0x7fa9fc00af40 comp rx=0 tx=0).stop 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 shutdown_connections 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8dc03ce10 0x7fa8dc03f2d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 --2- 172.21.15.164:0/2987162227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56049207e3c0 0x56049207e7e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 >> 172.21.15.164:0/2987162227 conn(0x560492072770 msgr2=0x560492072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 shutdown_connections 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.976+0000 7faa08013800 1 -- 172.21.15.164:0/2987162227 wait complete. 2024-09-14T10:55:25.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 msgr2=0x56049206a990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 0x56049206a990 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 msgr2=0x56049206f1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 0x56049206f1f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 msgr2=0x7fa8e803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 0x7fa8e803f320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec057000 tx=0x7fa9ec052000 comp rx=0 tx=0).stop 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 msgr2=0x560492063340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4001330 tx=0x7fa9f4001250 comp rx=0 tx=0).stop 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 shutdown_connections 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56049206cd70 0x56049206f1f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560491f6cb40 0x56049206a990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa8e803ce60 0x7fa8e803f320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 --2- 172.21.15.164:0/4208225837 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560491f68790 0x560492063340 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:25.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 >> 172.21.15.164:0/4208225837 conn(0x560491f63f80 msgr2=0x56049205cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:25.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 shutdown_connections 2024-09-14T10:55:25.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:25.977+0000 7faa08013800 1 -- 172.21.15.164:0/4208225837 wait complete. 2024-09-14T10:55:25.993 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-14T10:55:25.994 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:55:25.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-14T10:55:25.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-14T10:55:25.994 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-14T10:55:26.039 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.039 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745cb46800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559277e8a790 0x559277f19480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745cb46800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559277f1d6e0 con 0x559277f199c0 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745cb46800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x559277da17d0 con 0x559277e8a790 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745a637640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559277e8a790 0x559277f19480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f7453fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x559277f199c0 0x559277f1be80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38694/0 (socket says 172.21.15.164:38694) 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745a637640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559277e8a790 0x559277f19480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33358/0 (socket says 172.21.15.164:33358) 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f7453fff640 1 -- 172.21.15.164:0/1876972641 learned_addr learned my addr 172.21.15.164:0/1876972641 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745a637640 1 -- 172.21.15.164:0/1876972641 >> v1:172.21.15.116:6789/0 conn(0x559277f199c0 legacy=0x559277f1be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f745a637640 1 -- 172.21.15.164:0/1876972641 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559277f1e910 con 0x559277e8a790 2024-09-14T10:55:26.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.042+0000 7f7459e36640 1 -- 172.21.15.164:0/1876972641 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554354689 0 0) 0x559277f1d6e0 con 0x559277f199c0 2024-09-14T10:55:26.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.044+0000 7f745a637640 1 --2- 172.21.15.164:0/1876972641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x559277f19480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ec55c59e4c026 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.044+0000 7f7459e36640 1 -- 172.21.15.164:0/1876972641 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c053570 con 0x559277e8a790 2024-09-14T10:55:26.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.044+0000 7f7459e36640 1 -- 172.21.15.164:0/1876972641 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c058070 con 0x559277e8a790 2024-09-14T10:55:26.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.044+0000 7f7459e36640 1 -- 172.21.15.164:0/1876972641 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c053880 con 0x559277e8a790 2024-09-14T10:55:26.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 -- 172.21.15.164:0/1876972641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 msgr2=0x559277f19480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 --2- 172.21.15.164:0/1876972641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x559277f19480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f744c00a470 tx=0x7f744c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:26.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 -- 172.21.15.164:0/1876972641 shutdown_connections 2024-09-14T10:55:26.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 --2- 172.21.15.164:0/1876972641 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x559277f19480 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 -- 172.21.15.164:0/1876972641 >> 172.21.15.164:0/1876972641 conn(0x559277f10fb0 msgr2=0x559277f133f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 -- 172.21.15.164:0/1876972641 shutdown_connections 2024-09-14T10:55:26.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.045+0000 7f745cb46800 1 -- 172.21.15.164:0/1876972641 wait complete. 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745cb46800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745cb46800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559277daedd0 con 0x559277e8a790 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745a637640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745a637640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33368/0 (socket says 172.21.15.164:33368) 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.059+0000 7f745a637640 1 -- 172.21.15.164:0/1760909969 learned_addr learned my addr 172.21.15.164:0/1760909969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.060+0000 7f745a637640 1 -- 172.21.15.164:0/1760909969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559278006b90 con 0x559277e8a790 2024-09-14T10:55:26.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.060+0000 7f745a637640 1 --2- 172.21.15.164:0/1760909969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f744c025c20 tx=0x7f744c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf6f4edfeb958a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.060+0000 7f7348608640 1 -- 172.21.15.164:0/1760909969 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c053a20 con 0x559277e8a790 2024-09-14T10:55:26.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.060+0000 7f7348608640 1 -- 172.21.15.164:0/1760909969 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c063070 con 0x559277e8a790 2024-09-14T10:55:26.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.060+0000 7f7348608640 1 -- 172.21.15.164:0/1760909969 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c053d30 con 0x559277e8a790 2024-09-14T10:55:26.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- 172.21.15.164:0/1760909969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 msgr2=0x5592780065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 --2- 172.21.15.164:0/1760909969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f744c025c20 tx=0x7f744c051000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- 172.21.15.164:0/1760909969 shutdown_connections 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 --2- 172.21.15.164:0/1760909969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x5592780065a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- 172.21.15.164:0/1760909969 >> 172.21.15.164:0/1760909969 conn(0x559277f10fb0 msgr2=0x559278001f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- 172.21.15.164:0/1760909969 shutdown_connections 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- 172.21.15.164:0/1760909969 wait complete. 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745cb46800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559277f1dbb0 con 0x559277e8a790 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745a637640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745a637640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33370/0 (socket says 172.21.15.164:33370) 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.061+0000 7f745a637640 1 -- 172.21.15.164:0/2038088780 learned_addr learned my addr 172.21.15.164:0/2038088780 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f745a637640 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927800e5e0 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f745a637640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f744c025c20 tx=0x7f744c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f7346e05640 1 -- 172.21.15.164:0/2038088780 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c078070 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f7346e05640 1 -- 172.21.15.164:0/2038088780 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c073470 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927800e870 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f7346e05640 1 -- 172.21.15.164:0/2038088780 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c073750 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.062+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927800f480 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f7346e05640 1 -- 172.21.15.164:0/2038088780 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f744c07b070 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f7346e05640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 0x7f734003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f7346e05640 1 -- 172.21.15.164:0/2038088780 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f744c0984f0 con 0x559277e8a790 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f7453fff640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 0x7f734003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 0x5592780156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927800fe40 con 0x559277f199c0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f745ae38640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 0x5592780156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.063+0000 7f7453fff640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 0x7f734003f2d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7444000c00 tx=0x7f74440013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745ae38640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 0x5592780156d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745ae38640 1 -- 172.21.15.164:0/2038088780 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f745400a4d0 con 0x559277f199c0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927800f7f0 con 0x559277f199c0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745ae38640 1 -- 172.21.15.164:0/2038088780 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f745400a4d0 con 0x559277f199c0 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 0x559278019f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927801a600 con 0x559278017b40 2024-09-14T10:55:26.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.064+0000 7f745a637640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 0x559278019f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745a637640 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 0x559278019f30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745a637640 1 -- 172.21.15.164:0/2038088780 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f744c07a030 con 0x559278017b40 2024-09-14T10:55:26.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592780169e0 con 0x559277f199c0 2024-09-14T10:55:26.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745ae38640 1 -- 172.21.15.164:0/2038088780 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f745400a4d0 con 0x559277f199c0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278016e80 con 0x559277f199c0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.065+0000 7f745ae38640 1 -- 172.21.15.164:0/2038088780 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f745400a4d0 con 0x559277f199c0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745cb46800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745cb46800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559277e0d4a0 con 0x559278028fe0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33382/0 (socket says 172.21.15.164:33382) 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745ae38640 1 -- 172.21.15.164:0/1493591374 learned_addr learned my addr 172.21.15.164:0/1493591374 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.066+0000 7f745ae38640 1 -- 172.21.15.164:0/1493591374 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559278029a40 con 0x559278028fe0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f745ae38640 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x559278015c10 tx=0x7f7454018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f733ffff640 1 -- 172.21.15.164:0/1493591374 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454014450 con 0x559278028fe0 2024-09-14T10:55:26.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f733ffff640 1 -- 172.21.15.164:0/1493591374 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74540145f0 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927802a270 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f733ffff640 1 -- 172.21.15.164:0/1493591374 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454014910 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.067+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927802a810 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f733ffff640 1 -- 172.21.15.164:0/1493591374 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7454011040 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f733ffff640 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 0x7f733403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f733ffff640 1 -- 172.21.15.164:0/1493591374 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f745401e070 con 0x559278028fe0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745a637640 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 0x7f733403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745a637640 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 0x7f733403f2d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x559278015cb0 tx=0x7f744c096ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745cb46800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745cb46800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559278006f60 con 0x559278035aa0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33384/0 (socket says 172.21.15.164:33384) 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.068+0000 7f745ae38640 1 -- 172.21.15.164:0/4011030726 learned_addr learned my addr 172.21.15.164:0/4011030726 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745ae38640 1 -- 172.21.15.164:0/4011030726 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559278036470 con 0x559278035aa0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745ae38640 1 --2- 172.21.15.164:0/4011030726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7454016fd0 tx=0x7f7454011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672b35deef2b4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f733dffb640 1 -- 172.21.15.164:0/4011030726 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745404b070 con 0x559278035aa0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f733dffb640 1 -- 172.21.15.164:0/4011030726 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454051070 con 0x559278035aa0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f733dffb640 1 -- 172.21.15.164:0/4011030726 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454022db0 con 0x559278035aa0 2024-09-14T10:55:26.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 -- 172.21.15.164:0/4011030726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 msgr2=0x559278035e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 --2- 172.21.15.164:0/4011030726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7454016fd0 tx=0x7f7454011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 -- 172.21.15.164:0/4011030726 shutdown_connections 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 --2- 172.21.15.164:0/4011030726 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x559278035e80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 -- 172.21.15.164:0/4011030726 >> 172.21.15.164:0/4011030726 conn(0x559278031ea0 msgr2=0x5592780300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 -- 172.21.15.164:0/4011030726 shutdown_connections 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.069+0000 7f745cb46800 1 -- 172.21.15.164:0/4011030726 wait complete. 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745cb46800 1 Processor -- start 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745cb46800 1 -- start start 2024-09-14T10:55:26.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745cb46800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x55927803d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745cb46800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559278036ab0 con 0x559278035aa0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x55927803d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745ae38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x55927803d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33388/0 (socket says 172.21.15.164:33388) 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 learned_addr learned my addr 172.21.15.164:0/1116210701 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.070+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55927803d5e0 con 0x559278035aa0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f745ae38640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x55927803d080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7454053400 tx=0x7f7454054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f732bfff640 1 -- 172.21.15.164:0/1116210701 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f745404b040 con 0x559278035aa0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f732bfff640 1 -- 172.21.15.164:0/1116210701 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454031030 con 0x559278035aa0 2024-09-14T10:55:26.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f732bfff640 1 -- 172.21.15.164:0/1116210701 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454016910 con 0x559278035aa0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55927803d870 con 0x559278035aa0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55927803e400 con 0x559278035aa0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.071+0000 7f732bfff640 1 -- 172.21.15.164:0/1116210701 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7454011330 con 0x559278035aa0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f732bfff640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f732bfff640 1 -- 172.21.15.164:0/1116210701 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f745400e040 con 0x559278035aa0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f745a637640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559278048df0 0x55927804b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927804ba00 con 0x559278048df0 2024-09-14T10:55:26.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f7453fff640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559278048df0 0x55927804b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f745a637640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f744c05db10 tx=0x7f744c091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.072+0000 7f7453fff640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559278048df0 0x55927804b2b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744400f5f0 con 0x559278048df0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 realm 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278048190 con 0x559278048df0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744400f5f0 con 0x559278048df0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927804c4e0 con 0x559278048df0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744400f5f0 con 0x559278048df0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927804cdb0 con 0x559278048df0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f744400f5f0 con 0x559278048df0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55927804d6b0 0x55927804fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.073+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278050220 con 0x55927804d6b0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55927804d6b0 0x55927804fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55927804d6b0 0x55927804fac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f745403e070 con 0x55927804d6b0 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745cb46800 20 searching for the correct realm 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f745403e070 con 0x55927804d6b0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7454014070 0x7f7454001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.074+0000 7f745a637640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7454014070 0x7f7454001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.075+0000 7f745a637640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7454014070 0x7f7454001770 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.075+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.075+0000 7f745a637640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f744c0a6040 0x7f744c05c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.075+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.075+0000 7f7453fff640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f744c0a6040 0x7f744c05c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f744c0a6040 0x7f744c05c870 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744400f5f0 con 0x7f744c0a6040 2024-09-14T10:55:26.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744400f5f0 con 0x559278048df0 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x7f744c0a6040 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.076+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x7f744c0a6040 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745403e070 con 0x55927804d6b0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.077+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x7f744c0a6040 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f745403e070 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.078+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x7f744c0a6040 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.079+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x7f744c0a6040 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.080+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744402b040 con 0x559278048df0 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.081+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x55927804d6b0 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f744c0a6040 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x559278048df0 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.082+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559278051be0 con 0x7f7454014070 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278050cd0 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278051570 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278050910 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.083+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 zone default found 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 4 Realm: () 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 zonegroup default 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278052090 con 0x7f744c0a6040 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278053bb0 con 0x55927804d6b0 2024-09-14T10:55:26.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278054020 con 0x55927804d6b0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 started sync module instance, tier type = 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.084+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278052f20 con 0x7f7454014070 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.085+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.085+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94087567192848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278054930 con 0x7f7454014070 2024-09-14T10:55:26.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.085+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278055180 con 0x559278048df0 2024-09-14T10:55:26.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.088+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.088+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94087567199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278055740 con 0x559278048df0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.088+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278056240 con 0x55927804d6b0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.088+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94087567192848] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.089+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94087567199440] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.089+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.089+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94087567203632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278055190 con 0x55927804d6b0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.089+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278056820 con 0x7f7454014070 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.090+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.090+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94087567205232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278056c80 con 0x7f7454014070 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.090+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94087567203632] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.090+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278054480 con 0x559278048df0 2024-09-14T10:55:26.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.091+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.091+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94087567205232] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.091+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94087567208560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278057940 con 0x559278048df0 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.091+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278056790 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.092+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94087567208560] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.092+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.092+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94087567209616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592780578b0 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.092+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592780587b0 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.093+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94087567209616] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.093+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.093+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94087567212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278058720 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.093+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592780590e0 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94087567212112] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94087567213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592780590e0 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=0 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=1 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=2 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=3 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=4 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=5 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.094+0000 7f745cb46800 20 add_watcher() i=6 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.095+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94087567213648] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.095+0000 7f745cb46800 20 add_watcher() i=7 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.095+0000 7f745cb46800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.095+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927805c4e0 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.096+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.096+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94087567216128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278059a00 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94087567216128] v35'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f7310fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 5 note: GC not initialized 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f728b7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 20 Filter name: none 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f72897fa640 20 reqs_thread_entry: start 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.097+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927808f310 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745cb46800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55927808fba0 con 0x559278048df0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745cb46800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559278090bb0 con 0x7f7454014070 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.098+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.099+0000 7f7310fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.099+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94087567216128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55927808d160 con 0x559278048df0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.100+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94087567216128] v35'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.100+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94087567192848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55927808d160 con 0x7f7454014070 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.101+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94087567192848] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.101+0000 7f745cb46800 20 remove_watcher() i=0 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.101+0000 7f745cb46800 2 removed watcher, disabling cache 2024-09-14T10:55:26.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.101+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94087567199440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278077f90 con 0x559278048df0 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.102+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94087567199440] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.102+0000 7f745cb46800 20 remove_watcher() i=1 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.102+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94087567203632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55927808d160 con 0x55927804d6b0 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.103+0000 7f745ae38640 1 -- 172.21.15.164:0/1116210701 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94087567203632] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7454066040 con 0x55927804d6b0 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.103+0000 7f745cb46800 20 remove_watcher() i=2 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.103+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94087567205232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278077f90 con 0x7f7454014070 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.104+0000 7f745a637640 1 -- 172.21.15.164:0/1116210701 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94087567205232] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744c07a030 con 0x7f7454014070 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.104+0000 7f745cb46800 20 remove_watcher() i=3 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.104+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94087567208560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55927808d160 con 0x559278048df0 2024-09-14T10:55:26.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.105+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94087567208560] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x559278048df0 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.105+0000 7f745cb46800 20 remove_watcher() i=4 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.105+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94087567209616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278077f90 con 0x7f744c0a6040 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.106+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94087567209616] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.106+0000 7f745cb46800 20 remove_watcher() i=5 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.106+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94087567212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55927808d160 con 0x7f744c0a6040 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.107+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94087567212112] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.107+0000 7f745cb46800 20 remove_watcher() i=6 2024-09-14T10:55:26.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.107+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94087567213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559278077f90 con 0x7f744c0a6040 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94087567213648] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f744403b040 con 0x7f744c0a6040 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 20 remove_watcher() i=7 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f744c0a6040 msgr2=0x7f744c05c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f744c0a6040 0x7f744c05c870 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559278048df0 msgr2=0x55927804b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559278048df0 0x55927804b2b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7454014070 msgr2=0x7f7454001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7454014070 0x7f7454001770 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55927804d6b0 msgr2=0x55927804fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55927804d6b0 0x55927804fac0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 msgr2=0x7f732403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f732403ce10 0x7f732403f2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f744c05db10 tx=0x7f744c091000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 msgr2=0x55927803d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 --2- 172.21.15.164:0/1116210701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278035aa0 0x55927803d080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7454053400 tx=0x7f7454054510 comp rx=0 tx=0).stop 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 reap_dead start 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f7453fff640 1 -- 172.21.15.164:0/1116210701 reap_dead start 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 shutdown_connections 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 >> 172.21.15.164:0/1116210701 conn(0x559278031ea0 msgr2=0x5592780300b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 shutdown_connections 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.108+0000 7f745cb46800 1 -- 172.21.15.164:0/1116210701 wait complete. 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 msgr2=0x7f733403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 0x7f733403f2d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x559278015cb0 tx=0x7f744c096ad0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 msgr2=0x559278029400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x559278015c10 tx=0x7f7454018830 comp rx=0 tx=0).stop 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 shutdown_connections 2024-09-14T10:55:26.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f733403ce10 0x7f733403f2d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/1493591374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559278028fe0 0x559278029400 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 >> 172.21.15.164:0/1493591374 conn(0x55927801d390 msgr2=0x55927801d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 shutdown_connections 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/1493591374 wait complete. 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 msgr2=0x5592780156d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 0x5592780156d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 msgr2=0x559278019f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 0x559278019f30 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 msgr2=0x7f734003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 0x7f734003f2d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7444000c00 tx=0x7f74440013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 msgr2=0x55927800e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f744c025c20 tx=0x7f744c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 shutdown_connections 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559278017b40 0x559278019f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559277f199c0 0x5592780156d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f734003ce10 0x7f734003f2d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 --2- 172.21.15.164:0/2038088780 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559277e8a790 0x55927800e080 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 >> 172.21.15.164:0/2038088780 conn(0x559277f10fb0 msgr2=0x559278007990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 shutdown_connections 2024-09-14T10:55:26.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.109+0000 7f745cb46800 1 -- 172.21.15.164:0/2038088780 wait complete. 2024-09-14T10:55:26.127 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-14T10:55:26.127 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:55:26.142 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-14T10:55:26.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-14T10:55:26.142 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-14T10:55:26.187 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.187 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b654bb800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55aebd88bb40 0x55aebd88df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b654bb800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aebd88e5d0 con 0x55aebd887790 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b654bb800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55aebd7137d0 con 0x55aebd88bb40 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b627a4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55aebd88bb40 0x55aebd88df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b62fa5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55aebd887790 0x55aebd887b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38710/0 (socket says 172.21.15.164:38710) 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.190+0000 7f5b62fa5640 1 -- 172.21.15.164:0/3370697469 learned_addr learned my addr 172.21.15.164:0/3370697469 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:26.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.191+0000 7f5b627a4640 1 -- 172.21.15.164:0/3370697469 >> v1:172.21.15.116:6789/0 conn(0x55aebd887790 legacy=0x55aebd887b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.191+0000 7f5b61fa3640 1 -- 172.21.15.164:0/3370697469 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623609330 0 0) 0x55aebd88e5d0 con 0x55aebd887790 2024-09-14T10:55:26.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.191+0000 7f5b627a4640 1 -- 172.21.15.164:0/3370697469 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd88f800 con 0x55aebd88bb40 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.192+0000 7f5b627a4640 1 --2- 172.21.15.164:0/3370697469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd88bb40 0x55aebd88df50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00a470 tx=0x7f5b4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6c0dc9c04b70cf server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b61fa3640 1 -- 172.21.15.164:0/3370697469 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c053570 con 0x55aebd88bb40 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b61fa3640 1 -- 172.21.15.164:0/3370697469 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b4c058070 con 0x55aebd88bb40 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b61fa3640 1 -- 172.21.15.164:0/3370697469 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b4c053880 con 0x55aebd88bb40 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 -- 172.21.15.164:0/3370697469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd88bb40 msgr2=0x55aebd88df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 --2- 172.21.15.164:0/3370697469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd88bb40 0x55aebd88df50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c00a470 tx=0x7f5b4c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:26.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 -- 172.21.15.164:0/3370697469 shutdown_connections 2024-09-14T10:55:26.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 --2- 172.21.15.164:0/3370697469 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd88bb40 0x55aebd88df50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 -- 172.21.15.164:0/3370697469 >> 172.21.15.164:0/3370697469 conn(0x55aebd882f80 msgr2=0x55aebd8853e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 -- 172.21.15.164:0/3370697469 shutdown_connections 2024-09-14T10:55:26.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.193+0000 7f5b654bb800 1 -- 172.21.15.164:0/3370697469 wait complete. 2024-09-14T10:55:26.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.207+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.207+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.207+0000 7f5b654bb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.207+0000 7f5b654bb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aebd720dd0 con 0x55aebd887790 2024-09-14T10:55:26.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.207+0000 7f5b62fa5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5b62fa5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33408/0 (socket says 172.21.15.164:33408) 2024-09-14T10:55:26.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5b62fa5640 1 -- 172.21.15.164:0/135950187 learned_addr learned my addr 172.21.15.164:0/135950187 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5b62fa5640 1 -- 172.21.15.164:0/135950187 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd97b1e0 con 0x55aebd887790 2024-09-14T10:55:26.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/135950187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006fa0 tx=0x7f5b5c001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6814286c6af81 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5a50e09640 1 -- 172.21.15.164:0/135950187 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c003450 con 0x55aebd887790 2024-09-14T10:55:26.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5a50e09640 1 -- 172.21.15.164:0/135950187 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5c003610 con 0x55aebd887790 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.208+0000 7f5a50e09640 1 -- 172.21.15.164:0/135950187 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c003970 con 0x55aebd887790 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- 172.21.15.164:0/135950187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 msgr2=0x55aebd7fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 --2- 172.21.15.164:0/135950187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006fa0 tx=0x7f5b5c001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- 172.21.15.164:0/135950187 shutdown_connections 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 --2- 172.21.15.164:0/135950187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd7fbd80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- 172.21.15.164:0/135950187 >> 172.21.15.164:0/135950187 conn(0x55aebd882f80 msgr2=0x55aebd972ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- 172.21.15.164:0/135950187 shutdown_connections 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- 172.21.15.164:0/135950187 wait complete. 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.209+0000 7f5b654bb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aebd88eaa0 con 0x55aebd887790 2024-09-14T10:55:26.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b62fa5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b62fa5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33424/0 (socket says 172.21.15.164:33424) 2024-09-14T10:55:26.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b62fa5640 1 -- 172.21.15.164:0/4082917169 learned_addr learned my addr 172.21.15.164:0/4082917169 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b62fa5640 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd980690 con 0x55aebd887790 2024-09-14T10:55:26.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c001330 tx=0x7f5b5c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5a4f606640 1 -- 172.21.15.164:0/4082917169 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c014a10 con 0x55aebd887790 2024-09-14T10:55:26.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5a4f606640 1 -- 172.21.15.164:0/4082917169 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5c014bb0 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd980920 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5a4f606640 1 -- 172.21.15.164:0/4082917169 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5c01e3f0 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.210+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd981320 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.211+0000 7f5a4f606640 1 -- 172.21.15.164:0/4082917169 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5b5c010070 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.211+0000 7f5a4f606640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 0x7f5a4803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.211+0000 7f5a4f606640 1 -- 172.21.15.164:0/4082917169 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b5c018070 con 0x55aebd887790 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.211+0000 7f5b627a4640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 0x7f5a4803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 0x55aebd987780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd987cc0 con 0x55aebd88bb40 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b637a6640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 0x55aebd987780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b627a4640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 0x7f5a4803f2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c057000 tx=0x7f5b4c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b637a6640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 0x55aebd987780 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b637a6640 1 -- 172.21.15.164:0/4082917169 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd88bb40 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.212+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd988060 con 0x55aebd88bb40 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b637a6640 1 -- 172.21.15.164:0/4082917169 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd88bb40 2024-09-14T10:55:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 0x55aebd98bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd98c730 con 0x55aebd989b20 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 0x55aebd98bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 0x55aebd98bfa0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b62fa5640 1 -- 172.21.15.164:0/4082917169 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b5c01b070 con 0x55aebd989b20 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.213+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9888b0 con 0x55aebd88bb40 2024-09-14T10:55:26.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b637a6640 1 -- 172.21.15.164:0/4082917169 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd88bb40 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd988c90 con 0x55aebd88bb40 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b637a6640 1 -- 172.21.15.164:0/4082917169 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd88bb40 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b654bb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.214+0000 7f5b654bb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aebd77f4a0 con 0x55aebd99b170 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33436/0 (socket says 172.21.15.164:33436) 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b637a6640 1 -- 172.21.15.164:0/1382545891 learned_addr learned my addr 172.21.15.164:0/1382545891 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b637a6640 1 -- 172.21.15.164:0/1382545891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd99bbd0 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b637a6640 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55aebd982020 tx=0x7f5b5400af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5a4ce01640 1 -- 172.21.15.164:0/1382545891 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54007d60 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5a4ce01640 1 -- 172.21.15.164:0/1382545891 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5401e020 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd99c400 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5a4ce01640 1 -- 172.21.15.164:0/1382545891 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54019590 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.215+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd99c9a0 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.216+0000 7f5a4ce01640 1 -- 172.21.15.164:0/1382545891 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5b54016040 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.216+0000 7f5a4ce01640 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 0x7f5a3c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.216+0000 7f5a4ce01640 1 -- 172.21.15.164:0/1382545891 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b5401f030 con 0x55aebd99b170 2024-09-14T10:55:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.216+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 0x7f5a3c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 0x7f5a3c03f320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55aebd9821e0 tx=0x7f5b5c054040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b654bb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b654bb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aebd97b4c0 con 0x55aebd9a7c30 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33450/0 (socket says 172.21.15.164:33450) 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b637a6640 1 -- 172.21.15.164:0/4047668143 learned_addr learned my addr 172.21.15.164:0/4047668143 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b637a6640 1 -- 172.21.15.164:0/4047668143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd9a8620 con 0x55aebd9a7c30 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.217+0000 7f5b637a6640 1 --2- 172.21.15.164:0/4047668143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b540543d0 tx=0x7f5b54045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66623661da6c97b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5a467fc640 1 -- 172.21.15.164:0/4047668143 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5401d040 con 0x55aebd9a7c30 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5a467fc640 1 -- 172.21.15.164:0/4047668143 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5404b070 con 0x55aebd9a7c30 2024-09-14T10:55:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5a467fc640 1 -- 172.21.15.164:0/4047668143 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54017ac0 con 0x55aebd9a7c30 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- 172.21.15.164:0/4047668143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 msgr2=0x55aebd9a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4047668143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5b540543d0 tx=0x7f5b54045490 comp rx=0 tx=0).stop 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- 172.21.15.164:0/4047668143 shutdown_connections 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4047668143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9a8030 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- 172.21.15.164:0/4047668143 >> 172.21.15.164:0/4047668143 conn(0x55aebd9a4030 msgr2=0x55aebd9a2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- 172.21.15.164:0/4047668143 shutdown_connections 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- 172.21.15.164:0/4047668143 wait complete. 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 Processor -- start 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.218+0000 7f5b654bb800 1 -- start start 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b654bb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b654bb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55aebd9a8c40 con 0x55aebd9a7c30 2024-09-14T10:55:26.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b637a6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33466/0 (socket says 172.21.15.164:33466) 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 learned_addr learned my addr 172.21.15.164:0/2235207436 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebd978e50 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b637a6640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5b54048040 tx=0x7f5b54054360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5a44ff9640 1 -- 172.21.15.164:0/2235207436 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5401d070 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5a44ff9640 1 -- 172.21.15.164:0/2235207436 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54017500 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aebd977200 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5a44ff9640 1 -- 172.21.15.164:0/2235207436 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54017820 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.219+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebd9777a0 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.220+0000 7f5a44ff9640 1 -- 172.21.15.164:0/2235207436 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5b54019730 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.220+0000 7f5a44ff9640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a2c03cdc0 0x7f5a2c03f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.220+0000 7f5a44ff9640 1 -- 172.21.15.164:0/2235207436 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5b54033030 con 0x55aebd9a7c30 2024-09-14T10:55:26.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.220+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a2c03cdc0 0x7f5a2c03f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd9bcf80 0x55aebd9bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9bfb90 con 0x55aebd9bcf80 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a2c03cdc0 0x7f5a2c03f280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c01e810 tx=0x7f5b5c03f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b627a4640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd9bcf80 0x55aebd9bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b627a4640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd9bcf80 0x55aebd9bf440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 20 realm 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.221+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9bffc0 con 0x55aebd9bcf80 2024-09-14T10:55:26.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c0890 con 0x55aebd9bcf80 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c0c30 con 0x55aebd9bcf80 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd9c1990 0x55aebd9c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c42c0 con 0x55aebd9c1990 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.222+0000 7f5b637a6640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd9c1990 0x55aebd9c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b637a6640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd9c1990 0x55aebd9c3d80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b654bb800 20 searching for the correct realm 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b637a6640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5b54019040 0x7f5b5402da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.223+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5b54019040 0x7f5b5402da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5b54019040 0x7f5b5402da20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b62fa5640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5b5c044040 0x7f5b5c054720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b627a4640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5b5c044040 0x7f5b5c054720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.224+0000 7f5b627a4640 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5b5c044040 0x7f5b5c054720 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.225+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.226+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.227+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.228+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.229+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.230+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9c1990 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.231+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b5c044040 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x55aebd9bcf80 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5c10 con 0x7f5b54019040 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.232+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c4d30 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c55d0 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c4970 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 zone default found 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 4 Realm: () 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 zonegroup default 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c5200 con 0x7f5b5c044040 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.233+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c7fe0 con 0x55aebd9c1990 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c85b0 con 0x55aebd9c1990 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 20 started sync module instance, tier type = 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.234+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c7450 con 0x7f5b54019040 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.235+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.235+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208993816480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c8a10 con 0x7f5b54019040 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.235+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c9260 con 0x55aebd9bcf80 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.236+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208993816480] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.236+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.236+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208993824176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c9680 con 0x55aebd9bcf80 2024-09-14T10:55:26.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.236+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c9ed0 con 0x55aebd9c1990 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.237+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208993824176] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.237+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.237+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208993825712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9c9de0 con 0x55aebd9c1990 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.237+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9ca8d0 con 0x7f5b54019040 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.238+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208993825712] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.238+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.238+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208993829792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9ca890 con 0x7f5b54019040 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.238+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cb360 con 0x55aebd9bcf80 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.239+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208993829792] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.239+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.239+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208993832496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cb320 con 0x55aebd9bcf80 2024-09-14T10:55:26.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.239+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cbe10 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.240+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.240+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208993835296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cbe10 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.240+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9ccd70 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.240+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208993832496] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.241+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208993835296] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.241+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.241+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208993826864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cc030 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.241+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cd220 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208993840496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cd640 con 0x7f5b5c044040 2024-09-14T10:55:26.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=0 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=1 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=2 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=3 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=4 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=5 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208993826864] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=6 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208993840496] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 20 add_watcher() i=7 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.243+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cd640 con 0x55aebd9bcf80 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.244+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.244+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208993841552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebd9cd5b0 con 0x55aebd9bcf80 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208993841552] v35'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5a197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b654bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b654bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b654bb800 5 note: GC not initialized 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5993fff640 20 reqs_thread_entry: start 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b654bb800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5b654bb800 20 Filter name: none 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.245+0000 7f5991ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:26.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebda03490 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebda03d20 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.246+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55aebda04d30 con 0x7f5b54019040 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.247+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.247+0000 7f5a197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.247+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208993841552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.248+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94208993841552] v35'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.248+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208993816480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x7f5b54019040 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.249+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94208993816480] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.249+0000 7f5b654bb800 20 remove_watcher() i=0 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.249+0000 7f5b654bb800 2 removed watcher, disabling cache 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.249+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208993824176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x55aebd9bcf80 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.250+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94208993824176] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.250+0000 7f5b654bb800 20 remove_watcher() i=1 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.250+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208993825712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x55aebd9c1990 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.252+0000 7f5b637a6640 1 -- 172.21.15.164:0/2235207436 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94208993825712] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540083e0 con 0x55aebd9c1990 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.252+0000 7f5b654bb800 20 remove_watcher() i=2 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.252+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208993829792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x7f5b54019040 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.252+0000 7f5b62fa5640 1 -- 172.21.15.164:0/2235207436 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94208993829792] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040030 con 0x7f5b54019040 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.253+0000 7f5b654bb800 20 remove_watcher() i=3 2024-09-14T10:55:26.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.253+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208993832496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x55aebd9bcf80 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.254+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94208993832496] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x55aebd9bcf80 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.254+0000 7f5b654bb800 20 remove_watcher() i=4 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.254+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208993835296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.255+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94208993835296] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.255+0000 7f5b654bb800 20 remove_watcher() i=5 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.255+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208993826864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.255+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94208993826864] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.255+0000 7f5b654bb800 20 remove_watcher() i=6 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.256+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208993840496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55aebda01300 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.256+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94208993840496] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c051070 con 0x7f5b5c044040 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.256+0000 7f5b654bb800 20 remove_watcher() i=7 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5b5c044040 msgr2=0x7f5b5c054720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5b5c044040 0x7f5b5c054720 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd9bcf80 msgr2=0x55aebd9bf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd9bcf80 0x55aebd9bf440 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5b54019040 msgr2=0x7f5b5402da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5b54019040 0x7f5b5402da20 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd9c1990 msgr2=0x55aebd9c3d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd9c1990 0x55aebd9c3d80 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a2c03cdc0 msgr2=0x7f5a2c03f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a2c03cdc0 0x7f5a2c03f280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c01e810 tx=0x7f5b5c03f000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 msgr2=0x55aebd9788f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b627a4640 1 -- 172.21.15.164:0/2235207436 reap_dead start 2024-09-14T10:55:26.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5b54048040 tx=0x7f5b54054360 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 shutdown_connections 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/2235207436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd9a7c30 0x55aebd9788f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 >> 172.21.15.164:0/2235207436 conn(0x55aebd9a4030 msgr2=0x55aebd9a2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 shutdown_connections 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/2235207436 wait complete. 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 msgr2=0x7f5a3c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 0x7f5a3c03f320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55aebd9821e0 tx=0x7f5b5c054040 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 msgr2=0x55aebd99b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55aebd982020 tx=0x7f5b5400af20 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 shutdown_connections 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a3c03ce60 0x7f5a3c03f320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 --2- 172.21.15.164:0/1382545891 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd99b170 0x55aebd99b590 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 >> 172.21.15.164:0/1382545891 conn(0x55aebd98f520 msgr2=0x55aebd98f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 shutdown_connections 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.257+0000 7f5b654bb800 1 -- 172.21.15.164:0/1382545891 wait complete. 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 msgr2=0x55aebd987780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 0x55aebd987780 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 msgr2=0x55aebd98bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 0x55aebd98bfa0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 msgr2=0x7f5a4803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 0x7f5a4803f2d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c057000 tx=0x7f5b4c052000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 msgr2=0x55aebd980130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c001330 tx=0x7f5b5c001250 comp rx=0 tx=0).stop 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 shutdown_connections 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55aebd989b20 0x55aebd98bfa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55aebd88bb40 0x55aebd987780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a4803ce10 0x7f5a4803f2d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 --2- 172.21.15.164:0/4082917169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55aebd887790 0x55aebd980130 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 >> 172.21.15.164:0/4082917169 conn(0x55aebd882f80 msgr2=0x55aebd971690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 shutdown_connections 2024-09-14T10:55:26.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.258+0000 7f5b654bb800 1 -- 172.21.15.164:0/4082917169 wait complete. 2024-09-14T10:55:26.277 INFO:teuthology.orchestra.run.smithi164.stdout:["myfoo"] 2024-09-14T10:55:26.277 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-14T10:55:26.280 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.280 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-14T10:55:26.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-14T10:55:26.281 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-14T10:55:26.323 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.323 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.326+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.326+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.326+0000 7f8f5f20f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5592cf8b6be0 0x5592cf8b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f5f20f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592cf8b96d0 con 0x5592cf825f00 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f5f20f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5592cf73d7d0 con 0x5592cf8b6be0 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f544f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5592cf8b6be0 0x5592cf8b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f5ccf9640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5592cf825f00 0x5592cf8b54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38714/0 (socket says 172.21.15.164:38714) 2024-09-14T10:55:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/1187506323 learned_addr learned my addr 172.21.15.164:0/1187506323 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f544f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5592cf8b6be0 0x5592cf8b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33480/0 (socket says 172.21.15.164:33480) 2024-09-14T10:55:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f544f8640 1 -- 172.21.15.164:0/1187506323 >> v1:172.21.15.116:6789/0 conn(0x5592cf825f00 legacy=0x5592cf8b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f57fff640 1 -- 172.21.15.164:0/1187506323 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231221009 0 0) 0x5592cf8b96d0 con 0x5592cf825f00 2024-09-14T10:55:26.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.327+0000 7f8f544f8640 1 -- 172.21.15.164:0/1187506323 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf8ba900 con 0x5592cf8b6be0 2024-09-14T10:55:26.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f544f8640 1 --2- 172.21.15.164:0/1187506323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf8b6be0 0x5592cf8b9050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400a470 tx=0x7f8f44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bb5e11514f9563 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f57fff640 1 -- 172.21.15.164:0/1187506323 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44053570 con 0x5592cf8b6be0 2024-09-14T10:55:26.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f57fff640 1 -- 172.21.15.164:0/1187506323 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f44058070 con 0x5592cf8b6be0 2024-09-14T10:55:26.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f57fff640 1 -- 172.21.15.164:0/1187506323 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f44053880 con 0x5592cf8b6be0 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1187506323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf8b6be0 msgr2=0x5592cf8b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.329+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1187506323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf8b6be0 0x5592cf8b9050 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400a470 tx=0x7f8f44045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.330+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1187506323 shutdown_connections 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.330+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1187506323 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf8b6be0 0x5592cf8b9050 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.330+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1187506323 >> 172.21.15.164:0/1187506323 conn(0x5592cf8acf70 msgr2=0x5592cf8af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.330+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1187506323 shutdown_connections 2024-09-14T10:55:26.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.330+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1187506323 wait complete. 2024-09-14T10:55:26.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.343+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.343+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5f20f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5f20f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592cf74add0 con 0x5592cf825f00 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5ccf9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5ccf9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33496/0 (socket says 172.21.15.164:33496) 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/3098506791 learned_addr learned my addr 172.21.15.164:0/3098506791 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/3098506791 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf9a2c20 con 0x5592cf825f00 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/3098506791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001ea0 tx=0x7f8f4c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc22f586c5c4ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8e4ae0d640 1 -- 172.21.15.164:0/3098506791 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4c008070 con 0x5592cf825f00 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8e4ae0d640 1 -- 172.21.15.164:0/3098506791 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4c00d500 con 0x5592cf825f00 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.344+0000 7f8e4ae0d640 1 -- 172.21.15.164:0/3098506791 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4c00d880 con 0x5592cf825f00 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3098506791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 msgr2=0x5592cf9a2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/3098506791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001ea0 tx=0x7f8f4c00b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3098506791 shutdown_connections 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/3098506791 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9a2630 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3098506791 >> 172.21.15.164:0/3098506791 conn(0x5592cf8acf70 msgr2=0x5592cf99dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3098506791 shutdown_connections 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3098506791 wait complete. 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.345+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5f20f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5f20f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592cf8b9ba0 con 0x5592cf825f00 2024-09-14T10:55:26.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5ccf9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5ccf9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33502/0 (socket says 172.21.15.164:33502) 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/1247688568 learned_addr learned my addr 172.21.15.164:0/1247688568 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf9aa680 con 0x5592cf825f00 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.346+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0012f0 tx=0x7f8f4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8e4960a640 1 -- 172.21.15.164:0/1247688568 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4c00f9d0 con 0x5592cf825f00 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8e4960a640 1 -- 172.21.15.164:0/1247688568 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4c00fb70 con 0x5592cf825f00 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592cf9aa910 con 0x5592cf825f00 2024-09-14T10:55:26.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8e4960a640 1 -- 172.21.15.164:0/1247688568 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f4c00fe50 con 0x5592cf825f00 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592cf9ab310 con 0x5592cf825f00 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.347+0000 7f8e4960a640 1 -- 172.21.15.164:0/1247688568 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8f4c017040 con 0x5592cf825f00 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8e4960a640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 0x7f8e4403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8e4960a640 1 -- 172.21.15.164:0/1247688568 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8f4c015020 con 0x5592cf825f00 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f544f8640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 0x7f8e4403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 0x5592cf9b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9b1cb0 con 0x5592cf8b6be0 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 0x5592cf9b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f544f8640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 0x7f8e4403f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8f44057000 tx=0x7f8f44052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.348+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 0x5592cf9b1770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1247688568 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f5800a4d0 con 0x5592cf8b6be0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9b2050 con 0x5592cf8b6be0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1247688568 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f5800a4d0 con 0x5592cf8b6be0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 0x5592cf9b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9b6760 con 0x5592cf9b3b50 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 0x5592cf9b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 0x5592cf9b5fd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.349+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/1247688568 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f4c02d070 con 0x5592cf9b3b50 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9b28a0 con 0x5592cf8b6be0 2024-09-14T10:55:26.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1247688568 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f5800a4d0 con 0x5592cf8b6be0 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9b2cf0 con 0x5592cf8b6be0 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1247688568 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f5800a4d0 con 0x5592cf8b6be0 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.350+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5f20f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5f20f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592cf7a94a0 con 0x5592cf9c5140 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33514/0 (socket says 172.21.15.164:33514) 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1288126057 learned_addr learned my addr 172.21.15.164:0/1288126057 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/1288126057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf9c5ba0 con 0x5592cf9c5140 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800a2a0 tx=0x7f8f58018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8e427fc640 1 -- 172.21.15.164:0/1288126057 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f58014450 con 0x5592cf9c5140 2024-09-14T10:55:26.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8e427fc640 1 -- 172.21.15.164:0/1288126057 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f580145f0 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8e427fc640 1 -- 172.21.15.164:0/1288126057 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f58014910 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592cf9c63d0 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.351+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592cf9c6970 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.352+0000 7f8e427fc640 1 -- 172.21.15.164:0/1288126057 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8f58011040 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8e427fc640 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 0x7f8e3403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8e427fc640 1 -- 172.21.15.164:0/1288126057 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8f5801e070 con 0x5592cf9c5140 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 0x7f8e3403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 0x7f8e3403f2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5592cf9ac210 tx=0x7f8f4c0011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5f20f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5f20f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592cf9a3050 con 0x5592cf9d1be0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.353+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33530/0 (socket says 172.21.15.164:33530) 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/3851878731 learned_addr learned my addr 172.21.15.164:0/3851878731 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/3851878731 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf9d25d0 con 0x5592cf9d1be0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/3851878731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8f58016fd0 tx=0x7f8f58011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415e0c040583f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8e33fff640 1 -- 172.21.15.164:0/3851878731 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5804b070 con 0x5592cf9d1be0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8e33fff640 1 -- 172.21.15.164:0/3851878731 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f58051070 con 0x5592cf9d1be0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8e33fff640 1 -- 172.21.15.164:0/3851878731 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f58022dc0 con 0x5592cf9d1be0 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3851878731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 msgr2=0x5592cf9d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/3851878731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8f58016fd0 tx=0x7f8f58011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3851878731 shutdown_connections 2024-09-14T10:55:26.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/3851878731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d1fe0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.354+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3851878731 >> 172.21.15.164:0/3851878731 conn(0x5592cf9cdfe0 msgr2=0x5592cf9cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3851878731 shutdown_connections 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 -- 172.21.15.164:0/3851878731 wait complete. 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 Processor -- start 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 -- start start 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5f20f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5592cf9d2bf0 con 0x5592cf9d1be0 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5d4fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33534/0 (socket says 172.21.15.164:33534) 2024-09-14T10:55:26.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 learned_addr learned my addr 172.21.15.164:0/4179029426 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.355+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592cf9d9730 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8f58011fd0 tx=0x7f8f58054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8e327fc640 1 -- 172.21.15.164:0/4179029426 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5804b030 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8e327fc640 1 -- 172.21.15.164:0/4179029426 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f58056070 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592cf9d99c0 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8e327fc640 1 -- 172.21.15.164:0/4179029426 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f580547d0 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592cf9da340 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.356+0000 7f8e327fc640 1 -- 172.21.15.164:0/4179029426 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8f580457a0 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8e327fc640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e2803ce10 0x7f8e2803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8e327fc640 1 -- 172.21.15.164:0/4179029426 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f8f5804c070 con 0x5592cf9d1be0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e2803ce10 0x7f8e2803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf9e4eb0 0x5592cf9e7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9e7ac0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f544f8640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf9e4eb0 0x5592cf9e7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e2803ce10 0x7f8e2803f2d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0189e0 tx=0x7f8f4c041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.357+0000 7f8f544f8640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf9e4eb0 0x5592cf9e7370 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 realm 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9e7ef0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9e87c0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9e8b60 con 0x5592cf9e4eb0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9e98c0 0x5592cf9ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.358+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec1f0 con 0x5592cf9e98c0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9e98c0 0x5592cf9ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9e98c0 0x5592cf9ebcb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5f20f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5f20f800 20 searching for the correct realm 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8f58058040 0x7f8f580479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.359+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8f58058040 0x7f8f580479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.360+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8f58058040 0x7f8f580479d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.360+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.360+0000 7f8f5ccf9640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8f4c03c040 0x7f8f4c01a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.360+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.360+0000 7f8f544f8640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8f4c03c040 0x7f8f4c01a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8f4c03c040 0x7f8f4c01a750 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.361+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.362+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.363+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.364+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.365+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.366+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e98c0 2024-09-14T10:55:26.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f4c03c040 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x5592cf9e4eb0 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9edb40 con 0x7f8f58058040 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.367+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ecc60 con 0x5592cf9e4eb0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ed500 con 0x5592cf9e4eb0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 zone default found 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 4 Realm: () 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 zonegroup default 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.368+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ed130 con 0x7f8f4c03c040 2024-09-14T10:55:26.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9eff10 con 0x5592cf9e98c0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0520 con 0x5592cf9e98c0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 started sync module instance, tier type = 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.369+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ef380 con 0x7f8f58058040 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.370+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.370+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94089036885712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0980 con 0x7f8f58058040 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.370+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f1340 con 0x5592cf9e4eb0 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.371+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94089036885712] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.371+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.372+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94089036893840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f1760 con 0x5592cf9e4eb0 2024-09-14T10:55:26.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.372+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f2120 con 0x5592cf9e98c0 2024-09-14T10:55:26.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.373+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.373+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94089036897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f20f0 con 0x5592cf9e98c0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.373+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f3110 con 0x7f8f58058040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.373+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94089036893840] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.374+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94089036897392] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.374+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.374+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94089036899600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f12b0 con 0x7f8f58058040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.374+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f39f0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.375+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.375+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94089036903680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f4290 con 0x5592cf9e4eb0 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.375+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f4d70 con 0x7f8f4c03c040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.375+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94089036899600] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.376+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.376+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94089036908672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f4d70 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.376+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f5780 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.376+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94089036903680] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.377+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94089036908672] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.377+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.377+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94089036901344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f52d0 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.377+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f5c90 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.378+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94089036901344] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94089036905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f5c90 con 0x7f8f4c03c040 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=0 2024-09-14T10:55:26.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=1 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=2 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=3 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=4 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=5 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.379+0000 7f8f5f20f800 20 add_watcher() i=6 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94089036905952] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f5f20f800 20 add_watcher() i=7 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f5f20f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f8fb0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.380+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94089036912976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f6220 con 0x5592cf9e4eb0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94089036912976] v35'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8f5f20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8f5f20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8f5f20f800 5 note: GC not initialized 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8e11fe3640 20 reqs_thread_entry: start 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.381+0000 7f8f5f20f800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5f20f800 20 Filter name: none 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8d837fe640 20 reqs_thread_entry: start 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cfa2ba90 con 0x5592cf9e98c0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0520 con 0x5592cf9e98c0 2024-09-14T10:55:26.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0520 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.382+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v35'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(67 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.383+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 [pgnls start_epoch 35 out=127b] v35'3 uv3 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.384+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.385+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(80 [pgnls start_epoch 35 out=70b] v35'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.386+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.387+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.388+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f4c03c040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e4eb0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x5592cf9e98c0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9ec8a0 con 0x7f8f58058040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.389+0000 7f8f5f20f800 20 RGWRados::pool_iterate: got myfoo 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.390+0000 7f8e12fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.390+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94089036912976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0520 con 0x5592cf9e4eb0 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.391+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94089036912976] v35'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.391+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94089036885712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cfa29c70 con 0x7f8f58058040 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.392+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94089036885712] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.392+0000 7f8f5f20f800 20 remove_watcher() i=0 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.392+0000 7f8f5f20f800 2 removed watcher, disabling cache 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.392+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94089036893840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cfa29c70 con 0x5592cf9e4eb0 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.393+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94089036893840] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.393+0000 7f8f5f20f800 20 remove_watcher() i=1 2024-09-14T10:55:26.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.393+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94089036897392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cfa29c70 con 0x5592cf9e98c0 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.394+0000 7f8f5d4fa640 1 -- 172.21.15.164:0/4179029426 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94089036897392] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f5802a070 con 0x5592cf9e98c0 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.394+0000 7f8f5f20f800 20 remove_watcher() i=2 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.394+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94089036899600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9eeed0 con 0x7f8f58058040 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.395+0000 7f8f5ccf9640 1 -- 172.21.15.164:0/4179029426 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94089036899600] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f4c039070 con 0x7f8f58058040 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.395+0000 7f8f5f20f800 20 remove_watcher() i=3 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.395+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94089036903680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f0e90 con 0x5592cf9e4eb0 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.396+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94089036903680] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x5592cf9e4eb0 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.396+0000 7f8f5f20f800 20 remove_watcher() i=4 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.396+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94089036908672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f1c70 con 0x7f8f4c03c040 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.397+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94089036908672] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.397+0000 7f8f5f20f800 20 remove_watcher() i=5 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.397+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94089036901344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9f2510 con 0x7f8f4c03c040 2024-09-14T10:55:26.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.398+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94089036901344] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.398+0000 7f8f5f20f800 20 remove_watcher() i=6 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.398+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94089036905952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5592cf9eeed0 con 0x7f8f4c03c040 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94089036905952] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f44051070 con 0x7f8f4c03c040 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 20 remove_watcher() i=7 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8f4c03c040 msgr2=0x7f8f4c01a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f8f4c03c040 0x7f8f4c01a750 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf9e4eb0 msgr2=0x5592cf9e7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf9e4eb0 0x5592cf9e7370 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8f58058040 msgr2=0x7f8f580479d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f8f58058040 0x7f8f580479d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9e98c0 msgr2=0x5592cf9ebcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9e98c0 0x5592cf9ebcb0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e2803ce10 msgr2=0x7f8e2803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e2803ce10 0x7f8e2803f2d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0189e0 tx=0x7f8f4c041000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f544f8640 1 -- 172.21.15.164:0/4179029426 reap_dead start 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 msgr2=0x5592cf9d91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8f58011fd0 tx=0x7f8f58054560 comp rx=0 tx=0).stop 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 shutdown_connections 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/4179029426 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9d1be0 0x5592cf9d91d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 >> 172.21.15.164:0/4179029426 conn(0x5592cf9cdfe0 msgr2=0x5592cf9cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 shutdown_connections 2024-09-14T10:55:26.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.399+0000 7f8f5f20f800 1 -- 172.21.15.164:0/4179029426 wait complete. 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 msgr2=0x7f8e3403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 0x7f8e3403f2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5592cf9ac210 tx=0x7f8f4c0011b0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 msgr2=0x5592cf9c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800a2a0 tx=0x7f8f58018830 comp rx=0 tx=0).stop 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 shutdown_connections 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e3403ce10 0x7f8e3403f2d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1288126057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf9c5140 0x5592cf9c5560 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 >> 172.21.15.164:0/1288126057 conn(0x5592cf9b94f0 msgr2=0x5592cf9b98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 shutdown_connections 2024-09-14T10:55:26.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1288126057 wait complete. 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 msgr2=0x5592cf9b1770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 0x5592cf9b1770 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 msgr2=0x5592cf9b5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 0x5592cf9b5fd0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 msgr2=0x7f8e4403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 0x7f8e4403f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8f44057000 tx=0x7f8f44052000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 msgr2=0x5592cf9aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0012f0 tx=0x7f8f4c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 shutdown_connections 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5592cf9b3b50 0x5592cf9b5fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5592cf8b6be0 0x5592cf9b1770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8e4403d000 0x7f8e4403f4c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 --2- 172.21.15.164:0/1247688568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5592cf825f00 0x5592cf9aa120 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 >> 172.21.15.164:0/1247688568 conn(0x5592cf8acf70 msgr2=0x5592cf9a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 shutdown_connections 2024-09-14T10:55:26.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.400+0000 7f8f5f20f800 1 -- 172.21.15.164:0/1247688568 wait complete. 2024-09-14T10:55:26.421 INFO:teuthology.orchestra.run.smithi164.stdout:["myfoo"] 2024-09-14T10:55:26.421 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-14T10:55:26.434 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.448 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.461 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.505 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-14T10:55:26.534 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.560 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.586 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:26.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:26.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:26.587 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:55:26.631 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.631 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.634+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.634+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.634+0000 7fb6e5d32800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5606f526b790 0x5606f526bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.634+0000 7fb6e5d32800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606f526d470 con 0x5606f526c8b0 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.634+0000 7fb6e5d32800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5606f50f77d0 con 0x5606f526b790 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e19bc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5606f526b790 0x5606f526bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e11bb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5606f526c8b0 0x5606f526cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38722/0 (socket says 172.21.15.164:38722) 2024-09-14T10:55:26.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3451291472 learned_addr learned my addr 172.21.15.164:0/3451291472 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:26.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e19bc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5606f526b790 0x5606f526bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33536/0 (socket says 172.21.15.164:33536) 2024-09-14T10:55:26.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3451291472 >> v1:172.21.15.116:6789/0 conn(0x5606f526c8b0 legacy=0x5606f526cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.635+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3451291472 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f526d640 con 0x5606f526b790 2024-09-14T10:55:26.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3451291472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f526bb90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400a470 tx=0x7fb6d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d83f6efef83877c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e09ba640 1 -- 172.21.15.164:0/3451291472 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4053570 con 0x5606f526b790 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e09ba640 1 -- 172.21.15.164:0/3451291472 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4058070 con 0x5606f526b790 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e09ba640 1 -- 172.21.15.164:0/3451291472 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4053880 con 0x5606f526b790 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3451291472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 msgr2=0x5606f526bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.637+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3451291472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f526bb90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400a470 tx=0x7fb6d4045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.638+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3451291472 shutdown_connections 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.638+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3451291472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f526bb90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.638+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3451291472 >> 172.21.15.164:0/3451291472 conn(0x5606f5266f80 msgr2=0x5606f52693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.638+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3451291472 shutdown_connections 2024-09-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.638+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3451291472 wait complete. 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e5d32800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e5d32800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5606f5104dd0 con 0x5606f526b790 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e19bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e19bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33542/0 (socket says 172.21.15.164:33542) 2024-09-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.652+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3580089766 learned_addr learned my addr 172.21.15.164:0/3580089766 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.653+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3580089766 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f535bcd0 con 0x5606f526b790 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.653+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3580089766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4025c20 tx=0x7fb6d4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da091207aadcbe74 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.653+0000 7fb5cfe07640 1 -- 172.21.15.164:0/3580089766 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4053a20 con 0x5606f526b790 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.653+0000 7fb5cfe07640 1 -- 172.21.15.164:0/3580089766 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4063070 con 0x5606f526b790 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.653+0000 7fb5cfe07640 1 -- 172.21.15.164:0/3580089766 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4053cf0 con 0x5606f526b790 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3580089766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 msgr2=0x5606f535b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3580089766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4025c20 tx=0x7fb6d4051000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3580089766 shutdown_connections 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3580089766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f535b6e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3580089766 >> 172.21.15.164:0/3580089766 conn(0x5606f5266f80 msgr2=0x5606f5357060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3580089766 shutdown_connections 2024-09-14T10:55:26.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3580089766 wait complete. 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.654+0000 7fb6e5d32800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5606f5272da0 con 0x5606f526b790 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e19bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e19bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33550/0 (socket says 172.21.15.164:33550) 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e19bc640 1 -- 172.21.15.164:0/2063281266 learned_addr learned my addr 172.21.15.164:0/2063281266 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e19bc640 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f53636f0 con 0x5606f526b790 2024-09-14T10:55:26.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4025c20 tx=0x7fb6d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb5ce604640 1 -- 172.21.15.164:0/2063281266 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4068660 con 0x5606f526b790 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb5ce604640 1 -- 172.21.15.164:0/2063281266 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4068800 con 0x5606f526b790 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb5ce604640 1 -- 172.21.15.164:0/2063281266 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4068ae0 con 0x5606f526b790 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606f5363980 con 0x5606f526b790 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.655+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f5364590 con 0x5606f526b790 2024-09-14T10:55:26.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb5ce604640 1 -- 172.21.15.164:0/2063281266 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb6d4068c80 con 0x5606f526b790 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb5ce604640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 0x7fb5c803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb5ce604640 1 -- 172.21.15.164:0/2063281266 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb6d4098b50 con 0x5606f526b790 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 0x7fb5c803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 0x5606f536a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.656+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f536ad20 con 0x5606f526c8b0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 0x5606f536a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 0x7fb5c803f320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8001d70 tx=0x7fb6d80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 0x5606f536a7e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2063281266 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5606f526c8b0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f536b0c0 con 0x5606f526c8b0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2063281266 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5606f526c8b0 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 0x5606f536ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.657+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f536f720 con 0x5606f536caf0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 0x5606f536ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 0x5606f536ef90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e19bc640 1 -- 172.21.15.164:0/2063281266 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6d4051070 con 0x5606f536caf0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f536b910 con 0x5606f526c8b0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2063281266 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5606f526c8b0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.658+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f536bcf0 con 0x5606f526c8b0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2063281266 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6dc00a4d0 con 0x5606f526c8b0 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e5d32800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e5d32800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5606f51634a0 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33554/0 (socket says 172.21.15.164:33554) 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.659+0000 7fb6e21bd640 1 -- 172.21.15.164:0/518132234 learned_addr learned my addr 172.21.15.164:0/518132234 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb6e21bd640 1 -- 172.21.15.164:0/518132234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f51e0270 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5606f5364f90 tx=0x7fb6dc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb5c77fe640 1 -- 172.21.15.164:0/518132234 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc014450 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb5c77fe640 1 -- 172.21.15.164:0/518132234 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc014610 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606f5382550 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb5c77fe640 1 -- 172.21.15.164:0/518132234 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc014930 con 0x5606f51dfd50 2024-09-14T10:55:26.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.660+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f5382af0 con 0x5606f51dfd50 2024-09-14T10:55:26.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb5c77fe640 1 -- 172.21.15.164:0/518132234 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb6dc011040 con 0x5606f51dfd50 2024-09-14T10:55:26.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb5c77fe640 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 0x7fb5bc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb5c77fe640 1 -- 172.21.15.164:0/518132234 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb6dc01e070 con 0x5606f51dfd50 2024-09-14T10:55:26.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 0x7fb5bc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 0x7fb5bc03f2d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5606f53651c0 tx=0x7fb6d405f4a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e5d32800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.661+0000 7fb6e5d32800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5606f535c0a0 con 0x5606f538bcf0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33562/0 (socket says 172.21.15.164:33562) 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2984161278 learned_addr learned my addr 172.21.15.164:0/2984161278 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb6e21bd640 1 -- 172.21.15.164:0/2984161278 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f538c6e0 con 0x5606f538bcf0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/2984161278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc02bfb0 tx=0x7fb6dc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc9846b07045c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb5c57fa640 1 -- 172.21.15.164:0/2984161278 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc04b070 con 0x5606f538bcf0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb5c57fa640 1 -- 172.21.15.164:0/2984161278 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc051070 con 0x5606f538bcf0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.662+0000 7fb5c57fa640 1 -- 172.21.15.164:0/2984161278 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc011da0 con 0x5606f538bcf0 2024-09-14T10:55:26.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2984161278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 msgr2=0x5606f538c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2984161278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc02bfb0 tx=0x7fb6dc011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2984161278 shutdown_connections 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2984161278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f538c0f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2984161278 >> 172.21.15.164:0/2984161278 conn(0x5606f53880f0 msgr2=0x5606f5386330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2984161278 shutdown_connections 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2984161278 wait complete. 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 Processor -- start 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- start start 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e5d32800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5606f538cd00 con 0x5606f538bcf0 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e21bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33574/0 (socket says 172.21.15.164:33574) 2024-09-14T10:55:26.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.663+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 learned_addr learned my addr 172.21.15.164:0/3556007159 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f537fbc0 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc018430 tx=0x7fb6dc0543f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb5b37fe640 1 -- 172.21.15.164:0/3556007159 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc04b030 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb5b37fe640 1 -- 172.21.15.164:0/3556007159 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc031030 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606f537df70 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb5b37fe640 1 -- 172.21.15.164:0/3556007159 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6dc011330 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f537e4b0 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.664+0000 7fb5b37fe640 1 -- 172.21.15.164:0/3556007159 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb6dc014ad0 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb5b37fe640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5ac03ce10 0x7fb5ac03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb5b37fe640 1 -- 172.21.15.164:0/3556007159 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fb6dc04c070 con 0x5606f538bcf0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5ac03ce10 0x7fb5ac03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f53a1220 0x5606f53a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a3e30 con 0x5606f53a1220 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5ac03ce10 0x7fb5ac03f2d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6d405dac0 tx=0x7fb6d408a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.665+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f53a1220 0x5606f53a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f53a1220 0x5606f53a36e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d8009050 con 0x5606f53a1220 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 realm 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a0570 con 0x5606f53a1220 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d8009050 con 0x5606f53a1220 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a4910 con 0x5606f53a1220 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d8009050 con 0x5606f53a1220 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.666+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a51e0 con 0x5606f53a1220 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6d8009050 con 0x5606f53a1220 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f53a5b20 0x5606f53a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a8650 con 0x5606f53a5b20 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f53a5b20 0x5606f53a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f53a5b20 0x5606f53a7f10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6dc02a070 con 0x5606f53a5b20 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 20 searching for the correct realm 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6dc02a070 con 0x5606f53a5b20 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb6dc014070 0x7fb6dc015800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.667+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb6dc014070 0x7fb6dc015800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb6dc014070 0x7fb6dc015800 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e19bc640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb6d40a5040 0x7fb6d407e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.668+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb6d40a5040 0x7fb6d407e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb6d40a5040 0x7fb6d407e770 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8009050 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8009050 con 0x5606f53a1220 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.669+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc02a070 con 0x5606f53a5b20 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.670+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc02a070 con 0x5606f53a5b20 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.671+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.672+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.673+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.674+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a5b20 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6d40a5040 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x5606f53a1220 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.675+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9fe0 con 0x7fb6dc014070 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a90d0 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a8d10 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a99f0 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 zone default found 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 4 Realm: () 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 zonegroup default 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.676+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53a9550 con 0x7fb6d40a5040 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ac360 con 0x5606f53a5b20 2024-09-14T10:55:26.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ac940 con 0x5606f53a5b20 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 started sync module instance, tier type = 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.677+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ab7c0 con 0x7fb6dc014070 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.678+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.678+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94587884057360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53acda0 con 0x7fb6dc014070 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.678+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ad760 con 0x5606f53a1220 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.679+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.679+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94587884065968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ae000 con 0x5606f53a1220 2024-09-14T10:55:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.679+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94587884057360] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.679+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53aeab0 con 0x5606f53a5b20 2024-09-14T10:55:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.680+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94587884065968] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.680+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.680+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94587884070288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ae000 con 0x5606f53a5b20 2024-09-14T10:55:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.680+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53af0d0 con 0x7fb6dc014070 2024-09-14T10:55:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.681+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.681+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94587884070288] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.681+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94587884071968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53af920 con 0x7fb6dc014070 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.681+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53adb90 con 0x5606f53a1220 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.682+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94587884071968] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.683+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.683+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94587884074096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53af890 con 0x5606f53a1220 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.683+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b0930 con 0x7fb6d40a5040 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.684+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94587884074096] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.684+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.684+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94587884076640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b0930 con 0x7fb6d40a5040 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.684+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b1340 con 0x7fb6d40a5040 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.685+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94587884076640] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.685+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.685+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94587884078688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b1340 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.685+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b1d00 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94587884078688] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94587884080784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b1ee0 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=0 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=1 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=2 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=3 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=4 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=5 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.686+0000 7fb6e5d32800 20 add_watcher() i=6 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94587884080784] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e5d32800 20 add_watcher() i=7 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e5d32800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b5060 con 0x5606f53a1220 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.687+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94587884095984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53b1e00 con 0x5606f53a1220 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94587884095984] v35'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb5937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb6e5d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb6e5d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb6e5d32800 5 note: GC not initialized 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.688+0000 7fb5927fc640 20 reqs_thread_entry: start 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 20 Filter name: none 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb503fff640 20 reqs_thread_entry: start 2024-09-14T10:55:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e8430 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.689+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e8cc0 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e7760 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:26.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e78a0 con 0x7fb6dc014070 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(65 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 4.f 4:f0239f39:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e9a20 con 0x5606f53a1220 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 4.38 4:1f04a4af:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53eeb10 con 0x5606f53a1220 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.690+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 4.39 4:9fbb9af9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53eeb10 con 0x5606f53a5b20 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 4.1a 4:58ff1328:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53f3890 con 0x7fb6dc014070 2024-09-14T10:55:26.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 4.2c 4:346bfbf7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53f62d0 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(66 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(67 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 4.14 4:28e9a4ac:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53f3890 con 0x5606f53a5b20 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53f62d0 con 0x5606f53a5b20 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 4.17 4:eb4c7ac0:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53ee320 con 0x7fb6d40a5040 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(69 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 4.26 4:66262f28:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53fa0f0 con 0x7fb6d40a5040 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(70 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 4.27 4:e7fb0465:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53f62d0 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 4.35 4:aee5ca16:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5606f53fa0f0 con 0x5606f53a1220 2024-09-14T10:55:26.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(71 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(72 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.691+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(75 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.692+0000 7fb5937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.692+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94587884095984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53fa0f0 con 0x5606f53a1220 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.693+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94587884095984] v35'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.693+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94587884057360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x7fb6dc014070 2024-09-14T10:55:26.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.694+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94587884057360] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.694+0000 7fb6e5d32800 20 remove_watcher() i=0 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.694+0000 7fb6e5d32800 2 removed watcher, disabling cache 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.694+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94587884065968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x5606f53a1220 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.695+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94587884065968] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.695+0000 7fb6e5d32800 20 remove_watcher() i=1 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.695+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94587884070288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x5606f53a5b20 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.696+0000 7fb6e21bd640 1 -- 172.21.15.164:0/3556007159 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94587884070288] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6dc064040 con 0x5606f53a5b20 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.696+0000 7fb6e5d32800 20 remove_watcher() i=2 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.696+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94587884071968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x7fb6dc014070 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.697+0000 7fb6e19bc640 1 -- 172.21.15.164:0/3556007159 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94587884071968] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d4051070 con 0x7fb6dc014070 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.697+0000 7fb6e5d32800 20 remove_watcher() i=3 2024-09-14T10:55:26.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.697+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94587884074096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x5606f53a1220 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.698+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94587884074096] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x5606f53a1220 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.698+0000 7fb6e5d32800 20 remove_watcher() i=4 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.698+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94587884076640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.699+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94587884076640] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.699+0000 7fb6e5d32800 20 remove_watcher() i=5 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.699+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94587884078688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.700+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94587884078688] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.700+0000 7fb6e5d32800 20 remove_watcher() i=6 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.700+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94587884080784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5606f53e5da0 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94587884080784] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d8029040 con 0x7fb6d40a5040 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 20 remove_watcher() i=7 2024-09-14T10:55:26.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb6d40a5040 msgr2=0x7fb6d407e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb6d40a5040 0x7fb6d407e770 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f53a1220 msgr2=0x5606f53a36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f53a1220 0x5606f53a36e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb6dc014070 msgr2=0x7fb6dc015800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb6dc014070 0x7fb6dc015800 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f53a5b20 msgr2=0x5606f53a7f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f53a5b20 0x5606f53a7f10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5ac03ce10 msgr2=0x7fb5ac03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5ac03ce10 0x7fb5ac03f2d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6d405dac0 tx=0x7fb6d408a000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 msgr2=0x5606f537f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e11bb640 1 -- 172.21.15.164:0/3556007159 reap_dead start 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc018430 tx=0x7fb6dc0543f0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 shutdown_connections 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/3556007159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f538bcf0 0x5606f537f660 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 >> 172.21.15.164:0/3556007159 conn(0x5606f53880f0 msgr2=0x5606f5386300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 shutdown_connections 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.701+0000 7fb6e5d32800 1 -- 172.21.15.164:0/3556007159 wait complete. 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 msgr2=0x7fb5bc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 0x7fb5bc03f2d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5606f53651c0 tx=0x7fb6d405f4a0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 msgr2=0x5606f5381f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x5606f5364f90 tx=0x7fb6dc018830 comp rx=0 tx=0).stop 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 shutdown_connections 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5bc03ce10 0x7fb5bc03f2d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/518132234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f51dfd50 0x5606f5381f50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 >> 172.21.15.164:0/518132234 conn(0x5606f5372530 msgr2=0x5606f5372910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 shutdown_connections 2024-09-14T10:55:26.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/518132234 wait complete. 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 msgr2=0x5606f536a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 0x5606f536a7e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 msgr2=0x5606f536ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 0x5606f536ef90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 msgr2=0x7fb5c803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 0x7fb5c803f320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8001d70 tx=0x7fb6d80012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 msgr2=0x5606f5363190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4025c20 tx=0x7fb6d4002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 shutdown_connections 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5606f536caf0 0x5606f536ef90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5606f526c8b0 0x5606f536a7e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb5c803ce60 0x7fb5c803f320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 --2- 172.21.15.164:0/2063281266 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5606f526b790 0x5606f5363190 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 >> 172.21.15.164:0/2063281266 conn(0x5606f5266f80 msgr2=0x5606f5355850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 shutdown_connections 2024-09-14T10:55:26.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.702+0000 7fb6e5d32800 1 -- 172.21.15.164:0/2063281266 wait complete. 2024-09-14T10:55:26.717 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"c136da01-f20d-479c-ad02-fc389f5894e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:55:26.140597Z","creation_time":"2024-09-14T10:55:26.137796Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-14T10:55:26.717 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:55:26.140597Z', 'creation_time': '2024-09-14T10:55:26.137796Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:55:26.717 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:55:26.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-14T10:55:26.717 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-14T10:55:26.762 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.762 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc6c22f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5621b4de7fc0 0x5621b4dea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc6c22f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621b4dea8f0 con 0x5621b4d556f0 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc6c22f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5621b4c6c7d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc66dcb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5621b4de7fc0 0x5621b4dea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc66dcb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5621b4de7fc0 0x5621b4dea3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33580/0 (socket says 172.21.15.164:33580) 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc66dcb640 1 -- 172.21.15.164:0/3659809653 learned_addr learned my addr 172.21.15.164:0/3659809653 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc66dcb640 1 -- 172.21.15.164:0/3659809653 >> v1:172.21.15.116:6789/0 conn(0x5621b4d556f0 legacy=0x5621b4de68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc665ca640 1 -- 172.21.15.164:0/3659809653 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856756439 0 0) 0x5621b4dea8f0 con 0x5621b4d556f0 2024-09-14T10:55:26.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.765+0000 7efc66dcb640 1 -- 172.21.15.164:0/3659809653 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4debb20 con 0x5621b4de7fc0 2024-09-14T10:55:26.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.767+0000 7efc66dcb640 1 --2- 172.21.15.164:0/3659809653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4de7fc0 0x5621b4dea3b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00a520 tx=0x7efc5c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6506cd73af53987 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.767+0000 7efc665ca640 1 -- 172.21.15.164:0/3659809653 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc5c055070 con 0x5621b4de7fc0 2024-09-14T10:55:26.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.767+0000 7efc665ca640 1 -- 172.21.15.164:0/3659809653 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c0515b0 con 0x5621b4de7fc0 2024-09-14T10:55:26.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.767+0000 7efc665ca640 1 -- 172.21.15.164:0/3659809653 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc5c0518d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 -- 172.21.15.164:0/3659809653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4de7fc0 msgr2=0x5621b4dea3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3659809653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4de7fc0 0x5621b4dea3b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00a520 tx=0x7efc5c045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 -- 172.21.15.164:0/3659809653 shutdown_connections 2024-09-14T10:55:26.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3659809653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4de7fc0 0x5621b4dea3b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 -- 172.21.15.164:0/3659809653 >> 172.21.15.164:0/3659809653 conn(0x5621b4ddbfb0 msgr2=0x5621b4dde3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 -- 172.21.15.164:0/3659809653 shutdown_connections 2024-09-14T10:55:26.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.768+0000 7efc6c22f800 1 -- 172.21.15.164:0/3659809653 wait complete. 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc6c22f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc6c22f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621b4c79dd0 con 0x5621b4d556f0 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc675cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc675cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33588/0 (socket says 172.21.15.164:33588) 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc675cc640 1 -- 172.21.15.164:0/3636716145 learned_addr learned my addr 172.21.15.164:0/3636716145 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.782+0000 7efc675cc640 1 -- 172.21.15.164:0/3636716145 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4ed3dd0 con 0x5621b4d556f0 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.783+0000 7efc675cc640 1 --2- 172.21.15.164:0/3636716145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc58001de0 tx=0x7efc5800b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7aab64c32a54553 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.783+0000 7efb5560a640 1 -- 172.21.15.164:0/3636716145 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58016070 con 0x5621b4d556f0 2024-09-14T10:55:26.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.783+0000 7efb5560a640 1 -- 172.21.15.164:0/3636716145 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5800f4d0 con 0x5621b4d556f0 2024-09-14T10:55:26.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.783+0000 7efb5560a640 1 -- 172.21.15.164:0/3636716145 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc5800f830 con 0x5621b4d556f0 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.783+0000 7efc6c22f800 1 -- 172.21.15.164:0/3636716145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 msgr2=0x5621b4ed37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3636716145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc58001de0 tx=0x7efc5800b590 comp rx=0 tx=0).stop 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- 172.21.15.164:0/3636716145 shutdown_connections 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3636716145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4ed37e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- 172.21.15.164:0/3636716145 >> 172.21.15.164:0/3636716145 conn(0x5621b4ddbfb0 msgr2=0x5621b4ecf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- 172.21.15.164:0/3636716145 shutdown_connections 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- 172.21.15.164:0/3636716145 wait complete. 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc6c22f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621b4deadc0 con 0x5621b4d556f0 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc675cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc675cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33596/0 (socket says 172.21.15.164:33596) 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc675cc640 1 -- 172.21.15.164:0/3118539018 learned_addr learned my addr 172.21.15.164:0/3118539018 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.784+0000 7efc675cc640 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4edb8a0 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efc675cc640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5621b4ed4770 tx=0x7efc58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efb53e07640 1 -- 172.21.15.164:0/3118539018 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58016070 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efb53e07640 1 -- 172.21.15.164:0/3118539018 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc58023070 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efb53e07640 1 -- 172.21.15.164:0/3118539018 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc58011d40 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621b4edbb30 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.785+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b4edc530 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efb53e07640 1 -- 172.21.15.164:0/3118539018 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7efc58028460 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efb53e07640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 0x7efb4c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efb53e07640 1 -- 172.21.15.164:0/3118539018 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efc58054530 con 0x5621b4d556f0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efc66dcb640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 0x7efb4c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 0x5621b4ee2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4ee2ed0 con 0x5621b4de7fc0 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.786+0000 7efc67dcd640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 0x5621b4ee2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc66dcb640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 0x7efb4c03f320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5c057000 tx=0x7efc5c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc67dcd640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 0x5621b4ee2990 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc67dcd640 1 -- 172.21.15.164:0/3118539018 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6000a4d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4ee3270 con 0x5621b4de7fc0 2024-09-14T10:55:26.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc67dcd640 1 -- 172.21.15.164:0/3118539018 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc6000a4d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 0x5621b4ee7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4ee7920 con 0x5621b4ee4cf0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.787+0000 7efc675cc640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 0x5621b4ee7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc675cc640 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 0x5621b4ee7190 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc675cc640 1 -- 172.21.15.164:0/3118539018 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc580424a0 con 0x5621b4ee4cf0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4ee3ac0 con 0x5621b4de7fc0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc67dcd640 1 -- 172.21.15.164:0/3118539018 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc6000a4d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4ee3ea0 con 0x5621b4de7fc0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.788+0000 7efc67dcd640 1 -- 172.21.15.164:0/3118539018 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc6000a4d0 con 0x5621b4de7fc0 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc6c22f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc6c22f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621b4cd84a0 con 0x5621b4ef6330 2024-09-14T10:55:26.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33606/0 (socket says 172.21.15.164:33606) 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.789+0000 7efc67dcd640 1 -- 172.21.15.164:0/2447256673 learned_addr learned my addr 172.21.15.164:0/2447256673 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efc67dcd640 1 -- 172.21.15.164:0/2447256673 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4ef6d90 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efc67dcd640 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5621b4edc340 tx=0x7efc60018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efb51602640 1 -- 172.21.15.164:0/2447256673 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60014450 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efb51602640 1 -- 172.21.15.164:0/2447256673 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60014610 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efb51602640 1 -- 172.21.15.164:0/2447256673 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60014930 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621b4ef75c0 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.790+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b4ef7b60 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efb51602640 1 -- 172.21.15.164:0/2447256673 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7efc60011040 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efb51602640 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 0x7efb4003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efb51602640 1 -- 172.21.15.164:0/2447256673 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efc6001e070 con 0x5621b4ef6330 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc675cc640 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 0x7efb4003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc675cc640 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 0x7efb4003f2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5621b4edd3d0 tx=0x7efc5800e950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc6c22f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.791+0000 7efc6c22f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621b4ed4200 con 0x5621b4f02dd0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33620/0 (socket says 172.21.15.164:33620) 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efc67dcd640 1 -- 172.21.15.164:0/1351398809 learned_addr learned my addr 172.21.15.164:0/1351398809 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efc67dcd640 1 -- 172.21.15.164:0/1351398809 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4f037c0 con 0x5621b4f02dd0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efc67dcd640 1 --2- 172.21.15.164:0/1351398809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc60016fd0 tx=0x7efc60011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982f73da4602b44f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efb4affd640 1 -- 172.21.15.164:0/1351398809 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6004b070 con 0x5621b4f02dd0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efb4affd640 1 -- 172.21.15.164:0/1351398809 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60051070 con 0x5621b4f02dd0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.792+0000 7efb4affd640 1 -- 172.21.15.164:0/1351398809 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60045510 con 0x5621b4f02dd0 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- 172.21.15.164:0/1351398809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 msgr2=0x5621b4f031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 --2- 172.21.15.164:0/1351398809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc60016fd0 tx=0x7efc60011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- 172.21.15.164:0/1351398809 shutdown_connections 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 --2- 172.21.15.164:0/1351398809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f031d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- 172.21.15.164:0/1351398809 >> 172.21.15.164:0/1351398809 conn(0x5621b4eff1d0 msgr2=0x5621b4efd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- 172.21.15.164:0/1351398809 shutdown_connections 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- 172.21.15.164:0/1351398809 wait complete. 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 Processor -- start 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- start start 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f0a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc6c22f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621b4f03de0 con 0x5621b4f02dd0 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f0a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc67dcd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f0a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33624/0 (socket says 172.21.15.164:33624) 2024-09-14T10:55:26.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.793+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 learned_addr learned my addr 172.21.15.164:0/427761391 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621b4f0a940 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efc67dcd640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f0a3e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc60053380 tx=0x7efc60054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efb497fa640 1 -- 172.21.15.164:0/427761391 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6004b030 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efb497fa640 1 -- 172.21.15.164:0/427761391 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60031030 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621b4f0abd0 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efb497fa640 1 -- 172.21.15.164:0/427761391 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60011330 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.794+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621b4f0b550 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efb497fa640 1 -- 172.21.15.164:0/427761391 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7efc60014ad0 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efb497fa640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb3003ce60 0x7efb3003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efb497fa640 1 -- 172.21.15.164:0/427761391 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7efc6004c070 con 0x5621b4f02dd0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc675cc640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb3003ce60 0x7efb3003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4f16170 0x5621b4f18630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f18d80 con 0x5621b4f16170 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc66dcb640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4f16170 0x5621b4f18630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.795+0000 7efc675cc640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb3003ce60 0x7efb3003f320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc58019fd0 tx=0x7efc5804d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc66dcb640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4f16170 0x5621b4f18630 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 realm 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f191b0 con 0x5621b4f16170 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f19a80 con 0x5621b4f16170 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.796+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f19e20 con 0x5621b4f16170 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4f1ab80 0x5621b4f1cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1d4b0 con 0x5621b4f1ab80 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc67dcd640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4f1ab80 0x5621b4f1cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc67dcd640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4f1ab80 0x5621b4f1cf70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 20 searching for the correct realm 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.797+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc67dcd640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7efc60014070 0x7efc600378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc675cc640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7efc60014070 0x7efc600378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc675cc640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7efc60014070 0x7efc600378b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc675cc640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7efc58044aa0 0x7efc5803ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.798+0000 7efc66dcb640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7efc58044aa0 0x7efc5803ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7efc58044aa0 0x7efc5803ea40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.799+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.800+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.801+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.802+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.803+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x5621b4f16170 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.804+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c057030 con 0x7efc58044aa0 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f1ab80 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc58044aa0 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.805+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x5621b4f16170 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1ee00 con 0x7efc60014070 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1def0 con 0x5621b4f16170 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1e790 con 0x5621b4f16170 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.806+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1db30 con 0x5621b4f16170 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 zone default found 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 4 Realm: () 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 zonegroup default 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f1e370 con 0x7efc58044aa0 2024-09-14T10:55:26.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f211a0 con 0x5621b4f1ab80 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f21690 con 0x5621b4f1ab80 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 started sync module instance, tier type = 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.807+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f20640 con 0x7efc60014070 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.808+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.808+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702769670704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f21fa0 con 0x7efc60014070 2024-09-14T10:55:26.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.808+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f227f0 con 0x5621b4f16170 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.809+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702769670704] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.810+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.810+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702769674992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f228d0 con 0x5621b4f16170 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.810+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f233f0 con 0x5621b4f1ab80 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.811+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.811+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702769680064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f233b0 con 0x5621b4f1ab80 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.811+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f243d0 con 0x7efc60014070 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.811+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702769674992] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.812+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702769680064] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.812+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.812+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702769682400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f22340 con 0x7efc60014070 2024-09-14T10:55:26.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.812+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f24de0 con 0x5621b4f16170 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.813+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.813+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702769687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f254b0 con 0x5621b4f16170 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.813+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f25fd0 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.813+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702769682400] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.814+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.814+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702769687104] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.814+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702769691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f25f90 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.814+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f24f40 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.815+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702769691296] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.815+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.815+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702769684192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f26530 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.815+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f26ef0 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702769695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f26e60 con 0x7efc58044aa0 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=0 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=1 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=2 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=3 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=4 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.816+0000 7efc6c22f800 20 add_watcher() i=5 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702769684192] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc6c22f800 20 add_watcher() i=6 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702769695296] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x7efc58044aa0 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc6c22f800 20 add_watcher() i=7 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc6c22f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.817+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f24f00 con 0x5621b4f16170 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.818+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.818+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702769697424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f24f00 con 0x5621b4f16170 2024-09-14T10:55:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702769697424] v35'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efb1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 5 note: GC not initialized 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efb1cfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 20 Filter name: none 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efa967fc640 20 reqs_thread_entry: start 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.819+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5d0d0 con 0x5621b4f16170 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5d960 con 0x5621b4f16170 2024-09-14T10:55:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5e970 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.820+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5c290 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5e970 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 4.f 4:f0239f39:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5e370 con 0x5621b4f16170 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 4.38 4:1f04a4af:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f633d0 con 0x5621b4f16170 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 4.39 4:9fbb9af9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f65cc0 con 0x5621b4f1ab80 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 4.1a 4:58ff1328:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f633d0 con 0x7efc60014070 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 4.2c 4:346bfbf7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f6ae30 con 0x5621b4f16170 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 4.14 4:28e9a4ac:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f65cc0 con 0x5621b4f1ab80 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(67 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(70 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.821+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5eee0 con 0x5621b4f1ab80 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 4.17 4:eb4c7ac0:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5eee0 con 0x7efc58044aa0 2024-09-14T10:55:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(71 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(68 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c07f040 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(72 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 4.26 4:66262f28:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f670b0 con 0x7efc58044aa0 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 4.27 4:e7fb0465:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f670b0 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 4.35 4:aee5ca16:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f67550 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(73 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(74 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c085040 con 0x7efc58044aa0 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(75 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c085040 con 0x7efc58044aa0 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(76 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc5c085040 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.822+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(77 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7efc5c085040 con 0x5621b4f16170 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.823+0000 7efb1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.823+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702769697424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x5621b4f16170 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.824+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94702769697424] v35'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x5621b4f16170 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.824+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702769670704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x7efc60014070 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.825+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94702769670704] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.825+0000 7efc6c22f800 20 remove_watcher() i=0 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.825+0000 7efc6c22f800 2 removed watcher, disabling cache 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.825+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702769674992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x5621b4f16170 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.826+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94702769674992] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x5621b4f16170 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.826+0000 7efc6c22f800 20 remove_watcher() i=1 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.826+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702769680064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x5621b4f1ab80 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.827+0000 7efc67dcd640 1 -- 172.21.15.164:0/427761391 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94702769680064] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6003d070 con 0x5621b4f1ab80 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.827+0000 7efc6c22f800 20 remove_watcher() i=2 2024-09-14T10:55:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.827+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702769682400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x7efc60014070 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.828+0000 7efc675cc640 1 -- 172.21.15.164:0/427761391 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94702769682400] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5800e490 con 0x7efc60014070 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.828+0000 7efc6c22f800 20 remove_watcher() i=3 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.828+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702769687104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x5621b4f16170 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.829+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94702769687104] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x5621b4f16170 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.829+0000 7efc6c22f800 20 remove_watcher() i=4 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.829+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702769691296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x7efc58044aa0 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.830+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94702769691296] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x7efc58044aa0 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.830+0000 7efc6c22f800 20 remove_watcher() i=5 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.830+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702769684192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x7efc58044aa0 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.831+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94702769684192] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x7efc58044aa0 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.831+0000 7efc6c22f800 20 remove_watcher() i=6 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.831+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702769695296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5621b4f5aee0 con 0x7efc58044aa0 2024-09-14T10:55:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94702769695296] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc5c085040 con 0x7efc58044aa0 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 20 remove_watcher() i=7 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7efc58044aa0 msgr2=0x7efc5803ea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7efc58044aa0 0x7efc5803ea40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4f16170 msgr2=0x5621b4f18630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4f16170 0x5621b4f18630 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7efc60014070 msgr2=0x7efc600378b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7efc60014070 0x7efc600378b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4f1ab80 msgr2=0x5621b4f1cf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4f1ab80 0x5621b4f1cf70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb3003ce60 msgr2=0x7efb3003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb3003ce60 0x7efb3003f320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efc58019fd0 tx=0x7efc5804d000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 msgr2=0x5621b4f0a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 --2- 172.21.15.164:0/427761391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4f02dd0 0x5621b4f0a3e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc60053380 tx=0x7efc60054530 comp rx=0 tx=0).stop 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 reap_dead start 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc66dcb640 1 -- 172.21.15.164:0/427761391 reap_dead start 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 shutdown_connections 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.832+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 >> 172.21.15.164:0/427761391 conn(0x5621b4eff1d0 msgr2=0x5621b4efd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 shutdown_connections 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/427761391 wait complete. 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 msgr2=0x7efb4003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 0x7efb4003f2d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5621b4edd3d0 tx=0x7efc5800e950 comp rx=0 tx=0).stop 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 msgr2=0x5621b4ef6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5621b4edc340 tx=0x7efc60018830 comp rx=0 tx=0).stop 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 shutdown_connections 2024-09-14T10:55:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4003ce10 0x7efb4003f2d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/2447256673 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4ef6330 0x5621b4ef6750 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 >> 172.21.15.164:0/2447256673 conn(0x5621b4eea6e0 msgr2=0x5621b4eeaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 shutdown_connections 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/2447256673 wait complete. 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 msgr2=0x5621b4ee2990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 0x5621b4ee2990 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 msgr2=0x5621b4ee7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 0x5621b4ee7190 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 msgr2=0x7efb4c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 0x7efb4c03f320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5c057000 tx=0x7efc5c052000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 msgr2=0x5621b4edb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5621b4ed4770 tx=0x7efc58000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 shutdown_connections 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621b4ee4cf0 0x5621b4ee7190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621b4de7fc0 0x5621b4ee2990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7efb4c03ce60 0x7efb4c03f320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 --2- 172.21.15.164:0/3118539018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621b4d556f0 0x5621b4edb340 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.833+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 >> 172.21.15.164:0/3118539018 conn(0x5621b4ddbfb0 msgr2=0x5621b4ed4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.834+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 shutdown_connections 2024-09-14T10:55:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.834+0000 7efc6c22f800 1 -- 172.21.15.164:0/3118539018 wait complete. 2024-09-14T10:55:26.846 INFO:teuthology.orchestra.run.smithi164.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"c136da01-f20d-479c-ad02-fc389f5894e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:55:26.140597Z","creation_time":"2024-09-14T10:55:26.137796Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-14T10:55:26.846 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:55:26.140597Z', 'creation_time': '2024-09-14T10:55:26.137796Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-14T10:55:26.853 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:55:26.853 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:26.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:26.853 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:55:26.897 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:26.897 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.900+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.900+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff756339800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560937cd8790 0x560937cd8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff756339800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560937cda470 con 0x560937cd98b0 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff756339800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x560937b647d0 con 0x560937cd8790 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff752081640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560937cd8790 0x560937cd8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff752081640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560937cd8790 0x560937cd8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33634/0 (socket says 172.21.15.164:33634) 2024-09-14T10:55:26.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff751880640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x560937cd98b0 0x560937cd9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38752/0 (socket says 172.21.15.164:38752) 2024-09-14T10:55:26.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff752081640 1 -- 172.21.15.164:0/2534620555 learned_addr learned my addr 172.21.15.164:0/2534620555 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff752081640 1 -- 172.21.15.164:0/2534620555 >> v1:172.21.15.116:6789/0 conn(0x560937cd98b0 legacy=0x560937cd9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.901+0000 7ff752081640 1 -- 172.21.15.164:0/2534620555 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937cda640 con 0x560937cd8790 2024-09-14T10:55:26.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.903+0000 7ff752081640 1 --2- 172.21.15.164:0/2534620555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937cd8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff74400a520 tx=0x7ff744045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6463e333222474f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.903+0000 7ff75107f640 1 -- 172.21.15.164:0/2534620555 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744055070 con 0x560937cd8790 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.903+0000 7ff75107f640 1 -- 172.21.15.164:0/2534620555 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7440515b0 con 0x560937cd8790 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.903+0000 7ff75107f640 1 -- 172.21.15.164:0/2534620555 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7440518d0 con 0x560937cd8790 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 -- 172.21.15.164:0/2534620555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 msgr2=0x560937cd8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 --2- 172.21.15.164:0/2534620555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937cd8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff74400a520 tx=0x7ff744045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 -- 172.21.15.164:0/2534620555 shutdown_connections 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 --2- 172.21.15.164:0/2534620555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937cd8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 -- 172.21.15.164:0/2534620555 >> 172.21.15.164:0/2534620555 conn(0x560937cd3f80 msgr2=0x560937cd63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 -- 172.21.15.164:0/2534620555 shutdown_connections 2024-09-14T10:55:26.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.904+0000 7ff756339800 1 -- 172.21.15.164:0/2534620555 wait complete. 2024-09-14T10:55:26.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.917+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.917+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff756339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff756339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560937b71dd0 con 0x560937cd8790 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff752081640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff752081640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33640/0 (socket says 172.21.15.164:33640) 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff752081640 1 -- 172.21.15.164:0/3321890317 learned_addr learned my addr 172.21.15.164:0/3321890317 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff752081640 1 -- 172.21.15.164:0/3321890317 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937dc8cd0 con 0x560937cd8790 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff752081640 1 --2- 172.21.15.164:0/3321890317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff7440460d0 tx=0x7ff744051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1a8fc52341029d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.918+0000 7ff640608640 1 -- 172.21.15.164:0/3321890317 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7440519d0 con 0x560937cd8790 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff640608640 1 -- 172.21.15.164:0/3321890317 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff744051b70 con 0x560937cd8790 2024-09-14T10:55:26.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff640608640 1 -- 172.21.15.164:0/3321890317 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744051e50 con 0x560937cd8790 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 -- 172.21.15.164:0/3321890317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 msgr2=0x560937dc86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 --2- 172.21.15.164:0/3321890317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff7440460d0 tx=0x7ff744051000 comp rx=0 tx=0).stop 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 -- 172.21.15.164:0/3321890317 shutdown_connections 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 --2- 172.21.15.164:0/3321890317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937dc86e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 -- 172.21.15.164:0/3321890317 >> 172.21.15.164:0/3321890317 conn(0x560937cd3f80 msgr2=0x560937dc4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 -- 172.21.15.164:0/3321890317 shutdown_connections 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.919+0000 7ff756339800 1 -- 172.21.15.164:0/3321890317 wait complete. 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff756339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff756339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560937cdfda0 con 0x560937cd8790 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff752081640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff752081640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33644/0 (socket says 172.21.15.164:33644) 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff752081640 1 -- 172.21.15.164:0/2260874610 learned_addr learned my addr 172.21.15.164:0/2260874610 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff752081640 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937c4d290 con 0x560937cd8790 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff752081640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff7440460d0 tx=0x7ff744002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff63ee05640 1 -- 172.21.15.164:0/2260874610 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff744073020 con 0x560937cd8790 2024-09-14T10:55:26.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff63ee05640 1 -- 172.21.15.164:0/2260874610 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74406f580 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.920+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560937dd3e40 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.921+0000 7ff63ee05640 1 -- 172.21.15.164:0/2260874610 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74406f8a0 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.921+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560937dd4460 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.921+0000 7ff63ee05640 1 -- 172.21.15.164:0/2260874610 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ff744076020 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff63ee05640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 0x7ff63803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff63ee05640 1 -- 172.21.15.164:0/2260874610 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff74406b040 con 0x560937cd8790 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff751880640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 0x7ff63803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 0x560937dd83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937dd8a20 con 0x560937cd98b0 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff752882640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 0x560937dd83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff751880640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 0x7ff63803f2d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff73c001e30 tx=0x7ff73c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff752882640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 0x560937dd83d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff752882640 1 -- 172.21.15.164:0/2260874610 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff74c00a4d0 con 0x560937cd98b0 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.922+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937dd9300 con 0x560937cd98b0 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff752882640 1 -- 172.21.15.164:0/2260874610 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff74c00a4d0 con 0x560937cd98b0 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 0x560937ddd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937ddd840 con 0x560937ddac10 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff752081640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 0x560937ddd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff752081640 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 0x560937ddd0b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff752081640 1 -- 172.21.15.164:0/2260874610 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff744057030 con 0x560937ddac10 2024-09-14T10:55:26.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.923+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937dd9b50 con 0x560937cd98b0 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.924+0000 7ff752882640 1 -- 172.21.15.164:0/2260874610 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff74c00a4d0 con 0x560937cd98b0 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.924+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937dd9f70 con 0x560937cd98b0 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.924+0000 7ff752882640 1 -- 172.21.15.164:0/2260874610 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff74c00a4d0 con 0x560937cd98b0 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.924+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.924+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff756339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff756339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560937bd04a0 con 0x560937dec210 2024-09-14T10:55:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33646/0 (socket says 172.21.15.164:33646) 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff752882640 1 -- 172.21.15.164:0/3335354742 learned_addr learned my addr 172.21.15.164:0/3335354742 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff752882640 1 -- 172.21.15.164:0/3335354742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937decc70 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff752882640 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x560937dd8e20 tx=0x7ff74c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff637fff640 1 -- 172.21.15.164:0/3335354742 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c014450 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff637fff640 1 -- 172.21.15.164:0/3335354742 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c0145f0 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560937ded4a0 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff637fff640 1 -- 172.21.15.164:0/3335354742 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c014910 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.925+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560937deda40 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.926+0000 7ff637fff640 1 -- 172.21.15.164:0/3335354742 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ff74c011040 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.926+0000 7ff637fff640 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 0x7ff62c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.926+0000 7ff637fff640 1 -- 172.21.15.164:0/3335354742 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff74c01e070 con 0x560937dec210 2024-09-14T10:55:26.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752081640 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 0x7ff62c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff756339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff756339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560937dc9040 con 0x560937df8cd0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752081640 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 0x7ff62c03f2d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560937dd59d0 tx=0x7ff7440966f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33648/0 (socket says 172.21.15.164:33648) 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752882640 1 -- 172.21.15.164:0/1997181256 learned_addr learned my addr 172.21.15.164:0/1997181256 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752882640 1 -- 172.21.15.164:0/1997181256 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937df96c0 con 0x560937df8cd0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.927+0000 7ff752882640 1 --2- 172.21.15.164:0/1997181256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff74c016fd0 tx=0x7ff74c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a1da9c21a964fe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff635ffb640 1 -- 172.21.15.164:0/1997181256 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c04b070 con 0x560937df8cd0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff635ffb640 1 -- 172.21.15.164:0/1997181256 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c051070 con 0x560937df8cd0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff635ffb640 1 -- 172.21.15.164:0/1997181256 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c022db0 con 0x560937df8cd0 2024-09-14T10:55:26.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- 172.21.15.164:0/1997181256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 msgr2=0x560937df90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 --2- 172.21.15.164:0/1997181256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff74c016fd0 tx=0x7ff74c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- 172.21.15.164:0/1997181256 shutdown_connections 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 --2- 172.21.15.164:0/1997181256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937df90d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- 172.21.15.164:0/1997181256 >> 172.21.15.164:0/1997181256 conn(0x560937df50d0 msgr2=0x560937df3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- 172.21.15.164:0/1997181256 shutdown_connections 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- 172.21.15.164:0/1997181256 wait complete. 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 Processor -- start 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.928+0000 7ff756339800 1 -- start start 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff756339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff756339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560937df9ce0 con 0x560937df8cd0 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff752882640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33650/0 (socket says 172.21.15.164:33650) 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 learned_addr learned my addr 172.21.15.164:0/2383927181 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560937e00850 con 0x560937df8cd0 2024-09-14T10:55:26.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff752882640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff74c053400 tx=0x7ff74c054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff623fff640 1 -- 172.21.15.164:0/2383927181 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c04b040 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff623fff640 1 -- 172.21.15.164:0/2383927181 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c031030 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560937e00ae0 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff623fff640 1 -- 172.21.15.164:0/2383927181 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff74c016910 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.929+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560937e01670 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.930+0000 7ff623fff640 1 -- 172.21.15.164:0/2383927181 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ff74c011330 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.930+0000 7ff623fff640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff61c03ce10 0x7ff61c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.930+0000 7ff623fff640 1 -- 172.21.15.164:0/2383927181 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7ff74c00e040 con 0x560937df8cd0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.930+0000 7ff752081640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff61c03ce10 0x7ff61c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff752081640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff61c03ce10 0x7ff61c03f2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff744065fd0 tx=0x7ff744085070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937e0c070 0x560937e0e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e0ec80 con 0x560937e0c070 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff751880640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937e0c070 0x560937e0e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff751880640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937e0c070 0x560937e0e530 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00f610 con 0x560937e0c070 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 20 realm 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.931+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e0b3c0 con 0x560937e0c070 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00f610 con 0x560937e0c070 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e0f760 con 0x560937e0c070 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00f610 con 0x560937e0c070 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e10030 con 0x560937e0c070 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff73c00f610 con 0x560937e0c070 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937e10970 0x560937e12d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e134a0 con 0x560937e10970 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff752882640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937e10970 0x560937e12d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.932+0000 7ff752882640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937e10970 0x560937e12d60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff74c03e070 con 0x560937e10970 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff756339800 20 searching for the correct realm 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff74c03e070 con 0x560937e10970 2024-09-14T10:55:26.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752882640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ff74c014070 0x7ff74c001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752081640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ff74c014070 0x7ff74c001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.933+0000 7ff752081640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ff74c014070 0x7ff74c001770 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff752081640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ff744078020 0x7ff74408f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff751880640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ff744078020 0x7ff74408f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff751880640 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ff744078020 0x7ff74408f5c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00f610 con 0x7ff744078020 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.934+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00f610 con 0x560937e0c070 2024-09-14T10:55:26.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x7ff744078020 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x7ff744078020 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.935+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c03e070 con 0x560937e10970 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x7ff744078020 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.936+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c03e070 con 0x560937e10970 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.937+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x7ff744078020 2024-09-14T10:55:26.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.938+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x7ff744078020 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.939+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c02b040 con 0x560937e0c070 2024-09-14T10:55:26.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.940+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e10970 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff744078020 2024-09-14T10:55:26.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x560937e0c070 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560937e14e30 con 0x7ff74c014070 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.941+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e13f20 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e147c0 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e13b60 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 zone default found 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 4 Realm: () 2024-09-14T10:55:26.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 zonegroup default 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e152e0 con 0x7ff744078020 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.942+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e16dd0 con 0x560937e10970 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e172b0 con 0x560937e10970 2024-09-14T10:55:26.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 20 started sync module instance, tier type = 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.943+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e16170 con 0x7ff74c014070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.944+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.944+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94597592212832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e17bc0 con 0x7ff74c014070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.944+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e18410 con 0x560937e0c070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.945+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94597592212832] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.945+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.945+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94597592217360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e184f0 con 0x560937e0c070 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.945+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e19010 con 0x560937e10970 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.946+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.946+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94597592222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e18fd0 con 0x560937e10970 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.946+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e19ff0 con 0x7ff74c014070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.946+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94597592217360] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.947+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94597592222432] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.947+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.947+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94597592224768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e17f60 con 0x7ff74c014070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.947+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1aa00 con 0x560937e0c070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.948+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.948+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94597592229472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1b0d0 con 0x560937e0c070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.949+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1bbf0 con 0x7ff744078020 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.949+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94597592224768] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.949+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94597592229472] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.949+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.950+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94597592233664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1bbb0 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.950+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1c490 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.950+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94597592233664] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.951+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.951+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94597592226560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1c060 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.951+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1ca80 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.951+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94597592226560] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94597592237424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1cc60 con 0x7ff744078020 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=0 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=1 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=2 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=3 2024-09-14T10:55:26.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=4 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=5 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=6 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94597592237424] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 20 add_watcher() i=7 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.952+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e20030 con 0x560937e0c070 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.953+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.953+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94597592238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e1d420 con 0x560937e0c070 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94597592238928] v35'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff608fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff756339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff756339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:26.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff756339800 5 note: GC not initialized 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff5837fe640 20 reqs_thread_entry: start 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff756339800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff756339800 20 Filter name: none 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.954+0000 7ff5817fa640 20 reqs_thread_entry: start 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e531f0 con 0x7ff74c014070 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e53da0 con 0x7ff74c014070 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:26.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.955+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e53d50 con 0x7ff74c014070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 20 rados->read ofs=0 len=0 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e53d50 con 0x7ff74c014070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(65 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 4.f 4:f0239f39:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e56b70 con 0x560937e0c070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 4.38 4:1f04a4af:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e59500 con 0x560937e0c070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 4.39 4:9fbb9af9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e59500 con 0x560937e10970 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 4.1a 4:58ff1328:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e5e540 con 0x7ff74c014070 2024-09-14T10:55:26.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 4.2c 4:346bfbf7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e61380 con 0x560937e0c070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 4.14 4:28e9a4ac:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e640d0 con 0x560937e10970 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e66c60 con 0x560937e10970 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 4.17 4:eb4c7ac0:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e69760 con 0x7ff744078020 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 4.26 4:66262f28:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e6c110 con 0x7ff744078020 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 4.27 4:e7fb0465:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e6efa0 con 0x560937e0c070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 4.35 4:aee5ca16:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560937e71e10 con 0x560937e0c070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.956+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(71 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(69 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(66 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(67 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(72 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(70 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(75 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(76 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(74 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.957+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.958+0000 7ff608fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.958+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94597592238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e61380 con 0x560937e0c070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.959+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94597592238928] v35'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.959+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94597592212832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x7ff74c014070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.960+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94597592212832] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.960+0000 7ff756339800 20 remove_watcher() i=0 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.960+0000 7ff756339800 2 removed watcher, disabling cache 2024-09-14T10:55:26.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.960+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94597592217360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x560937e0c070 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.961+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94597592217360] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.961+0000 7ff756339800 20 remove_watcher() i=1 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.961+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94597592222432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x560937e10970 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.962+0000 7ff752882640 1 -- 172.21.15.164:0/2383927181 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94597592222432] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff74c066040 con 0x560937e10970 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.962+0000 7ff756339800 20 remove_watcher() i=2 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.962+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94597592224768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x7ff74c014070 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.963+0000 7ff752081640 1 -- 172.21.15.164:0/2383927181 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94597592224768] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff744057030 con 0x7ff74c014070 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.963+0000 7ff756339800 20 remove_watcher() i=3 2024-09-14T10:55:26.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.963+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94597592229472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x560937e0c070 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.964+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94597592229472] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x560937e0c070 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.964+0000 7ff756339800 20 remove_watcher() i=4 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.964+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94597592233664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.965+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94597592233664] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.965+0000 7ff756339800 20 remove_watcher() i=5 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.965+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94597592226560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.966+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94597592226560] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.966+0000 7ff756339800 20 remove_watcher() i=6 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.966+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94597592237424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560937e50ae0 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94597592237424] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c03b040 con 0x7ff744078020 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 20 remove_watcher() i=7 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ff744078020 msgr2=0x7ff74408f5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ff744078020 0x7ff74408f5c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937e0c070 msgr2=0x560937e0e530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937e0c070 0x560937e0e530 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ff74c014070 msgr2=0x7ff74c001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ff74c014070 0x7ff74c001770 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937e10970 msgr2=0x560937e12d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937e10970 0x560937e12d60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff61c03ce10 msgr2=0x7ff61c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff61c03ce10 0x7ff61c03f2d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff744065fd0 tx=0x7ff744085070 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 msgr2=0x560937e002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff751880640 1 -- 172.21.15.164:0/2383927181 reap_dead start 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff74c053400 tx=0x7ff74c054510 comp rx=0 tx=0).stop 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 shutdown_connections 2024-09-14T10:55:26.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/2383927181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937df8cd0 0x560937e002f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 >> 172.21.15.164:0/2383927181 conn(0x560937df50d0 msgr2=0x560937df32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 shutdown_connections 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/2383927181 wait complete. 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 msgr2=0x7ff62c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 0x7ff62c03f2d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x560937dd59d0 tx=0x7ff7440966f0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 msgr2=0x560937dec630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x560937dd8e20 tx=0x7ff74c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 shutdown_connections 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff62c03ce10 0x7ff62c03f2d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 --2- 172.21.15.164:0/3335354742 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937dec210 0x560937dec630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 >> 172.21.15.164:0/3335354742 conn(0x560937de05c0 msgr2=0x560937de09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.967+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 shutdown_connections 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/3335354742 wait complete. 2024-09-14T10:55:26.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 msgr2=0x560937dd83d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 0x560937dd83d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 msgr2=0x560937ddd0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 0x560937ddd0b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 msgr2=0x7ff63803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 0x7ff63803f2d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff73c001e30 tx=0x7ff73c001390 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 msgr2=0x560937c4cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff7440460d0 tx=0x7ff744002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 shutdown_connections 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560937ddac10 0x560937ddd0b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560937cd98b0 0x560937dd83d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff63803ce10 0x7ff63803f2d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 --2- 172.21.15.164:0/2260874610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560937cd8790 0x560937c4cd30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:26.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 >> 172.21.15.164:0/2260874610 conn(0x560937cd3f80 msgr2=0x560937dc9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:26.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 shutdown_connections 2024-09-14T10:55:26.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:26.968+0000 7ff756339800 1 -- 172.21.15.164:0/2260874610 wait complete. 2024-09-14T10:55:26.981 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"c136da01-f20d-479c-ad02-fc389f5894e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:55:26.140597Z","creation_time":"2024-09-14T10:55:26.137796Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-14T10:55:26.982 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:55:26.140597Z', 'creation_time': '2024-09-14T10:55:26.137796Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:55:26.982 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-14T10:55:26.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-14T10:55:26.982 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-14T10:55:27.027 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.028 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.030+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.030+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a4b2c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d57087bba0 0x55d57087e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a4b2c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d57087e6e0 con 0x55d5707eb7b0 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a4b2c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55d5707027d0 con 0x55d57087bba0 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a004e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d57087bba0 0x55d57087e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a084f640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55d5707eb7b0 0x55d57087a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38758/0 (socket says 172.21.15.164:38758) 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a084f640 1 -- 172.21.15.164:0/3687580525 learned_addr learned my addr 172.21.15.164:0/3687580525 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a004e640 1 -- 172.21.15.164:0/3687580525 >> v1:172.21.15.116:6789/0 conn(0x55d5707eb7b0 legacy=0x55d57087a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f53a004e640 1 -- 172.21.15.164:0/3687580525 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57087f910 con 0x55d57087bba0 2024-09-14T10:55:27.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.031+0000 7f539f84d640 1 -- 172.21.15.164:0/3687580525 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077087486 0 0) 0x55d57087e6e0 con 0x55d5707eb7b0 2024-09-14T10:55:27.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.033+0000 7f53a004e640 1 --2- 172.21.15.164:0/3687580525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57087bba0 0x55d57087e060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f539400a470 tx=0x7f5394045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cca3de9904a111 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.033+0000 7f539f84d640 1 -- 172.21.15.164:0/3687580525 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394053570 con 0x55d57087bba0 2024-09-14T10:55:27.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.033+0000 7f539f84d640 1 -- 172.21.15.164:0/3687580525 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394058070 con 0x55d57087bba0 2024-09-14T10:55:27.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.033+0000 7f539f84d640 1 -- 172.21.15.164:0/3687580525 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5394053880 con 0x55d57087bba0 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3687580525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57087bba0 msgr2=0x55d57087e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/3687580525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57087bba0 0x55d57087e060 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f539400a470 tx=0x7f5394045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3687580525 shutdown_connections 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/3687580525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57087bba0 0x55d57087e060 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3687580525 >> 172.21.15.164:0/3687580525 conn(0x55d570871f90 msgr2=0x55d5708743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3687580525 shutdown_connections 2024-09-14T10:55:27.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.034+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3687580525 wait complete. 2024-09-14T10:55:27.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.047+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a4b2c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a4b2c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d57070fdd0 con 0x55d5707eb7b0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a084f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a084f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33670/0 (socket says 172.21.15.164:33670) 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a084f640 1 -- 172.21.15.164:0/432812741 learned_addr learned my addr 172.21.15.164:0/432812741 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a084f640 1 -- 172.21.15.164:0/432812741 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d570967c30 con 0x55d5707eb7b0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.048+0000 7f53a084f640 1 --2- 172.21.15.164:0/432812741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5390001ea0 tx=0x7f539000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b118025afa280226 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f528ee0d640 1 -- 172.21.15.164:0/432812741 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5390008070 con 0x55d5707eb7b0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f528ee0d640 1 -- 172.21.15.164:0/432812741 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539000d500 con 0x55d5707eb7b0 2024-09-14T10:55:27.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f528ee0d640 1 -- 172.21.15.164:0/432812741 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539000d880 con 0x55d5707eb7b0 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 -- 172.21.15.164:0/432812741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 msgr2=0x55d570967640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/432812741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5390001ea0 tx=0x7f539000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 -- 172.21.15.164:0/432812741 shutdown_connections 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/432812741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570967640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 -- 172.21.15.164:0/432812741 >> 172.21.15.164:0/432812741 conn(0x55d570871f90 msgr2=0x55d570962fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 -- 172.21.15.164:0/432812741 shutdown_connections 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.049+0000 7f53a4b2c800 1 -- 172.21.15.164:0/432812741 wait complete. 2024-09-14T10:55:27.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a4b2c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a4b2c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d57087ebb0 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a084f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a084f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33682/0 (socket says 172.21.15.164:33682) 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a084f640 1 -- 172.21.15.164:0/1793994652 learned_addr learned my addr 172.21.15.164:0/1793994652 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a084f640 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5708780f0 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.050+0000 7f53a084f640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53900012f0 tx=0x7f5390000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.051+0000 7f528d60a640 1 -- 172.21.15.164:0/1793994652 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539000f9d0 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.051+0000 7f528d60a640 1 -- 172.21.15.164:0/1793994652 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539000fb70 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.051+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5708764a0 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.051+0000 7f528d60a640 1 -- 172.21.15.164:0/1793994652 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539000fe50 con 0x55d5707eb7b0 2024-09-14T10:55:27.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.051+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d570876a60 con 0x55d5707eb7b0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f528d60a640 1 -- 172.21.15.164:0/1793994652 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5390017040 con 0x55d5707eb7b0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f528d60a640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 0x7f528803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f528d60a640 1 -- 172.21.15.164:0/1793994652 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5390015020 con 0x55d5707eb7b0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a004e640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 0x7f528803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 0x55d570978650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570978b90 con 0x55d57087bba0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a1050640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 0x55d570978650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a004e640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 0x7f528803f470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5394057000 tx=0x7f5394052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.052+0000 7f53a1050640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 0x55d570978650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a1050640 1 -- 172.21.15.164:0/1793994652 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f539800a4d0 con 0x55d57087bba0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570876f60 con 0x55d57087bba0 2024-09-14T10:55:27.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a1050640 1 -- 172.21.15.164:0/1793994652 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f539800a4d0 con 0x55d57087bba0 2024-09-14T10:55:27.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 0x55d57097d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d57097d9a0 con 0x55d57097aee0 2024-09-14T10:55:27.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a084f640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 0x55d57097d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.053+0000 7f53a084f640 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 0x55d57097d2d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.054+0000 7f53a084f640 1 -- 172.21.15.164:0/1793994652 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f539002d070 con 0x55d57097aee0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.054+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570979d80 con 0x55d57087bba0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.054+0000 7f53a1050640 1 -- 172.21.15.164:0/1793994652 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f539800a4d0 con 0x55d57087bba0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.054+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d57097a220 con 0x55d57087bba0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.054+0000 7f53a1050640 1 -- 172.21.15.164:0/1793994652 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f539800a4d0 con 0x55d57087bba0 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a4b2c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a4b2c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d57076e4a0 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33696/0 (socket says 172.21.15.164:33696) 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a1050640 1 -- 172.21.15.164:0/2400726503 learned_addr learned my addr 172.21.15.164:0/2400726503 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a1050640 1 -- 172.21.15.164:0/2400726503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d57098ce20 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.055+0000 7f53a1050640 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55d570978f90 tx=0x7f5398018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.056+0000 7f52867fc640 1 -- 172.21.15.164:0/2400726503 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5398014450 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.056+0000 7f52867fc640 1 -- 172.21.15.164:0/2400726503 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53980145f0 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.056+0000 7f52867fc640 1 -- 172.21.15.164:0/2400726503 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5398014910 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.056+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d57098d650 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.056+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57098dbf0 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f52867fc640 1 -- 172.21.15.164:0/2400726503 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5398011040 con 0x55d57098c3c0 2024-09-14T10:55:27.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f52867fc640 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 0x7f527803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f52867fc640 1 -- 172.21.15.164:0/2400726503 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f539801e070 con 0x55d57098c3c0 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a084f640 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 0x7f527803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a084f640 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 0x7f527803f2d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55d570979030 tx=0x7f539001bf60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a4b2c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a4b2c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d570968060 con 0x55d570998e00 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33702/0 (socket says 172.21.15.164:33702) 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.057+0000 7f53a1050640 1 -- 172.21.15.164:0/3295645309 learned_addr learned my addr 172.21.15.164:0/3295645309 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a1050640 1 -- 172.21.15.164:0/3295645309 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5709997f0 con 0x55d570998e00 2024-09-14T10:55:27.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a1050640 1 --2- 172.21.15.164:0/3295645309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5398016620 tx=0x7f5398011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2645f50cdc9ee5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f5277fff640 1 -- 172.21.15.164:0/3295645309 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5398028070 con 0x55d570998e00 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f5277fff640 1 -- 172.21.15.164:0/3295645309 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5398022de0 con 0x55d570998e00 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f5277fff640 1 -- 172.21.15.164:0/3295645309 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f539802b350 con 0x55d570998e00 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3295645309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 msgr2=0x55d570999200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/3295645309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5398016620 tx=0x7f5398011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3295645309 shutdown_connections 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/3295645309 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d570999200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3295645309 >> 172.21.15.164:0/3295645309 conn(0x55d570995220 msgr2=0x55d570993460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3295645309 shutdown_connections 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.058+0000 7f53a4b2c800 1 -- 172.21.15.164:0/3295645309 wait complete. 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a4b2c800 1 Processor -- start 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a4b2c800 1 -- start start 2024-09-14T10:55:27.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a4b2c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d5709a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a4b2c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d570999e10 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d5709a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a1050640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d5709a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33704/0 (socket says 172.21.15.164:33704) 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 learned_addr learned my addr 172.21.15.164:0/2225403367 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5709a08e0 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.059+0000 7f53a1050640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d5709a0380 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5398022f90 tx=0x7f5398054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f52767fc640 1 -- 172.21.15.164:0/2225403367 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5398044070 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f52767fc640 1 -- 172.21.15.164:0/2225403367 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5398032070 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5709a0b70 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f52767fc640 1 -- 172.21.15.164:0/2225403367 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5398054cd0 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5709a14f0 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.060+0000 7f52767fc640 1 -- 172.21.15.164:0/2225403367 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5398001770 con 0x55d570998e00 2024-09-14T10:55:27.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f52767fc640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f526c03ce60 0x7f526c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f52767fc640 1 -- 172.21.15.164:0/2225403367 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f539800e040 con 0x55d570998e00 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a084f640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f526c03ce60 0x7f526c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d5709ac110 0x55d5709ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709aed20 con 0x55d5709ac110 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a084f640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f526c03ce60 0x7f526c03f320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55d57097dd80 tx=0x7f5390039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.061+0000 7f53a004e640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d5709ac110 0x55d5709ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a004e640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d5709ac110 0x55d5709ae5d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 realm 2024-09-14T10:55:27.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709af150 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709afa20 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.062+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709afdc0 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d5709b0b20 0x55d5709b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b3450 con 0x55d5709b0b20 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d5709b0b20 0x55d5709b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d5709b0b20 0x55d5709b2f10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f539802a070 con 0x55d5709b0b20 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 20 searching for the correct realm 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f539802a070 con 0x55d5709b0b20 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5398014070 0x7f5398037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.063+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a084f640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5398014070 0x7f5398037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a084f640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5398014070 0x7f5398037960 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002d070 con 0x7f5398014070 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a084f640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f539002e550 0x7f539002e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.064+0000 7f53a004e640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f539002e550 0x7f539002e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f539002e550 0x7f539002e970 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.065+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002d070 con 0x7f5398014070 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539802a070 con 0x55d5709b0b20 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.066+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f539002d070 con 0x7f5398014070 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539802a070 con 0x55d5709b0b20 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.067+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539802a070 con 0x55d5709b0b20 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.068+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002d070 con 0x7f5398014070 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.069+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.070+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f539002d070 con 0x7f5398014070 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709b0b20 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f539002e550 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x55d5709ac110 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.071+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4da0 con 0x7f5398014070 2024-09-14T10:55:27.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b3e90 con 0x55d5709ac110 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4730 con 0x55d5709ac110 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.072+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b3ad0 con 0x55d5709ac110 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 zone default found 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 4 Realm: () 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 zonegroup default 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b4310 con 0x7f539002e550 2024-09-14T10:55:27.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b7120 con 0x55d5709b0b20 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b7700 con 0x55d5709b0b20 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 started sync module instance, tier type = 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.073+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b6580 con 0x7f5398014070 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.074+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.074+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94375205626064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b7b60 con 0x7f5398014070 2024-09-14T10:55:27.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.074+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b8520 con 0x55d5709ac110 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.075+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94375205626064] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.075+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.076+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94375205634160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b8490 con 0x55d5709ac110 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.076+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b93e0 con 0x55d5709b0b20 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.077+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94375205634160] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.077+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.077+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94375205636368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b93e0 con 0x55d5709b0b20 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.077+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b9de0 con 0x7f5398014070 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.078+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94375205636368] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.078+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.078+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94375205637936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b9350 con 0x7f5398014070 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.078+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709baca0 con 0x55d5709ac110 2024-09-14T10:55:27.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.079+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94375205637936] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.080+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.080+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94375205644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bac10 con 0x55d5709ac110 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.080+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bbb60 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.081+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94375205644272] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.081+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.082+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94375205646336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bbb60 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.082+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bc520 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.082+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.082+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94375205650544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bc940 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.082+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bd420 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94375205646336] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94375205650544] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94375205654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bc490 con 0x7f539002e550 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=0 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=1 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=2 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=3 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=4 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=5 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.083+0000 7f53a4b2c800 20 add_watcher() i=6 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.084+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94375205654320] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.084+0000 7f53a4b2c800 20 add_watcher() i=7 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.084+0000 7f53a4b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.084+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709c0520 con 0x55d5709ac110 2024-09-14T10:55:27.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.085+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.085+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94375205648048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bd9a0 con 0x55d5709ac110 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94375205648048] v35'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f5256fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 5 note: GC not initialized 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f5255fe3640 20 reqs_thread_entry: start 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 20 Filter name: none 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f51c77fe640 20 reqs_thread_entry: start 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.086+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f3070 con 0x55d5709ac110 2024-09-14T10:55:27.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f4460 con 0x7f5398014070 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.087+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f4800 con 0x7f5398014070 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 4.f 4:f0239f39:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f6340 con 0x55d5709ac110 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 4.38 4:1f04a4af:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f8ff0 con 0x55d5709ac110 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 4.39 4:9fbb9af9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709fbc60 con 0x55d5709b0b20 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 4.1a 4:58ff1328:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f9070 con 0x7f5398014070 2024-09-14T10:55:27.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 4.2c 4:346bfbf7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a00e70 con 0x55d5709ac110 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 4.14 4:28e9a4ac:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a03bf0 con 0x55d5709b0b20 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a069a0 con 0x55d5709b0b20 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 4.17 4:eb4c7ac0:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a09750 con 0x7f539002e550 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 4.26 4:66262f28:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0c4b0 con 0x7f539002e550 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 4.27 4:e7fb0465:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0f260 con 0x55d5709ac110 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 4.35 4:aee5ca16:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a11fc0 con 0x55d5709ac110 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(70 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.088+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(74 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(75 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(72 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.089+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709f1f50 con 0x7f5398014070 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.090+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(76 foo.buckets [call] v35'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.090+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0c4b0 con 0x7f5398014070 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.091+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(77 foo.buckets [call] v35'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.091+0000 7f53a4b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.091+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0c4b0 con 0x55d5709ac110 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.091+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.092+0000 7f53a4b2c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:27.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.092+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0c4b0 con 0x7f5398014070 2024-09-14T10:55:27.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.092+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.093+0000 7f5256fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.093+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94375205648048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d570a0c4b0 con 0x55d5709ac110 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.094+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94375205648048] v35'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.094+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94375205626064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709bb6b0 con 0x7f5398014070 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.095+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94375205626064] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.095+0000 7f53a4b2c800 20 remove_watcher() i=0 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.095+0000 7f53a4b2c800 2 removed watcher, disabling cache 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.095+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94375205634160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b60d0 con 0x55d5709ac110 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.096+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94375205634160] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.096+0000 7f53a4b2c800 20 remove_watcher() i=1 2024-09-14T10:55:27.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.096+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94375205636368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b60d0 con 0x55d5709b0b20 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.097+0000 7f53a1050640 1 -- 172.21.15.164:0/2225403367 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94375205636368] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5398066040 con 0x55d5709b0b20 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.097+0000 7f53a4b2c800 20 remove_watcher() i=2 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.097+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94375205637936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b8910 con 0x7f5398014070 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.098+0000 7f53a084f640 1 -- 172.21.15.164:0/2225403367 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94375205637936] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5390063040 con 0x7f5398014070 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.098+0000 7f53a4b2c800 20 remove_watcher() i=3 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.098+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94375205644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b60d0 con 0x55d5709ac110 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.099+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94375205644272] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x55d5709ac110 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.099+0000 7f53a4b2c800 20 remove_watcher() i=4 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.099+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94375205646336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b8f30 con 0x7f539002e550 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94375205646336] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a4b2c800 20 remove_watcher() i=5 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94375205650544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709ba7f0 con 0x7f539002e550 2024-09-14T10:55:27.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94375205650544] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a4b2c800 20 remove_watcher() i=6 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.100+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94375205654320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5709b60d0 con 0x7f539002e550 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94375205654320] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5394051070 con 0x7f539002e550 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 20 remove_watcher() i=7 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f539002e550 msgr2=0x7f539002e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f539002e550 0x7f539002e970 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d5709ac110 msgr2=0x55d5709ae5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d5709ac110 0x55d5709ae5d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5398014070 msgr2=0x7f5398037960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5398014070 0x7f5398037960 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d5709b0b20 msgr2=0x55d5709b2f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.101+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d5709b0b20 0x55d5709b2f10 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f526c03ce60 msgr2=0x7f526c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f526c03ce60 0x7f526c03f320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55d57097dd80 tx=0x7f5390039000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 msgr2=0x55d5709a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2225403367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d570998e00 0x55d5709a0380 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5398022f90 tx=0x7f5398054510 comp rx=0 tx=0).stop 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a004e640 1 -- 172.21.15.164:0/2225403367 reap_dead start 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 shutdown_connections 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 >> 172.21.15.164:0/2225403367 conn(0x55d570995220 msgr2=0x55d570993430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 shutdown_connections 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2225403367 wait complete. 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 msgr2=0x7f527803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 0x7f527803f2d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55d570979030 tx=0x7f539001bf60 comp rx=0 tx=0).stop 2024-09-14T10:55:27.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 msgr2=0x55d57098c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55d570978f90 tx=0x7f5398018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 shutdown_connections 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f527803ce10 0x7f527803f2d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/2400726503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d57098c3c0 0x55d57098c7e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 >> 172.21.15.164:0/2400726503 conn(0x55d570980770 msgr2=0x55d570980b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 shutdown_connections 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/2400726503 wait complete. 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 msgr2=0x55d570978650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 0x55d570978650 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 msgr2=0x55d57097d2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.102+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 0x55d57097d2d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 msgr2=0x7f528803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 0x7f528803f470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5394057000 tx=0x7f5394052000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 msgr2=0x55d570877b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f53900012f0 tx=0x7f5390000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 shutdown_connections 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d57097aee0 0x55d57097d2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d57087bba0 0x55d570978650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f528803cfb0 0x7f528803f470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 --2- 172.21.15.164:0/1793994652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d5707eb7b0 0x55d570877b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 >> 172.21.15.164:0/1793994652 conn(0x55d570871f90 msgr2=0x55d570968b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 shutdown_connections 2024-09-14T10:55:27.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.103+0000 7f53a4b2c800 1 -- 172.21.15.164:0/1793994652 wait complete. 2024-09-14T10:55:27.114 INFO:teuthology.orchestra.run.smithi164.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-14T10:55:27.091603Z","last_stats_update":"2024-09-14T10:55:27.090206Z"} 2024-09-14T10:55:27.114 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-14T10:55:27.091603Z', 'last_stats_update': '2024-09-14T10:55:27.090206Z'} 2024-09-14T10:55:27.120 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:27.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-14T10:55:27.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-14T10:55:27.120 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-14T10:55:27.167 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.167 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd041d26800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d741267f10 0x55d7412f7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd041d26800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7412fb700 con 0x55d7412f7a50 2024-09-14T10:55:27.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd041d26800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55d74117f7d0 con 0x55d741267f10 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd03d95d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d741267f10 0x55d7412f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd03d95d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55d741267f10 0x55d7412f7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33706/0 (socket says 172.21.15.164:33706) 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd03d95d640 1 -- 172.21.15.164:0/3843677979 learned_addr learned my addr 172.21.15.164:0/3843677979 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.170+0000 7fd03d15c640 1 --1- 172.21.15.164:0/3843677979 >> v1:172.21.15.116:6789/0 conn(0x55d7412f7a50 0x55d7412f9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38762/0 (socket says 172.21.15.164:38762) 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.171+0000 7fd03d95d640 1 -- 172.21.15.164:0/3843677979 >> v1:172.21.15.116:6789/0 conn(0x55d7412f7a50 legacy=0x55d7412f9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.171+0000 7fd03d95d640 1 -- 172.21.15.164:0/3843677979 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7412fc930 con 0x55d741267f10 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.172+0000 7fd03d95d640 1 --2- 172.21.15.164:0/3843677979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7412f7510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd03800a520 tx=0x7fd038045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554c61033dba339b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd03c95b640 1 -- 172.21.15.164:0/3843677979 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd038055070 con 0x55d741267f10 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd03c95b640 1 -- 172.21.15.164:0/3843677979 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0380515b0 con 0x55d741267f10 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd03c95b640 1 -- 172.21.15.164:0/3843677979 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0380518d0 con 0x55d741267f10 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 -- 172.21.15.164:0/3843677979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 msgr2=0x55d7412f7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 --2- 172.21.15.164:0/3843677979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7412f7510 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd03800a520 tx=0x7fd038045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 -- 172.21.15.164:0/3843677979 shutdown_connections 2024-09-14T10:55:27.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 --2- 172.21.15.164:0/3843677979 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7412f7510 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 -- 172.21.15.164:0/3843677979 >> 172.21.15.164:0/3843677979 conn(0x55d7412eefa0 msgr2=0x55d7412f1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 -- 172.21.15.164:0/3843677979 shutdown_connections 2024-09-14T10:55:27.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.173+0000 7fd041d26800 1 -- 172.21.15.164:0/3843677979 wait complete. 2024-09-14T10:55:27.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.187+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.187+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd041d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd041d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d74118cdd0 con 0x55d741267f10 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd03d95d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd03d95d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33710/0 (socket says 172.21.15.164:33710) 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd03d95d640 1 -- 172.21.15.164:0/3680417335 learned_addr learned my addr 172.21.15.164:0/3680417335 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd03d95d640 1 -- 172.21.15.164:0/3680417335 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7413e4e20 con 0x55d741267f10 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fd03d95d640 1 --2- 172.21.15.164:0/3680417335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0380460d0 tx=0x7fd038051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a118c1e03c605d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fcf2be07640 1 -- 172.21.15.164:0/3680417335 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0380519d0 con 0x55d741267f10 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fcf2be07640 1 -- 172.21.15.164:0/3680417335 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd038051b70 con 0x55d741267f10 2024-09-14T10:55:27.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.188+0000 7fcf2be07640 1 -- 172.21.15.164:0/3680417335 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd038051e50 con 0x55d741267f10 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 -- 172.21.15.164:0/3680417335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 msgr2=0x55d7413e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 --2- 172.21.15.164:0/3680417335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0380460d0 tx=0x7fd038051000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 -- 172.21.15.164:0/3680417335 shutdown_connections 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 --2- 172.21.15.164:0/3680417335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413e4830 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 -- 172.21.15.164:0/3680417335 >> 172.21.15.164:0/3680417335 conn(0x55d7412eefa0 msgr2=0x55d7413e01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 -- 172.21.15.164:0/3680417335 shutdown_connections 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 -- 172.21.15.164:0/3680417335 wait complete. 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.189+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd041d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd041d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d7412fbbd0 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd03d95d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd03d95d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33714/0 (socket says 172.21.15.164:33714) 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd03d95d640 1 -- 172.21.15.164:0/4108570004 learned_addr learned my addr 172.21.15.164:0/4108570004 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd03d95d640 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7413ec780 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fd03d95d640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd0380460d0 tx=0x7fd038002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.190+0000 7fcf2a604640 1 -- 172.21.15.164:0/4108570004 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd038073020 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.191+0000 7fcf2a604640 1 -- 172.21.15.164:0/4108570004 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03806f5a0 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.191+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7413eca10 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.191+0000 7fcf2a604640 1 -- 172.21.15.164:0/4108570004 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd03806f8c0 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.191+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7413ed620 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.191+0000 7fcf2a604640 1 -- 172.21.15.164:0/4108570004 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd038076020 con 0x55d741267f10 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fcf2a604640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 0x7fcf2403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fcf2a604640 1 -- 172.21.15.164:0/4108570004 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd03806b040 con 0x55d741267f10 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd03d15c640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 0x7fcf2403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 0x55d7413f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7413f3db0 con 0x55d7412f7a50 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd03e15e640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 0x55d7413f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd03d15c640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 0x7fcf2403f2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55d7412684d0 tx=0x7fd028001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd03e15e640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 0x55d7413f3870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd03e15e640 1 -- 172.21.15.164:0/4108570004 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd03000a4d0 con 0x55d7412f7a50 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.192+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7413f4150 con 0x55d7412f7a50 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd03e15e640 1 -- 172.21.15.164:0/4108570004 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd03000a4d0 con 0x55d7412f7a50 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 0x55d7413f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7413f8880 con 0x55d7413f5c50 2024-09-14T10:55:27.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd03d95d640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 0x55d7413f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd03d95d640 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 0x55d7413f80f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd03d95d640 1 -- 172.21.15.164:0/4108570004 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd038057030 con 0x55d7413f5c50 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.193+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7413f49a0 con 0x55d7412f7a50 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.194+0000 7fd03e15e640 1 -- 172.21.15.164:0/4108570004 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd03000a4d0 con 0x55d7412f7a50 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.194+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7413f4e00 con 0x55d7412f7a50 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.194+0000 7fd03e15e640 1 -- 172.21.15.164:0/4108570004 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd03000a4d0 con 0x55d7412f7a50 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.194+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.194+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd041d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd041d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d7411eb4a0 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33730/0 (socket says 172.21.15.164:33730) 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd03e15e640 1 -- 172.21.15.164:0/3459269029 learned_addr learned my addr 172.21.15.164:0/3459269029 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd03e15e640 1 -- 172.21.15.164:0/3459269029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d741407d50 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd03e15e640 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55d7413ed220 tx=0x7fd030018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fcf237fe640 1 -- 172.21.15.164:0/3459269029 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd030014450 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fcf237fe640 1 -- 172.21.15.164:0/3459269029 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030014610 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d741408580 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fcf237fe640 1 -- 172.21.15.164:0/3459269029 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd030014930 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.195+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d741408b20 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.196+0000 7fcf237fe640 1 -- 172.21.15.164:0/3459269029 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd030011040 con 0x55d7414072f0 2024-09-14T10:55:27.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fcf237fe640 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 0x7fcf1803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fcf237fe640 1 -- 172.21.15.164:0/3459269029 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd03001e070 con 0x55d7414072f0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd03d95d640 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 0x7fcf1803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd03d95d640 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 0x7fcf1803f2d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55d7413ee320 tx=0x7fd038067040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd041d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd041d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d7413e5190 con 0x55d7412f45b0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33746/0 (socket says 172.21.15.164:33746) 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.197+0000 7fd03e15e640 1 -- 172.21.15.164:0/369371847 learned_addr learned my addr 172.21.15.164:0/369371847 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd03e15e640 1 -- 172.21.15.164:0/369371847 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7412f4ef0 con 0x55d7412f45b0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd03e15e640 1 --2- 172.21.15.164:0/369371847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd030022ea0 tx=0x7fd030045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01700a42bfde3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fcf217fa640 1 -- 172.21.15.164:0/369371847 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd03004b070 con 0x55d7412f45b0 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fcf217fa640 1 -- 172.21.15.164:0/369371847 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030051070 con 0x55d7412f45b0 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fcf217fa640 1 -- 172.21.15.164:0/369371847 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0300168f0 con 0x55d7412f45b0 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 -- 172.21.15.164:0/369371847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 msgr2=0x55d7412f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 --2- 172.21.15.164:0/369371847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd030022ea0 tx=0x7fd030045490 comp rx=0 tx=0).stop 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 -- 172.21.15.164:0/369371847 shutdown_connections 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 --2- 172.21.15.164:0/369371847 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d7412f49b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 -- 172.21.15.164:0/369371847 >> 172.21.15.164:0/369371847 conn(0x55d741410190 msgr2=0x55d74140e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 -- 172.21.15.164:0/369371847 shutdown_connections 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.198+0000 7fd041d26800 1 -- 172.21.15.164:0/369371847 wait complete. 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd041d26800 1 Processor -- start 2024-09-14T10:55:27.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd041d26800 1 -- start start 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd041d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d74141d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd041d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55d7412f3470 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d74141d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd03e15e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d74141d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33752/0 (socket says 172.21.15.164:33752) 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 learned_addr learned my addr 172.21.15.164:0/1100610897 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.199+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d74141dac0 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fd03e15e640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d74141d560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd030022ea0 tx=0x7fd030054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fcf0f7fe640 1 -- 172.21.15.164:0/1100610897 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd03004b030 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fcf0f7fe640 1 -- 172.21.15.164:0/1100610897 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd030031070 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d74141dd50 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fcf0f7fe640 1 -- 172.21.15.164:0/1100610897 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd030054e40 con 0x55d7412f45b0 2024-09-14T10:55:27.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d74141e6d0 con 0x55d7412f45b0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.200+0000 7fcf0f7fe640 1 -- 172.21.15.164:0/1100610897 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd030045760 con 0x55d7412f45b0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fcf0f7fe640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf0803ce60 0x7fcf0803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fcf0f7fe640 1 -- 172.21.15.164:0/1100610897 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd03004c070 con 0x55d7412f45b0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fd03d95d640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf0803ce60 0x7fcf0803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fd03d95d640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf0803ce60 0x7fcf0803f320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd03806ffa0 tx=0x7fd038084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7414292e0 0x55d74142b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.201+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d74142bef0 con 0x55d7414292e0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd03d15c640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7414292e0 0x55d74142b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd03d15c640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7414292e0 0x55d74142b7a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd02800bdb0 con 0x55d7414292e0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 20 realm 2024-09-14T10:55:27.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741428630 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd02800bdb0 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.202+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d74142c9e0 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd02800bdb0 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d74142d2b0 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd02800bdb0 con 0x55d7414292e0 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d74142dcd0 0x55d7414300c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741430790 con 0x55d74142dcd0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd03e15e640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d74142dcd0 0x55d7414300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd03e15e640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d74142dcd0 0x55d7414300c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.203+0000 7fd041d26800 20 searching for the correct realm 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03e15e640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd030014070 0x7fd0300238a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03d95d640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd030014070 0x7fd0300238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03d95d640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd030014070 0x7fd0300238a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.204+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d95d640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd03808e040 0x7fd0380978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d15c640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd03808e040 0x7fd0380978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d15c640 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd03808e040 0x7fd0380978b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02800bdb0 con 0x7fd03808e040 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.205+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02800bdb0 con 0x55d7414292e0 2024-09-14T10:55:27.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x7fd03808e040 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x7fd03808e040 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.206+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x7fd03808e040 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.207+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x7fd03808e040 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.208+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.209+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x7fd03808e040 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02802b040 con 0x55d7414292e0 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.210+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.211+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d74142dcd0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd03808e040 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x55d7414292e0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.212+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7414320a0 con 0x7fd030014070 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741431180 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741431a20 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741432520 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 zone default found 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 4 Realm: () 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 zonegroup default 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.213+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741432520 con 0x7fd03808e040 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741434300 con 0x55d74142dcd0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741434810 con 0x55d74142dcd0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 started sync module instance, tier type = 2024-09-14T10:55:27.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.214+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7414337a0 con 0x7fd030014070 2024-09-14T10:55:27.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.215+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.215+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94383001252592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741434c70 con 0x7fd030014070 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.215+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7414354c0 con 0x55d7414292e0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.216+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94383001252592] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.217+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.217+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94383001254848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741435600 con 0x55d7414292e0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.217+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741436120 con 0x55d74142dcd0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.218+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94383001254848] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.218+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.218+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94383001263088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7414360e0 con 0x55d74142dcd0 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.218+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741436bd0 con 0x7fd030014070 2024-09-14T10:55:27.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.219+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94383001263088] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.219+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.219+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94383001265888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741436ff0 con 0x7fd030014070 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.219+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7414379f0 con 0x55d7414292e0 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.220+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.220+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94383001269504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741438290 con 0x55d7414292e0 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.220+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741438d90 con 0x7fd03808e040 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.220+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94383001265888] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.221+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94383001269504] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.222+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.222+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94383001260112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741438240 con 0x7fd03808e040 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.222+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741439200 con 0x7fd03808e040 2024-09-14T10:55:27.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.223+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94383001260112] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.223+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.223+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94383001271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7414393e0 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.223+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741439c30 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94383001277888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741439ff0 con 0x7fd03808e040 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=0 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=1 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=2 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=3 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=4 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.224+0000 7fd041d26800 20 add_watcher() i=5 2024-09-14T10:55:27.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.225+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94383001271696] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.225+0000 7fd041d26800 20 add_watcher() i=6 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.225+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94383001277888] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.226+0000 7fd041d26800 20 add_watcher() i=7 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.226+0000 7fd041d26800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.226+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741438f30 con 0x55d7414292e0 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.226+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.226+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94383001279104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741438f30 con 0x55d7414292e0 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94383001279104] v35'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fceef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd041d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd041d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd041d26800 5 note: GC not initialized 2024-09-14T10:55:27.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fceee7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd041d26800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.227+0000 7fd041d26800 20 Filter name: none 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fce5ffff640 20 reqs_thread_entry: start 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741470350 con 0x55d7414292e0 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d74146fd30 con 0x7fd030014070 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.228+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741473ac0 con 0x7fd030014070 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:27.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.229+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d741477200 con 0x7fd030014070 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 foo.buckets [call] v35'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741476250 con 0x7fd030014070 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.230+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74147aec0 con 0x7fd030014070 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd041d26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd041d26800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd041d26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94383001544864 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d741477c50 con 0x7fd03808e040 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== watch-notify(notify (1) cookie 94383001271696 notify 150323855362 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7fd028018040 con 0x7fd03808e040 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fcf217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94383001271696 notifier 4493 bl.length()=338 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fcf217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fcf217fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(68 notify.6 [notify cookie 94383001544864 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fcf217fa640 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fcf00003ea0 con 0x7fd03808e040 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.232+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify_complete (2) cookie 94383001544864 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd028009050 con 0x7fd03808e040 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.233+0000 7fceef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.233+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94383001279104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x55d7414292e0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.234+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94383001279104] v35'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.234+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94383001252592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x7fd030014070 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.235+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94383001252592] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.235+0000 7fd041d26800 20 remove_watcher() i=0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.235+0000 7fd041d26800 2 removed watcher, disabling cache 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.235+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94383001254848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x55d7414292e0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.236+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94383001254848] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.236+0000 7fd041d26800 20 remove_watcher() i=1 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.236+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94383001263088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x55d74142dcd0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.237+0000 7fd03e15e640 1 -- 172.21.15.164:0/1100610897 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94383001263088] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd03002a070 con 0x55d74142dcd0 2024-09-14T10:55:27.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.237+0000 7fd041d26800 20 remove_watcher() i=2 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.237+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94383001265888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x7fd030014070 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.238+0000 7fd03d95d640 1 -- 172.21.15.164:0/1100610897 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94383001265888] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd038057030 con 0x7fd030014070 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.238+0000 7fd041d26800 20 remove_watcher() i=3 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.238+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94383001269504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74146e100 con 0x55d7414292e0 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.239+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94383001269504] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x55d7414292e0 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.239+0000 7fd041d26800 20 remove_watcher() i=4 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.239+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94383001260112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74147aec0 con 0x7fd03808e040 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.240+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94383001260112] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.240+0000 7fd041d26800 20 remove_watcher() i=5 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.240+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94383001271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74147aec0 con 0x7fd03808e040 2024-09-14T10:55:27.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.241+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94383001271696] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.241+0000 7fd041d26800 20 remove_watcher() i=6 2024-09-14T10:55:27.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.241+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94383001277888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d74147aec0 con 0x7fd03808e040 2024-09-14T10:55:27.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94383001277888] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd02803b040 con 0x7fd03808e040 2024-09-14T10:55:27.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 20 remove_watcher() i=7 2024-09-14T10:55:27.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd03808e040 msgr2=0x7fd0380978b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd03808e040 0x7fd0380978b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7414292e0 msgr2=0x55d74142b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7414292e0 0x55d74142b7a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd030014070 msgr2=0x7fd0300238a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd030014070 0x7fd0300238a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d74142dcd0 msgr2=0x55d7414300c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d74142dcd0 0x55d7414300c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf0803ce60 msgr2=0x7fcf0803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf0803ce60 0x7fcf0803f320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd03806ffa0 tx=0x7fd038084000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 msgr2=0x55d74141d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/1100610897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7412f45b0 0x55d74141d560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd030022ea0 tx=0x7fd030054520 comp rx=0 tx=0).stop 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 reap_dead start 2024-09-14T10:55:27.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd03d15c640 1 -- 172.21.15.164:0/1100610897 reap_dead start 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 shutdown_connections 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 >> 172.21.15.164:0/1100610897 conn(0x55d741410190 msgr2=0x55d74140e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 shutdown_connections 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/1100610897 wait complete. 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 msgr2=0x7fcf1803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 0x7fcf1803f2d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55d7413ee320 tx=0x7fd038067040 comp rx=0 tx=0).stop 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 msgr2=0x55d741407710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.242+0000 7fd041d26800 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55d7413ed220 tx=0x7fd030018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 shutdown_connections 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf1803ce10 0x7fcf1803f2d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/3459269029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d7414072f0 0x55d741407710 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 >> 172.21.15.164:0/3459269029 conn(0x55d7413fb6a0 msgr2=0x55d7413fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 shutdown_connections 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/3459269029 wait complete. 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 msgr2=0x55d7413f3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 0x55d7413f3870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 msgr2=0x55d7413f80f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 0x55d7413f80f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 msgr2=0x7fcf2403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 0x7fcf2403f2d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55d7412684d0 tx=0x7fd028001390 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 msgr2=0x55d7413ec220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd0380460d0 tx=0x7fd038002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 shutdown_connections 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55d7413f5c50 0x55d7413f80f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55d7412f7a50 0x55d7413f3870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcf2403ce10 0x7fcf2403f2d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 --2- 172.21.15.164:0/4108570004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d741267f10 0x55d7413ec220 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 >> 172.21.15.164:0/4108570004 conn(0x55d7412eefa0 msgr2=0x55d7413e5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 shutdown_connections 2024-09-14T10:55:27.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.243+0000 7fd041d26800 1 -- 172.21.15.164:0/4108570004 wait complete. 2024-09-14T10:55:27.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:55:27.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:55:27.256 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-14T10:55:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1d863800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f43243ef30 0x55f4324ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1d863800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4324d2720 con 0x55f4324cea70 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1d863800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55f4323567d0 con 0x55f43243ef30 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1b354640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f43243ef30 0x55f4324ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1ab53640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55f4324cea70 0x55f4324d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38768/0 (socket says 172.21.15.164:38768) 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1ab53640 1 -- 172.21.15.164:0/1372435425 learned_addr learned my addr 172.21.15.164:0/1372435425 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1b354640 1 -- 172.21.15.164:0/1372435425 >> v1:172.21.15.116:6789/0 conn(0x55f4324cea70 legacy=0x55f4324d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1b354640 1 -- 172.21.15.164:0/1372435425 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4324d3950 con 0x55f43243ef30 2024-09-14T10:55:27.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.312+0000 7fcc1a352640 1 -- 172.21.15.164:0/1372435425 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568843224 0 0) 0x55f4324d2720 con 0x55f4324cea70 2024-09-14T10:55:27.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.314+0000 7fcc1b354640 1 --2- 172.21.15.164:0/1372435425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4324ce530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc14005fd0 tx=0x7fcc14045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670a9664b406987d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.314+0000 7fcc1a352640 1 -- 172.21.15.164:0/1372435425 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc14058530 con 0x55f43243ef30 2024-09-14T10:55:27.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.314+0000 7fcc1a352640 1 -- 172.21.15.164:0/1372435425 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc140586d0 con 0x55f43243ef30 2024-09-14T10:55:27.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.314+0000 7fcc1a352640 1 -- 172.21.15.164:0/1372435425 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc140589d0 con 0x55f43243ef30 2024-09-14T10:55:27.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 -- 172.21.15.164:0/1372435425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 msgr2=0x55f4324ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1372435425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4324ce530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc14005fd0 tx=0x7fcc14045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:27.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 -- 172.21.15.164:0/1372435425 shutdown_connections 2024-09-14T10:55:27.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1372435425 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4324ce530 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 -- 172.21.15.164:0/1372435425 >> 172.21.15.164:0/1372435425 conn(0x55f4324c5fc0 msgr2=0x55f4324c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 -- 172.21.15.164:0/1372435425 shutdown_connections 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.315+0000 7fcc1d863800 1 -- 172.21.15.164:0/1372435425 wait complete. 2024-09-14T10:55:27.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1d863800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1d863800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f432363dd0 con 0x55f43243ef30 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1b354640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1b354640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33776/0 (socket says 172.21.15.164:33776) 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.329+0000 7fcc1b354640 1 -- 172.21.15.164:0/1976818513 learned_addr learned my addr 172.21.15.164:0/1976818513 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.330+0000 7fcc1b354640 1 -- 172.21.15.164:0/1976818513 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4325bbd10 con 0x55f43243ef30 2024-09-14T10:55:27.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.330+0000 7fcc1b354640 1 --2- 172.21.15.164:0/1976818513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcc14025a60 tx=0x7fcc14051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25530bfbc923d2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.330+0000 7fcb0960a640 1 -- 172.21.15.164:0/1976818513 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc14058a30 con 0x55f43243ef30 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.330+0000 7fcb0960a640 1 -- 172.21.15.164:0/1976818513 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc14068070 con 0x55f43243ef30 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.330+0000 7fcb0960a640 1 -- 172.21.15.164:0/1976818513 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc14058d00 con 0x55f43243ef30 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- 172.21.15.164:0/1976818513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 msgr2=0x55f4325bb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1976818513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcc14025a60 tx=0x7fcc14051000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- 172.21.15.164:0/1976818513 shutdown_connections 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1976818513 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325bb720 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- 172.21.15.164:0/1976818513 >> 172.21.15.164:0/1976818513 conn(0x55f4324c5fc0 msgr2=0x55f4325b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- 172.21.15.164:0/1976818513 shutdown_connections 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- 172.21.15.164:0/1976818513 wait complete. 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1d863800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f4324d2bf0 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1b354640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1b354640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33786/0 (socket says 172.21.15.164:33786) 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.331+0000 7fcc1b354640 1 -- 172.21.15.164:0/1890683827 learned_addr learned my addr 172.21.15.164:0/1890683827 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcc1b354640 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4325c36d0 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcc1b354640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc14005bf0 tx=0x7fcc14003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcb07e07640 1 -- 172.21.15.164:0/1890683827 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc14063710 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcb07e07640 1 -- 172.21.15.164:0/1890683827 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc140638d0 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4325c3960 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcb07e07640 1 -- 172.21.15.164:0/1890683827 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc14063bf0 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.332+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4325c4360 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcb07e07640 1 -- 172.21.15.164:0/1890683827 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcc1404f3f0 con 0x55f43243ef30 2024-09-14T10:55:27.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcb07e07640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 0x7fcb0003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcb07e07640 1 -- 172.21.15.164:0/1890683827 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcc140986d0 con 0x55f43243ef30 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 0x7fcb0003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 0x55f4325ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325c4f10 con 0x55f4324cea70 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 0x55f4325ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.333+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 0x7fcb0003f320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc04000c00 tx=0x7fcc040013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 0x55f4325ca7c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1bb55640 1 -- 172.21.15.164:0/1890683827 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4324cea70 2024-09-14T10:55:27.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325c47b0 con 0x55f4324cea70 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1bb55640 1 -- 172.21.15.164:0/1890683827 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4324cea70 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 0x55f4325cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325cf6c0 con 0x55f4325ccc30 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1b354640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 0x55f4325cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.334+0000 7fcc1b354640 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 0x55f4325cf020 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.335+0000 7fcc1b354640 1 -- 172.21.15.164:0/1890683827 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcc14094040 con 0x55f4325ccc30 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.335+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325cbad0 con 0x55f4324cea70 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.335+0000 7fcc1bb55640 1 -- 172.21.15.164:0/1890683827 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4324cea70 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.335+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325cbfc0 con 0x55f4324cea70 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.335+0000 7fcc1bb55640 1 -- 172.21.15.164:0/1890683827 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4324cea70 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1d863800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1d863800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f4323c24a0 con 0x55f4325de0f0 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33802/0 (socket says 172.21.15.164:33802) 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2008313041 learned_addr learned my addr 172.21.15.164:0/2008313041 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.336+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2008313041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4325deb50 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55f4325c4760 tx=0x7fcc0c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcb05602640 1 -- 172.21.15.164:0/2008313041 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c007dc0 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcb05602640 1 -- 172.21.15.164:0/2008313041 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c01e020 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcb05602640 1 -- 172.21.15.164:0/2008313041 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c019570 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4325df380 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.337+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4325df920 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcb05602640 1 -- 172.21.15.164:0/2008313041 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcc0c016040 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcb05602640 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 0x7fcaf403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcb05602640 1 -- 172.21.15.164:0/2008313041 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcc0c01f030 con 0x55f4325de0f0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 0x7fcaf403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 0x7fcaf403f2d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f4325cad60 tx=0x7fcc14082040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1d863800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.338+0000 7fcc1d863800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f4325bc080 con 0x55f4325eac30 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33808/0 (socket says 172.21.15.164:33808) 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2317590434 learned_addr learned my addr 172.21.15.164:0/2317590434 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2317590434 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4325eb600 con 0x55f4325eac30 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2317590434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c014d90 tx=0x7fcc0c014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb603382642d789d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcafeffd640 1 -- 172.21.15.164:0/2317590434 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c051020 con 0x55f4325eac30 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcafeffd640 1 -- 172.21.15.164:0/2317590434 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c045260 con 0x55f4325eac30 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcafeffd640 1 -- 172.21.15.164:0/2317590434 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c01d070 con 0x55f4325eac30 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1d863800 1 -- 172.21.15.164:0/2317590434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 msgr2=0x55f4325eb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2317590434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c014d90 tx=0x7fcc0c014d00 comp rx=0 tx=0).stop 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.339+0000 7fcc1d863800 1 -- 172.21.15.164:0/2317590434 shutdown_connections 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2317590434 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325eb010 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 -- 172.21.15.164:0/2317590434 >> 172.21.15.164:0/2317590434 conn(0x55f4325e7030 msgr2=0x55f4325e5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 -- 172.21.15.164:0/2317590434 shutdown_connections 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 -- 172.21.15.164:0/2317590434 wait complete. 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 Processor -- start 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 -- start start 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1d863800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f4325ebc40 con 0x55f4325eac30 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1bb55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33818/0 (socket says 172.21.15.164:33818) 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 learned_addr learned my addr 172.21.15.164:0/2636308146 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.340+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4325f26f0 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325f2190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c014d90 tx=0x7fcc0c0543f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcafd7fa640 1 -- 172.21.15.164:0/2636308146 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c030020 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcafd7fa640 1 -- 172.21.15.164:0/2636308146 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc0c045410 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4325f2980 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcafd7fa640 1 -- 172.21.15.164:0/2636308146 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc0c019a50 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4325f2980 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.341+0000 7fcafd7fa640 1 -- 172.21.15.164:0/2636308146 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcc0c033020 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcafd7fa640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce60 0x7fcae403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcafd7fa640 1 -- 172.21.15.164:0/2636308146 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcc0c03ebd0 con 0x55f4325eac30 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce60 0x7fcae403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce60 0x7fcae403f320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f4325cb1b0 tx=0x7fcc14084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4325fdc00 0x55f4326000c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.342+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432600810 con 0x55f4325fdc00 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4325fdc00 0x55f4326000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4325fdc00 0x55f4326000c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc0400f5f0 con 0x55f4325fdc00 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 realm 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4325fcf50 con 0x55f4325fdc00 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc0400f5f0 con 0x55f4325fdc00 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432601300 con 0x55f4325fdc00 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc0400f5f0 con 0x55f4325fdc00 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.343+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432601bd0 con 0x55f4325fdc00 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcc0400f5f0 con 0x55f4325fdc00 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4326025f0 0x55f4326049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432605150 con 0x55f4326025f0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4326025f0 0x55f4326049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4326025f0 0x55f4326049e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4326025f0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 20 searching for the correct realm 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.344+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4326025f0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1bb55640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcc0c035020 0x7fcc0c045970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcc0c035020 0x7fcc0c045970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcc0c035020 0x7fcc0c045970 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1b354640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcc14096c20 0x7fcc14095270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.345+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcc14096c20 0x7fcc14095270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcc14096c20 0x7fcc14095270 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0400f5f0 con 0x7fcc14096c20 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0400f5f0 con 0x55f4325fdc00 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.346+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4326025f0 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.347+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x7fcc14096c20 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.348+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c0083e0 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x7fcc14096c20 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.349+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x7fcc14096c20 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.350+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0402b040 con 0x55f4325fdc00 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.351+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4326025f0 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc14096c20 2024-09-14T10:55:27.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.352+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x55f4325fdc00 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f432606a70 con 0x7fcc0c035020 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432605a10 con 0x55f4325fdc00 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432605e00 con 0x55f4325fdc00 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.353+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432606ef0 con 0x55f4325fdc00 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 zone default found 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 4 Realm: () 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 zonegroup default 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432606ef0 con 0x7fcc14096c20 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432608d90 con 0x55f4326025f0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432609130 con 0x55f4326025f0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 started sync module instance, tier type = 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.354+0000 7fcc1d863800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.355+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f4326081d0 con 0x7fcc0c035020 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.355+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.355+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94507305565472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432609590 con 0x7fcc0c035020 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.356+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432609de0 con 0x55f4325fdc00 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.356+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94507305565472] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.357+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.357+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94507305567728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432609ec0 con 0x55f4325fdc00 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.357+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260a990 con 0x55f4326025f0 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.358+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94507305567728] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.358+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.358+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94507305575552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260a950 con 0x55f4326025f0 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.358+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260b420 con 0x7fcc0c035020 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.359+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94507305575552] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.359+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.359+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94507305572656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260b810 con 0x7fcc0c035020 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.359+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260c260 con 0x55f4325fdc00 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.360+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.360+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94507305581904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260cb30 con 0x55f4325fdc00 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.360+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260d5e0 con 0x7fcc14096c20 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.361+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94507305572656] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.361+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94507305581904] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.363+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.363+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94507305578272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260c630 con 0x7fcc14096c20 2024-09-14T10:55:27.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.363+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260deb0 con 0x7fcc14096c20 2024-09-14T10:55:27.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.364+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94507305578272] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.364+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.364+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94507305586928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260c630 con 0x7fcc14096c20 2024-09-14T10:55:27.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.364+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260e450 con 0x7fcc14096c20 2024-09-14T10:55:27.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94507305586928] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94507305588880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260e410 con 0x7fcc14096c20 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=0 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=1 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=2 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=3 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=4 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=5 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.365+0000 7fcc1d863800 20 add_watcher() i=6 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94507305588880] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1d863800 20 add_watcher() i=7 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1d863800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4326118a0 con 0x55f4325fdc00 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.366+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94507305591088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f43260edf0 con 0x55f4325fdc00 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.367+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94507305591088] v35'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.367+0000 7fcad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 5 note: GC not initialized 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcad0fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 20 Filter name: none 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fca4a7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:27.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.368+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432644c10 con 0x7fcc14096c20 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f4326432b0 con 0x7fcc14096c20 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:55:27.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.369+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432643b80 con 0x7fcc14096c20 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1d863800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1d863800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1d863800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94507305809616 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432648550 con 0x7fcc14096c20 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify (1) cookie 94507305578272 notify 150323855363 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f432643f20 con 0x7fcc14096c20 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(65 notify.5 [notify cookie 94507305809616 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcafeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94507305578272 notifier 4500 bl.length()=556 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcafeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:55:27.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcafeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.370+0000 7fcafeffd640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fcae0003ea0 con 0x7fcc14096c20 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.371+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.371+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== watch-notify(notify_complete (2) cookie 94507305809616 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f432644560 con 0x7fcc14096c20 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.371+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432646080 con 0x7fcc14096c20 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1d863800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1d863800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1d863800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94507305809456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f432648550 con 0x55f4326025f0 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94507305575552 notify 150323855368 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f4325f26f0 con 0x55f4326025f0 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 notify.2 [notify cookie 94507305809456 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcafeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94507305575552 notifier 4500 bl.length()=177 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcafeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcafeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.372+0000 7fcafeffd640 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fcae0003ea0 con 0x55f4326025f0 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.373+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== watch-notify(notify_complete (2) cookie 94507305809456 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcc0c04c040 con 0x55f4326025f0 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.373+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.382 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:55:27.370245Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:27.370235Z","tags":[],"group_ids":[]} 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.373+0000 7fcad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.373+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94507305591088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x55f4325fdc00 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.374+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94507305591088] v35'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.374+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94507305565472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x7fcc0c035020 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.375+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94507305565472] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.375+0000 7fcc1d863800 20 remove_watcher() i=0 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.375+0000 7fcc1d863800 2 removed watcher, disabling cache 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.375+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94507305567728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x55f4325fdc00 2024-09-14T10:55:27.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.376+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94507305567728] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.376+0000 7fcc1d863800 20 remove_watcher() i=1 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.376+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94507305575552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x55f4326025f0 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.377+0000 7fcc1bb55640 1 -- 172.21.15.164:0/2636308146 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94507305575552] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0c064040 con 0x55f4326025f0 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.377+0000 7fcc1d863800 20 remove_watcher() i=2 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.377+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94507305572656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x7fcc0c035020 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.378+0000 7fcc1b354640 1 -- 172.21.15.164:0/2636308146 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94507305572656] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc1409f040 con 0x7fcc0c035020 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.378+0000 7fcc1d863800 20 remove_watcher() i=3 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.378+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94507305581904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x55f4325fdc00 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.379+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94507305581904] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x55f4325fdc00 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.379+0000 7fcc1d863800 20 remove_watcher() i=4 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.379+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94507305578272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x7fcc14096c20 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.380+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94507305578272] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.381+0000 7fcc1d863800 20 remove_watcher() i=5 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.381+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94507305586928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x7fcc14096c20 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.381+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94507305586928] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.381+0000 7fcc1d863800 20 remove_watcher() i=6 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.381+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94507305588880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f432642970 con 0x7fcc14096c20 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94507305588880] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcc0403b040 con 0x7fcc14096c20 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 20 remove_watcher() i=7 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcc14096c20 msgr2=0x7fcc14095270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcc14096c20 0x7fcc14095270 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4325fdc00 msgr2=0x55f4326000c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4325fdc00 0x55f4326000c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcc0c035020 msgr2=0x7fcc0c045970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcc0c035020 0x7fcc0c045970 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4326025f0 msgr2=0x55f4326049e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4326025f0 0x55f4326049e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce60 msgr2=0x7fcae403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcae403ce60 0x7fcae403f320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55f4325cb1b0 tx=0x7fcc14084000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 msgr2=0x55f4325f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2636308146 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325eac30 0x55f4325f2190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c014d90 tx=0x7fcc0c0543f0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 reap_dead start 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1ab53640 1 -- 172.21.15.164:0/2636308146 reap_dead start 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 shutdown_connections 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 >> 172.21.15.164:0/2636308146 conn(0x55f4325e7030 msgr2=0x55f4325e5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 shutdown_connections 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2636308146 wait complete. 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 msgr2=0x7fcaf403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 0x7fcaf403f2d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55f4325cad60 tx=0x7fcc14082040 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 msgr2=0x55f4325de510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55f4325c4760 tx=0x7fcc0c00af40 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 shutdown_connections 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaf403ce10 0x7fcaf403f2d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 --2- 172.21.15.164:0/2008313041 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f4325de0f0 0x55f4325de510 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.383+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 >> 172.21.15.164:0/2008313041 conn(0x55f4325d24a0 msgr2=0x55f4325d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 shutdown_connections 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/2008313041 wait complete. 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 msgr2=0x55f4325ca7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 0x55f4325ca7c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 msgr2=0x55f4325cf020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 0x55f4325cf020 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 msgr2=0x7fcb0003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 0x7fcb0003f320 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcc04000c00 tx=0x7fcc040013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 msgr2=0x55f4325c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcc14005bf0 tx=0x7fcc14003330 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 shutdown_connections 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f4325ccc30 0x55f4325cf020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f4324cea70 0x55f4325ca7c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcb0003ce60 0x7fcb0003f320 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 --2- 172.21.15.164:0/1890683827 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f43243ef30 0x55f4325c3170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 >> 172.21.15.164:0/1890683827 conn(0x55f4324c5fc0 msgr2=0x55f4325bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 shutdown_connections 2024-09-14T10:55:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.384+0000 7fcc1d863800 1 -- 172.21.15.164:0/1890683827 wait complete. 2024-09-14T10:55:27.393 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:55:27.370245Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:27.370235Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:27.399 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:55:27.403 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:27.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-14T10:55:27.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-14T10:55:27.403 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-14T10:55:27.447 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.447 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c9532e800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a9f436fed0 0x55a9f4401890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c9532e800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9f44058e0 con 0x55a9f4401dd0 2024-09-14T10:55:27.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c9532e800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55a9f42877d0 con 0x55a9f436fed0 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c910dd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a9f436fed0 0x55a9f4401890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c908dc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55a9f4401dd0 0x55a9f44041c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38772/0 (socket says 172.21.15.164:38772) 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c910dd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a9f436fed0 0x55a9f4401890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33830/0 (socket says 172.21.15.164:33830) 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.450+0000 7f3c908dc640 1 -- 172.21.15.164:0/3944191360 learned_addr learned my addr 172.21.15.164:0/3944191360 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.451+0000 7f3c910dd640 1 -- 172.21.15.164:0/3944191360 >> v1:172.21.15.116:6789/0 conn(0x55a9f4401dd0 legacy=0x55a9f44041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.451+0000 7f3c910dd640 1 -- 172.21.15.164:0/3944191360 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f4406b10 con 0x55a9f436fed0 2024-09-14T10:55:27.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.452+0000 7f3c910dd640 1 --2- 172.21.15.164:0/3944191360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f4401890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00a470 tx=0x7f3c8c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bd63d6f2d9af5a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.452+0000 7f3c8bfff640 1 -- 172.21.15.164:0/3944191360 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c053570 con 0x55a9f436fed0 2024-09-14T10:55:27.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.452+0000 7f3c8bfff640 1 -- 172.21.15.164:0/3944191360 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8c058070 con 0x55a9f436fed0 2024-09-14T10:55:27.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.452+0000 7f3c8bfff640 1 -- 172.21.15.164:0/3944191360 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c053880 con 0x55a9f436fed0 2024-09-14T10:55:27.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 -- 172.21.15.164:0/3944191360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 msgr2=0x55a9f4401890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 --2- 172.21.15.164:0/3944191360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f4401890 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00a470 tx=0x7f3c8c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:27.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 -- 172.21.15.164:0/3944191360 shutdown_connections 2024-09-14T10:55:27.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 --2- 172.21.15.164:0/3944191360 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f4401890 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 -- 172.21.15.164:0/3944191360 >> 172.21.15.164:0/3944191360 conn(0x55a9f43f6f80 msgr2=0x55a9f43f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 -- 172.21.15.164:0/3944191360 shutdown_connections 2024-09-14T10:55:27.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.453+0000 7f3c9532e800 1 -- 172.21.15.164:0/3944191360 wait complete. 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c9532e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c9532e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a9f4294dd0 con 0x55a9f436fed0 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c910dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c910dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33834/0 (socket says 172.21.15.164:33834) 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c910dd640 1 -- 172.21.15.164:0/2324498653 learned_addr learned my addr 172.21.15.164:0/2324498653 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.468+0000 7f3c910dd640 1 -- 172.21.15.164:0/2324498653 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f44eeff0 con 0x55a9f436fed0 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2324498653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c025c20 tx=0x7f3c8c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf95ffe6637bab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3b7f606640 1 -- 172.21.15.164:0/2324498653 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c053a20 con 0x55a9f436fed0 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3b7f606640 1 -- 172.21.15.164:0/2324498653 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8c063070 con 0x55a9f436fed0 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3b7f606640 1 -- 172.21.15.164:0/2324498653 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c053cf0 con 0x55a9f436fed0 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 -- 172.21.15.164:0/2324498653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 msgr2=0x55a9f44eea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2324498653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c025c20 tx=0x7f3c8c051000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 -- 172.21.15.164:0/2324498653 shutdown_connections 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2324498653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44eea00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 -- 172.21.15.164:0/2324498653 >> 172.21.15.164:0/2324498653 conn(0x55a9f43f6f80 msgr2=0x55a9f44ea380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.469+0000 7f3c9532e800 1 -- 172.21.15.164:0/2324498653 shutdown_connections 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c9532e800 1 -- 172.21.15.164:0/2324498653 wait complete. 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c9532e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c9532e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a9f4405db0 con 0x55a9f436fed0 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c910dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c910dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33838/0 (socket says 172.21.15.164:33838) 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c910dd640 1 -- 172.21.15.164:0/2953154607 learned_addr learned my addr 172.21.15.164:0/2953154607 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.470+0000 7f3c910dd640 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f44f6a00 con 0x55a9f436fed0 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c025c20 tx=0x7f3c8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3b7de03640 1 -- 172.21.15.164:0/2953154607 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c068660 con 0x55a9f436fed0 2024-09-14T10:55:27.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3b7de03640 1 -- 172.21.15.164:0/2953154607 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8c068800 con 0x55a9f436fed0 2024-09-14T10:55:27.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9f44f6c90 con 0x55a9f436fed0 2024-09-14T10:55:27.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3b7de03640 1 -- 172.21.15.164:0/2953154607 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8c068ae0 con 0x55a9f436fed0 2024-09-14T10:55:27.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.471+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f44f78a0 con 0x55a9f436fed0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3b7de03640 1 -- 172.21.15.164:0/2953154607 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c8c068c80 con 0x55a9f436fed0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3b7de03640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 0x7f3b7803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3b7de03640 1 -- 172.21.15.164:0/2953154607 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c8c098b50 con 0x55a9f436fed0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 0x7f3b7803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 0x55a9f44fdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f44fe030 con 0x55a9f4401dd0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3c918de640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 0x55a9f44fdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.472+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 0x7f3b7803f2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001d70 tx=0x7f3c7c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c918de640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 0x55a9f44fdaf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c918de640 1 -- 172.21.15.164:0/2953154607 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c8400a4d0 con 0x55a9f4401dd0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f44fe3d0 con 0x55a9f4401dd0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c918de640 1 -- 172.21.15.164:0/2953154607 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c8400a4d0 con 0x55a9f4401dd0 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 0x55a9f4502330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4502ac0 con 0x55a9f44ffe90 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 0x55a9f4502330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.473+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 0x55a9f4502330 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.474+0000 7f3c910dd640 1 -- 172.21.15.164:0/2953154607 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c8c051070 con 0x55a9f44ffe90 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.474+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f44fec20 con 0x55a9f4401dd0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.474+0000 7f3c918de640 1 -- 172.21.15.164:0/2953154607 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c8400a4d0 con 0x55a9f4401dd0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.474+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f44ff000 con 0x55a9f4401dd0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.474+0000 7f3c918de640 1 -- 172.21.15.164:0/2953154607 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c8400a4d0 con 0x55a9f4401dd0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c9532e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c9532e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a9f42f34a0 con 0x55a9f45114d0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33844/0 (socket says 172.21.15.164:33844) 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.475+0000 7f3c918de640 1 -- 172.21.15.164:0/53138355 learned_addr learned my addr 172.21.15.164:0/53138355 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3c918de640 1 -- 172.21.15.164:0/53138355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f4511f30 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3c918de640 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55a9f44f74a0 tx=0x7f3c84018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3b76ffd640 1 -- 172.21.15.164:0/53138355 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84014450 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3b76ffd640 1 -- 172.21.15.164:0/53138355 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c84014610 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3b76ffd640 1 -- 172.21.15.164:0/53138355 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c84014930 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9f4512760 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.476+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f4512d00 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3b76ffd640 1 -- 172.21.15.164:0/53138355 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c84011040 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3b76ffd640 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 0x7f3b6803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3b76ffd640 1 -- 172.21.15.164:0/53138355 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c8401e070 con 0x55a9f45114d0 2024-09-14T10:55:27.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c910dd640 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 0x7f3b6803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c910dd640 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 0x7f3b6803f2d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55a9f44f8570 tx=0x7f3c8c05d660 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c9532e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.477+0000 7f3c9532e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a9f44ef3c0 con 0x55a9f451df70 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33858/0 (socket says 172.21.15.164:33858) 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3c918de640 1 -- 172.21.15.164:0/3000837194 learned_addr learned my addr 172.21.15.164:0/3000837194 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3c918de640 1 -- 172.21.15.164:0/3000837194 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f451e960 con 0x55a9f451df70 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3c918de640 1 --2- 172.21.15.164:0/3000837194 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c8402b400 tx=0x7f3c84011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b903792a422628c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3b74ff9640 1 -- 172.21.15.164:0/3000837194 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8404b070 con 0x55a9f451df70 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3b74ff9640 1 -- 172.21.15.164:0/3000837194 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c84051070 con 0x55a9f451df70 2024-09-14T10:55:27.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.478+0000 7f3b74ff9640 1 -- 172.21.15.164:0/3000837194 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c840167c0 con 0x55a9f451df70 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- 172.21.15.164:0/3000837194 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 msgr2=0x55a9f451e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 --2- 172.21.15.164:0/3000837194 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c8402b400 tx=0x7f3c84011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- 172.21.15.164:0/3000837194 shutdown_connections 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 --2- 172.21.15.164:0/3000837194 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f451e370 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- 172.21.15.164:0/3000837194 >> 172.21.15.164:0/3000837194 conn(0x55a9f451a370 msgr2=0x55a9f45185b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- 172.21.15.164:0/3000837194 shutdown_connections 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- 172.21.15.164:0/3000837194 wait complete. 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 Processor -- start 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- start start 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c9532e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a9f451ef80 con 0x55a9f451df70 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c918de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33866/0 (socket says 172.21.15.164:33866) 2024-09-14T10:55:27.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.479+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 learned_addr learned my addr 172.21.15.164:0/2681637829 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f4525b60 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3c918de640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c84054500 tx=0x7f3c84054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3b66ffd640 1 -- 172.21.15.164:0/2681637829 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c8404b030 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3b66ffd640 1 -- 172.21.15.164:0/2681637829 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c84031070 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3b66ffd640 1 -- 172.21.15.164:0/2681637829 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c840167c0 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9f4525df0 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.480+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f4526980 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3b66ffd640 1 -- 172.21.15.164:0/2681637829 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c84014ad0 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3b66ffd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b5c03ce60 0x7f3b5c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3b66ffd640 1 -- 172.21.15.164:0/2681637829 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c8404c070 con 0x55a9f451df70 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b5c03ce60 0x7f3b5c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f45312b0 0x55a9f4533770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4533ec0 con 0x55a9f45312b0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f45312b0 0x55a9f4533770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.481+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b5c03ce60 0x7f3b5c03f320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c05d6f0 tx=0x7f3c8c082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f45312b0 0x55a9f4533770 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7c009050 con 0x55a9f45312b0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 realm 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4530650 con 0x55a9f45312b0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7c009050 con 0x55a9f45312b0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f45349a0 con 0x55a9f45312b0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7c009050 con 0x55a9f45312b0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.482+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4535270 con 0x55a9f45312b0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c7c009050 con 0x55a9f45312b0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f4535bb0 0x55a9f4537fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f45386e0 con 0x55a9f4535bb0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c918de640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f4535bb0 0x55a9f4537fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c918de640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f4535bb0 0x55a9f4537fa0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 20 searching for the correct realm 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.483+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c918de640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c84059040 0x7f3c8402f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c84059040 0x7f3c8402f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c84059040 0x7f3c8402f990 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c910dd640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c8c05f040 0x7f3c8c07d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.484+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c8c05f040 0x7f3c8c07d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c8c05f040 0x7f3c8c07d760 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c009050 con 0x7f3c8c05f040 2024-09-14T10:55:27.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c009050 con 0x55a9f45312b0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.485+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.486+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.487+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.488+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.489+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.490+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.491+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c8c05f040 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x55a9f45312b0 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453a070 con 0x7f3c84059040 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4539160 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.492+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4538da0 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4539a80 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 zone default found 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 4 Realm: () 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 zonegroup default 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f45395e0 con 0x7f3c8c05f040 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453c3f0 con 0x55a9f4535bb0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.493+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453ca00 con 0x55a9f4535bb0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 20 started sync module instance, tier type = 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.494+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453b800 con 0x7f3c84059040 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.495+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.495+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94188436960080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453ce60 con 0x7f3c84059040 2024-09-14T10:55:27.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.495+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453d6b0 con 0x55a9f45312b0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.496+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94188436960080] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.496+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.496+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94188436962336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453d770 con 0x55a9f45312b0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.496+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453e270 con 0x55a9f4535bb0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.497+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94188436962336] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.497+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.497+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94188436970848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453e230 con 0x55a9f4535bb0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.497+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453ed20 con 0x7f3c84059040 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.498+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94188436970848] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.498+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.498+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94188436967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453f110 con 0x7f3c84059040 2024-09-14T10:55:27.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.498+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453fb80 con 0x55a9f45312b0 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.499+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.499+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94188436977232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f453fb40 con 0x55a9f45312b0 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.499+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4540b60 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.499+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94188436967936] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.500+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94188436977232] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.500+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.500+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94188436981360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4540b60 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.500+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4540fd0 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.501+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94188436981360] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.501+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.501+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94188436973568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4540f90 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.501+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4541d20 con 0x7f3c8c05f040 2024-09-14T10:55:27.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94188436973568] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94188436983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4541860 con 0x7f3c8c05f040 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=0 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=1 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=2 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=3 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=4 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=5 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.502+0000 7f3c9532e800 20 add_watcher() i=6 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.503+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94188436983696] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.503+0000 7f3c9532e800 20 add_watcher() i=7 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.503+0000 7f3c9532e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.503+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4544da0 con 0x55a9f45312b0 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.503+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.504+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94188436985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f45422f0 con 0x55a9f45312b0 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94188436985216] v35'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3b477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 5 note: GC not initialized 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3b467e4640 20 reqs_thread_entry: start 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 20 Filter name: none 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3ab7fff640 20 reqs_thread_entry: start 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.505+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4577b10 con 0x7f3c84059040 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.506+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.506+0000 7f3c9532e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.507+0000 7f3b477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.507+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94188436985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x55a9f45312b0 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.508+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94188436985216] v35'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.508+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94188436960080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x7f3c84059040 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.508+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94188436960080] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.508+0000 7f3c9532e800 20 remove_watcher() i=0 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.509+0000 7f3c9532e800 2 removed watcher, disabling cache 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.509+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94188436962336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x55a9f45312b0 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94188436962336] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c9532e800 20 remove_watcher() i=1 2024-09-14T10:55:27.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94188436970848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x55a9f4535bb0 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c918de640 1 -- 172.21.15.164:0/2681637829 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94188436970848] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8402a070 con 0x55a9f4535bb0 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c9532e800 20 remove_watcher() i=2 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.510+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94188436967936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x7f3c84059040 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.511+0000 7f3c910dd640 1 -- 172.21.15.164:0/2681637829 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94188436967936] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c8c051070 con 0x7f3c84059040 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.511+0000 7f3c9532e800 20 remove_watcher() i=3 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.511+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94188436977232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x55a9f45312b0 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.512+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94188436977232] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x55a9f45312b0 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.512+0000 7f3c9532e800 20 remove_watcher() i=4 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.512+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94188436981360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x7f3c8c05f040 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.513+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94188436981360] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.513+0000 7f3c9532e800 20 remove_watcher() i=5 2024-09-14T10:55:27.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.513+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94188436973568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x7f3c8c05f040 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.514+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94188436973568] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.514+0000 7f3c9532e800 20 remove_watcher() i=6 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.514+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94188436983696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9f4575a10 con 0x7f3c8c05f040 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94188436983696] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c7c029040 con 0x7f3c8c05f040 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 20 remove_watcher() i=7 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c8c05f040 msgr2=0x7f3c8c07d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c8c05f040 0x7f3c8c07d760 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f45312b0 msgr2=0x55a9f4533770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f45312b0 0x55a9f4533770 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c84059040 msgr2=0x7f3c8402f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c84059040 0x7f3c8402f990 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f4535bb0 msgr2=0x55a9f4537fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f4535bb0 0x55a9f4537fa0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b5c03ce60 msgr2=0x7f3b5c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b5c03ce60 0x7f3b5c03f320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c05d6f0 tx=0x7f3c8c082000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c908dc640 1 -- 172.21.15.164:0/2681637829 reap_dead start 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 msgr2=0x55a9f4525600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.515+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c84054500 tx=0x7f3c84054530 comp rx=0 tx=0).stop 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 shutdown_connections 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2681637829 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f451df70 0x55a9f4525600 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 >> 172.21.15.164:0/2681637829 conn(0x55a9f451a370 msgr2=0x55a9f4518580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 shutdown_connections 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2681637829 wait complete. 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 msgr2=0x7f3b6803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 0x7f3b6803f2d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55a9f44f8570 tx=0x7f3c8c05d660 comp rx=0 tx=0).stop 2024-09-14T10:55:27.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 msgr2=0x55a9f45118f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55a9f44f74a0 tx=0x7f3c84018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 shutdown_connections 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b6803ce10 0x7f3b6803f2d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/53138355 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f45114d0 0x55a9f45118f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 >> 172.21.15.164:0/53138355 conn(0x55a9f4505880 msgr2=0x55a9f4505c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 shutdown_connections 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/53138355 wait complete. 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 msgr2=0x55a9f44fdaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 0x55a9f44fdaf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 msgr2=0x55a9f4502330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 0x55a9f4502330 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 msgr2=0x7f3b7803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 0x7f3b7803f2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c001d70 tx=0x7f3c7c0012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 msgr2=0x55a9f44f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.516+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c025c20 tx=0x7f3c8c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 shutdown_connections 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a9f44ffe90 0x55a9f4502330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a9f4401dd0 0x55a9f44fdaf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b7803ce10 0x7f3b7803f2d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 --2- 172.21.15.164:0/2953154607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a9f436fed0 0x55a9f44f64a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 >> 172.21.15.164:0/2953154607 conn(0x55a9f43f6f80 msgr2=0x55a9f44e8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 shutdown_connections 2024-09-14T10:55:27.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.517+0000 7f3c9532e800 1 -- 172.21.15.164:0/2953154607 wait complete. 2024-09-14T10:55:27.526 INFO:teuthology.orchestra.run.smithi164.stdout:{"key":"bucket:myfoo","ver":{"tag":"_ppxEJrzok9KIHKCiy-cc8Wd","ver":2},"mtime":"2024-09-14T10:55:27.231606Z","data":{"bucket":{"name":"myfoo","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","bucket_id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-14T10:55:26.137796Z","linked":false,"has_bucket_info":false}} 2024-09-14T10:55:27.526 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_ppxEJrzok9KIHKCiy-cc8Wd', 'ver': 2}, 'mtime': '2024-09-14T10:55:27.231606Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'bucket_id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-14T10:55:26.137796Z', 'linked': False, 'has_bucket_info': False}} 2024-09-14T10:55:27.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '4d2cef0f-8511-4251-8070-7385f93096af.4241.1'] 2024-09-14T10:55:27.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '4d2cef0f-8511-4251-8070-7385f93096af.4241.1'] 2024-09-14T10:55:27.527 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:27.576 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.576 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532ba40800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55758a4d6d50 0x55758a4d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532ba40800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55758a4d9710 con 0x55758a4d0cb0 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532ba40800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55758a35d7d0 con 0x55758a4d6d50 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f5328d29640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55758a4d6d50 0x55758a4d9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532952a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55758a4d0cb0 0x55758a4d10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38780/0 (socket says 172.21.15.164:38780) 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f5328d29640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55758a4d6d50 0x55758a4d9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33874/0 (socket says 172.21.15.164:33874) 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.579+0000 7f532952a640 1 -- 172.21.15.164:0/1262713364 learned_addr learned my addr 172.21.15.164:0/1262713364 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.580+0000 7f5328d29640 1 -- 172.21.15.164:0/1262713364 >> v1:172.21.15.116:6789/0 conn(0x55758a4d0cb0 legacy=0x55758a4d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.580+0000 7f5328d29640 1 -- 172.21.15.164:0/1262713364 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a4da920 con 0x55758a4d6d50 2024-09-14T10:55:27.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.580+0000 7f5323fff640 1 -- 172.21.15.164:0/1262713364 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126803560 0 0) 0x55758a4d9710 con 0x55758a4d0cb0 2024-09-14T10:55:27.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.581+0000 7f5328d29640 1 --2- 172.21.15.164:0/1262713364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d6d50 0x55758a4d9140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f531400a470 tx=0x7f5314045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2228e331cc14a725 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.581+0000 7f5323fff640 1 -- 172.21.15.164:0/1262713364 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5314053570 con 0x55758a4d6d50 2024-09-14T10:55:27.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.581+0000 7f5323fff640 1 -- 172.21.15.164:0/1262713364 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5314058070 con 0x55758a4d6d50 2024-09-14T10:55:27.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f5323fff640 1 -- 172.21.15.164:0/1262713364 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5314053880 con 0x55758a4d6d50 2024-09-14T10:55:27.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 -- 172.21.15.164:0/1262713364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d6d50 msgr2=0x55758a4d9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 --2- 172.21.15.164:0/1262713364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d6d50 0x55758a4d9140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f531400a470 tx=0x7f5314045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:27.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 -- 172.21.15.164:0/1262713364 shutdown_connections 2024-09-14T10:55:27.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 --2- 172.21.15.164:0/1262713364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d6d50 0x55758a4d9140 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 -- 172.21.15.164:0/1262713364 >> 172.21.15.164:0/1262713364 conn(0x55758a4cc700 msgr2=0x55758a4ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 -- 172.21.15.164:0/1262713364 shutdown_connections 2024-09-14T10:55:27.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.582+0000 7f532ba40800 1 -- 172.21.15.164:0/1262713364 wait complete. 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532ba40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532ba40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55758a36add0 con 0x55758a4d0cb0 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532952a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532952a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33880/0 (socket says 172.21.15.164:33880) 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.596+0000 7f532952a640 1 -- 172.21.15.164:0/4152236357 learned_addr learned my addr 172.21.15.164:0/4152236357 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.597+0000 7f532952a640 1 -- 172.21.15.164:0/4152236357 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a4d3ab0 con 0x55758a4d0cb0 2024-09-14T10:55:27.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.597+0000 7f532952a640 1 --2- 172.21.15.164:0/4152236357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ea0 tx=0x7f532400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cb07bea9a96bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.597+0000 7f5217606640 1 -- 172.21.15.164:0/4152236357 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5324008070 con 0x55758a4d0cb0 2024-09-14T10:55:27.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.597+0000 7f5217606640 1 -- 172.21.15.164:0/4152236357 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532400d500 con 0x55758a4d0cb0 2024-09-14T10:55:27.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.597+0000 7f5217606640 1 -- 172.21.15.164:0/4152236357 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532400d880 con 0x55758a4d0cb0 2024-09-14T10:55:27.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- 172.21.15.164:0/4152236357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 msgr2=0x55758a4d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 --2- 172.21.15.164:0/4152236357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ea0 tx=0x7f532400b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- 172.21.15.164:0/4152236357 shutdown_connections 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 --2- 172.21.15.164:0/4152236357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a4d34c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- 172.21.15.164:0/4152236357 >> 172.21.15.164:0/4152236357 conn(0x55758a4cc700 msgr2=0x55758a5be090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- 172.21.15.164:0/4152236357 shutdown_connections 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- 172.21.15.164:0/4152236357 wait complete. 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532ba40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55758a4d9be0 con 0x55758a4d0cb0 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532952a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532952a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33884/0 (socket says 172.21.15.164:33884) 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.598+0000 7f532952a640 1 -- 172.21.15.164:0/2874395531 learned_addr learned my addr 172.21.15.164:0/2874395531 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f532952a640 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a5cc930 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f532952a640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53240012f0 tx=0x7f5324000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f5215e03640 1 -- 172.21.15.164:0/2874395531 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532400f9d0 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f5215e03640 1 -- 172.21.15.164:0/2874395531 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532400fb70 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55758a5ccbc0 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f5215e03640 1 -- 172.21.15.164:0/2874395531 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532400fe50 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.599+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55758a5cd5c0 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.600+0000 7f5215e03640 1 -- 172.21.15.164:0/2874395531 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5324017040 con 0x55758a4d0cb0 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.600+0000 7f5215e03640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 0x7f521003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.600+0000 7f5215e03640 1 -- 172.21.15.164:0/2874395531 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f5324015020 con 0x55758a4d0cb0 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.600+0000 7f5328d29640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 0x7f521003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 0x55758a5d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a5d3f60 con 0x55758a4d6d50 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f5329d2b640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 0x55758a5d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f5328d29640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 0x7f521003f470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5314057000 tx=0x7f5314052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f5329d2b640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 0x55758a5d3a20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f5329d2b640 1 -- 172.21.15.164:0/2874395531 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f531c00a4d0 con 0x55758a4d6d50 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.601+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a5d4300 con 0x55758a4d6d50 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f5329d2b640 1 -- 172.21.15.164:0/2874395531 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f531c00a4d0 con 0x55758a4d6d50 2024-09-14T10:55:27.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 0x55758a5d8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a5d8a10 con 0x55758a5d5e00 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532952a640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 0x55758a5d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532952a640 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 0x55758a5d8280 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532952a640 1 -- 172.21.15.164:0/2874395531 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f532402d070 con 0x55758a5d5e00 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.602+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a5d4b50 con 0x55758a4d6d50 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f5329d2b640 1 -- 172.21.15.164:0/2874395531 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f531c00a4d0 con 0x55758a4d6d50 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a5d4fa0 con 0x55758a4d6d50 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f5329d2b640 1 -- 172.21.15.164:0/2874395531 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f531c00a4d0 con 0x55758a4d6d50 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f532ba40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.603+0000 7f532ba40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55758a3c94a0 con 0x55758a5e73f0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33886/0 (socket says 172.21.15.164:33886) 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f5329d2b640 1 -- 172.21.15.164:0/2780556106 learned_addr learned my addr 172.21.15.164:0/2780556106 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f5329d2b640 1 -- 172.21.15.164:0/2780556106 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a5e7e50 con 0x55758a5e73f0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f5329d2b640 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f531c00a2a0 tx=0x7f531c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f520effd640 1 -- 172.21.15.164:0/2780556106 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c014450 con 0x55758a5e73f0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f520effd640 1 -- 172.21.15.164:0/2780556106 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c0145f0 con 0x55758a5e73f0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55758a5e8680 con 0x55758a5e73f0 2024-09-14T10:55:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f520effd640 1 -- 172.21.15.164:0/2780556106 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c014910 con 0x55758a5e73f0 2024-09-14T10:55:27.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.604+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55758a5e8c20 con 0x55758a5e73f0 2024-09-14T10:55:27.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.605+0000 7f520effd640 1 -- 172.21.15.164:0/2780556106 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f531c011040 con 0x55758a5e73f0 2024-09-14T10:55:27.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.605+0000 7f520effd640 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 0x7f520003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.605+0000 7f520effd640 1 -- 172.21.15.164:0/2780556106 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f531c01e070 con 0x55758a5e73f0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.605+0000 7f532952a640 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 0x7f520003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f532952a640 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 0x7f520003f2d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55758a5ce4c0 tx=0x7f532401bf60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f532ba40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f532ba40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55758a4d1f10 con 0x55758a5f3eb0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33896/0 (socket says 172.21.15.164:33896) 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f5329d2b640 1 -- 172.21.15.164:0/3816126664 learned_addr learned my addr 172.21.15.164:0/3816126664 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.606+0000 7f5329d2b640 1 -- 172.21.15.164:0/3816126664 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a5f4880 con 0x55758a5f3eb0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f5329d2b640 1 --2- 172.21.15.164:0/3816126664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f531c016fd0 tx=0x7f531c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f5e4b9c120ac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f520cff9640 1 -- 172.21.15.164:0/3816126664 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c04b070 con 0x55758a5f3eb0 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f520cff9640 1 -- 172.21.15.164:0/3816126664 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c051070 con 0x55758a5f3eb0 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f520cff9640 1 -- 172.21.15.164:0/3816126664 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c011da0 con 0x55758a5f3eb0 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- 172.21.15.164:0/3816126664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 msgr2=0x55758a5f4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 --2- 172.21.15.164:0/3816126664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f531c016fd0 tx=0x7f531c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- 172.21.15.164:0/3816126664 shutdown_connections 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 --2- 172.21.15.164:0/3816126664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5f4290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- 172.21.15.164:0/3816126664 >> 172.21.15.164:0/3816126664 conn(0x55758a5f02b0 msgr2=0x55758a5ee4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- 172.21.15.164:0/3816126664 shutdown_connections 2024-09-14T10:55:27.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- 172.21.15.164:0/3816126664 wait complete. 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 Processor -- start 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.607+0000 7f532ba40800 1 -- start start 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f532ba40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5fb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f532ba40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55758a5f4ec0 con 0x55758a5f3eb0 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5fb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f5329d2b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5fb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33910/0 (socket says 172.21.15.164:33910) 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 learned_addr learned my addr 172.21.15.164:0/3100826234 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55758a5fb9c0 con 0x55758a5f3eb0 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f5329d2b640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5fb460 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f531c0014d0 tx=0x7f531c054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f51feffd640 1 -- 172.21.15.164:0/3100826234 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c04b030 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.608+0000 7f51feffd640 1 -- 172.21.15.164:0/3100826234 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c011330 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55758a5fbc50 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f51feffd640 1 -- 172.21.15.164:0/3100826234 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f531c0457a0 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55758a5fc5d0 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f51feffd640 1 -- 172.21.15.164:0/3100826234 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f531c045940 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f51feffd640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51f403ce60 0x7f51f403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.609+0000 7f51feffd640 1 -- 172.21.15.164:0/3100826234 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f531c04c070 con 0x55758a5f3eb0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f532952a640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51f403ce60 0x7f51f403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f532952a640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51f403ce60 0x7f51f403f320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5324018fd0 tx=0x7f5324039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a607190 0x55758a609650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a609da0 con 0x55758a607190 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f5328d29640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a607190 0x55758a609650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.610+0000 7f5328d29640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a607190 0x55758a609650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 realm 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60a1d0 con 0x55758a607190 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60aaa0 con 0x55758a607190 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60ae40 con 0x55758a607190 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a60bba0 0x55758a60df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.611+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60e5a0 con 0x55758a60bba0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a60bba0 0x55758a60df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a60bba0 0x55758a60df90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f532ba40800 20 searching for the correct realm 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f531c014070 0x7f531c03fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.612+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f532952a640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f531c014070 0x7f531c03fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f532952a640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f531c014070 0x7f531c03fa40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532402d070 con 0x7f531c014070 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f532952a640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f53240541c0 0x7f53240545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.613+0000 7f5328d29640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f53240541c0 0x7f53240545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f53240541c0 0x7f53240545e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.614+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532402d070 con 0x7f531c014070 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.615+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f532402d070 con 0x7f531c014070 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.616+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.617+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.618+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532402d070 con 0x7f531c014070 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.619+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532402d070 con 0x7f531c014070 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a60bba0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.620+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f53240541c0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x55758a607190 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55758a60fe90 con 0x7f531c014070 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60ef90 con 0x55758a607190 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.621+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a60f7e0 con 0x55758a607190 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a610310 con 0x55758a607190 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 zone default found 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 4 Realm: () 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 zonegroup default 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a6106b0 con 0x7f53240541c0 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.622+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a612490 con 0x55758a60bba0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a612970 con 0x55758a60bba0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 20 started sync module instance, tier type = 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.623+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a611930 con 0x7f531c014070 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.624+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.624+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93963321154848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a611590 con 0x7f531c014070 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.624+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6138a0 con 0x55758a607190 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.625+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93963321154848] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.625+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.625+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93963321160688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a613810 con 0x55758a607190 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.625+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a614760 con 0x55758a60bba0 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.626+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93963321160688] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.626+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.626+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93963321162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a614760 con 0x55758a60bba0 2024-09-14T10:55:27.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.626+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6151b0 con 0x7f531c014070 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.627+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93963321162896] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.627+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.627+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93963321164464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6146d0 con 0x7f531c014070 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.627+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6160a0 con 0x55758a607190 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.628+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.628+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93963321171408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a616860 con 0x55758a607190 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.628+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a617360 con 0x7f53240541c0 2024-09-14T10:55:27.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.628+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93963321164464] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.629+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.629+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93963321171408] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.629+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93963321175632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a617320 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.629+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6162f0 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.630+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93963321175632] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93963321169360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6178f0 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6182b0 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93963321169360] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93963321172656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a6182b0 con 0x7f53240541c0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 20 add_watcher() i=0 2024-09-14T10:55:27.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 20 add_watcher() i=1 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 20 add_watcher() i=2 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 20 add_watcher() i=3 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.631+0000 7f532ba40800 20 add_watcher() i=4 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f532ba40800 20 add_watcher() i=5 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f532ba40800 20 add_watcher() i=6 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93963321172656] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f532ba40800 20 add_watcher() i=7 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f532ba40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.632+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a61b580 con 0x55758a607190 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.633+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.633+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93963321180016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a618840 con 0x55758a607190 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93963321180016] v35'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f51dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f532ba40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f532ba40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f532ba40800 5 note: GC not initialized 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f51defe5640 20 reqs_thread_entry: start 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f532ba40800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f532ba40800 20 Filter name: none 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.634+0000 7f51dcfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a64e8b0 con 0x7f53240541c0 2024-09-14T10:55:27.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.635+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a650840 con 0x7f531c014070 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:27.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a652670 con 0x7f531c014070 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.636+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a656cc0 con 0x7f531c014070 2024-09-14T10:55:27.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.637+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 foo.buckets [call] v35'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.637+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a65cc70 con 0x7f531c014070 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532ba40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532ba40800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532ba40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532ba40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.638+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93963321421104 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a6570f0 con 0x7f53240541c0 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== watch-notify(notify (1) cookie 93963321172656 notify 150323855364 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f5314081040 con 0x7f53240541c0 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f520cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 93963321172656 notifier 4514 bl.length()=760 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f520cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f520cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:27.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f520cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(67 notify.7 [notify cookie 93963321421104 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f520cff9640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f51ec003ea0 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== watch-notify(notify_complete (2) cookie 93963321421104 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55758a4da920 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f532ba40800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f532ba40800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f532ba40800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f532ba40800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.639+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a65b4b0 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.640+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(69 fud.buckets [call] v35'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.640+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a652d10 con 0x7f531c014070 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f532ba40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f532ba40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f532ba40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93963321421072 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55758a65b960 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== watch-notify(notify (1) cookie 93963321169360 notify 150323855365 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f531405fc90 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f520cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 93963321169360 notifier 4514 bl.length()=314 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.641+0000 7f520cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.642+0000 7f520cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.642+0000 7f520cff9640 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f51ec003ea0 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.642+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(71 notify.6 [notify cookie 93963321421072 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.642+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.642+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== watch-notify(notify_complete (2) cookie 93963321421072 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f531407a550 con 0x7f53240541c0 2024-09-14T10:55:27.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.643+0000 7f51dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.643+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93963321180016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x55758a607190 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.644+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93963321180016] v35'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.644+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93963321154848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x7f531c014070 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.645+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93963321154848] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.645+0000 7f532ba40800 20 remove_watcher() i=0 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.645+0000 7f532ba40800 2 removed watcher, disabling cache 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.645+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93963321160688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x55758a607190 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.646+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93963321160688] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.646+0000 7f532ba40800 20 remove_watcher() i=1 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.646+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93963321162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x55758a60bba0 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.647+0000 7f5329d2b640 1 -- 172.21.15.164:0/3100826234 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93963321162896] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f531c02a070 con 0x55758a60bba0 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.647+0000 7f532ba40800 20 remove_watcher() i=2 2024-09-14T10:55:27.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.647+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93963321164464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x7f531c014070 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.648+0000 7f532952a640 1 -- 172.21.15.164:0/3100826234 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93963321164464] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5324063040 con 0x7f531c014070 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.648+0000 7f532ba40800 20 remove_watcher() i=3 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.648+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93963321171408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x55758a607190 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.649+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93963321171408] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x55758a607190 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.649+0000 7f532ba40800 20 remove_watcher() i=4 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.649+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93963321175632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x7f53240541c0 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.650+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93963321175632] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.650+0000 7f532ba40800 20 remove_watcher() i=5 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.650+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93963321169360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x7f53240541c0 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.651+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93963321169360] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.651+0000 7f532ba40800 20 remove_watcher() i=6 2024-09-14T10:55:27.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.651+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93963321172656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55758a64c680 con 0x7f53240541c0 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93963321172656] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5314051070 con 0x7f53240541c0 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 20 remove_watcher() i=7 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f53240541c0 msgr2=0x7f53240545e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f53240541c0 0x7f53240545e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a607190 msgr2=0x55758a609650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a607190 0x55758a609650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f531c014070 msgr2=0x7f531c03fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f531c014070 0x7f531c03fa40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a60bba0 msgr2=0x55758a60df90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a60bba0 0x55758a60df90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51f403ce60 msgr2=0x7f51f403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f51f403ce60 0x7f51f403f320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5324018fd0 tx=0x7f5324039000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 msgr2=0x55758a5fb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/3100826234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5f3eb0 0x55758a5fb460 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f531c0014d0 tx=0x7f531c054560 comp rx=0 tx=0).stop 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f5328d29640 1 -- 172.21.15.164:0/3100826234 reap_dead start 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 shutdown_connections 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 >> 172.21.15.164:0/3100826234 conn(0x55758a5f02b0 msgr2=0x55758a5ee4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 shutdown_connections 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/3100826234 wait complete. 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 msgr2=0x7f520003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 0x7f520003f2d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55758a5ce4c0 tx=0x7f532401bf60 comp rx=0 tx=0).stop 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 msgr2=0x55758a5e7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.652+0000 7f532ba40800 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f531c00a2a0 tx=0x7f531c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 shutdown_connections 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f520003ce10 0x7f520003f2d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2780556106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a5e73f0 0x55758a5e7810 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 >> 172.21.15.164:0/2780556106 conn(0x55758a5db7a0 msgr2=0x55758a5dbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 shutdown_connections 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2780556106 wait complete. 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 msgr2=0x55758a5d3a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 0x55758a5d3a20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 msgr2=0x55758a5d8280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 0x55758a5d8280 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 msgr2=0x7f521003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 0x7f521003f470 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5314057000 tx=0x7f5314052000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 msgr2=0x55758a5cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53240012f0 tx=0x7f5324000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 shutdown_connections 2024-09-14T10:55:27.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55758a5d5e00 0x55758a5d8280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55758a4d6d50 0x55758a5d3a20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f521003cfb0 0x7f521003f470 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 --2- 172.21.15.164:0/2874395531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55758a4d0cb0 0x55758a5cc3d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 >> 172.21.15.164:0/2874395531 conn(0x55758a4cc700 msgr2=0x55758a5bdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 shutdown_connections 2024-09-14T10:55:27.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.653+0000 7f532ba40800 1 -- 172.21.15.164:0/2874395531 wait complete. 2024-09-14T10:55:27.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:27.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:27.669 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:55:27.713 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.713 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.716+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.716+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f58a0015800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5583849c1fa0 0x5583849c4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f58a0015800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583849c4960 con 0x55838492f710 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f58a0015800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5583848467d0 con 0x5583849c1fa0 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589af91640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5583849c1fa0 0x5583849c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589b792640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55838492f710 0x5583849c0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38794/0 (socket says 172.21.15.164:38794) 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589af91640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5583849c1fa0 0x5583849c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33920/0 (socket says 172.21.15.164:33920) 2024-09-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589b792640 1 -- 172.21.15.164:0/3282180635 learned_addr learned my addr 172.21.15.164:0/3282180635 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589af91640 1 -- 172.21.15.164:0/3282180635 >> v1:172.21.15.116:6789/0 conn(0x55838492f710 legacy=0x5583849c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.717+0000 7f589af91640 1 -- 172.21.15.164:0/3282180635 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583849c5b40 con 0x5583849c1fa0 2024-09-14T10:55:27.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f589af91640 1 --2- 172.21.15.164:0/3282180635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583849c1fa0 0x5583849c4390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f589000a470 tx=0x7f5890045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a192ea9ce2a92b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f589a790640 1 -- 172.21.15.164:0/3282180635 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5890053570 con 0x5583849c1fa0 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f589a790640 1 -- 172.21.15.164:0/3282180635 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5890058070 con 0x5583849c1fa0 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f589a790640 1 -- 172.21.15.164:0/3282180635 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5890053880 con 0x5583849c1fa0 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f58a0015800 1 -- 172.21.15.164:0/3282180635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583849c1fa0 msgr2=0x5583849c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f58a0015800 1 --2- 172.21.15.164:0/3282180635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583849c1fa0 0x5583849c4390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f589000a470 tx=0x7f5890045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f58a0015800 1 -- 172.21.15.164:0/3282180635 shutdown_connections 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f58a0015800 1 --2- 172.21.15.164:0/3282180635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5583849c1fa0 0x5583849c4390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.719+0000 7f58a0015800 1 -- 172.21.15.164:0/3282180635 >> 172.21.15.164:0/3282180635 conn(0x5583849b5fb0 msgr2=0x5583849b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.720+0000 7f58a0015800 1 -- 172.21.15.164:0/3282180635 shutdown_connections 2024-09-14T10:55:27.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.720+0000 7f58a0015800 1 -- 172.21.15.164:0/3282180635 wait complete. 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.733+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.733+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.733+0000 7f58a0015800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.733+0000 7f58a0015800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558384853dd0 con 0x55838492f710 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f589b792640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f589b792640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33924/0 (socket says 172.21.15.164:33924) 2024-09-14T10:55:27.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f589b792640 1 -- 172.21.15.164:0/4079822096 learned_addr learned my addr 172.21.15.164:0/4079822096 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f589b792640 1 -- 172.21.15.164:0/4079822096 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558384aadf80 con 0x55838492f710 2024-09-14T10:55:27.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f589b792640 1 --2- 172.21.15.164:0/4079822096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f588c001e40 tx=0x7f588c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcff28abb39afe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f578960a640 1 -- 172.21.15.164:0/4079822096 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c012020 con 0x55838492f710 2024-09-14T10:55:27.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f578960a640 1 -- 172.21.15.164:0/4079822096 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c00e5a0 con 0x55838492f710 2024-09-14T10:55:27.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.734+0000 7f578960a640 1 -- 172.21.15.164:0/4079822096 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c00e8a0 con 0x55838492f710 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- 172.21.15.164:0/4079822096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 msgr2=0x558384aad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 --2- 172.21.15.164:0/4079822096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f588c001e40 tx=0x7f588c001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- 172.21.15.164:0/4079822096 shutdown_connections 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 --2- 172.21.15.164:0/4079822096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384aad990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- 172.21.15.164:0/4079822096 >> 172.21.15.164:0/4079822096 conn(0x5583849b5fb0 msgr2=0x558384aa9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- 172.21.15.164:0/4079822096 shutdown_connections 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- 172.21.15.164:0/4079822096 wait complete. 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.735+0000 7f58a0015800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583849c4e30 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f589b792640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f589b792640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33932/0 (socket says 172.21.15.164:33932) 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f589b792640 1 -- 172.21.15.164:0/3893095471 learned_addr learned my addr 172.21.15.164:0/3893095471 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f589b792640 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558384ab5a50 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f589b792640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c010 tx=0x7f588c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f5787e07640 1 -- 172.21.15.164:0/3893095471 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c012030 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f5787e07640 1 -- 172.21.15.164:0/3893095471 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c0014a0 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558384ab5ce0 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f5787e07640 1 -- 172.21.15.164:0/3893095471 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f588c01a7a0 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.736+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558384ab66e0 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f5787e07640 1 -- 172.21.15.164:0/3893095471 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f588c015020 con 0x55838492f710 2024-09-14T10:55:27.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f5787e07640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 0x7f578003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f5787e07640 1 -- 172.21.15.164:0/3893095471 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f588c020030 con 0x55838492f710 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f589af91640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 0x7f578003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 0x558384abcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.737+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384ab7270 con 0x5583849c1fa0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f589bf93640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 0x558384abcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f589af91640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 0x7f578003f320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5890057000 tx=0x7f5890052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f589bf93640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 0x558384abcb40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f589bf93640 1 -- 172.21.15.164:0/3893095471 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f589400a4d0 con 0x5583849c1fa0 2024-09-14T10:55:27.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384ab6b70 con 0x5583849c1fa0 2024-09-14T10:55:27.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f589bf93640 1 -- 172.21.15.164:0/3893095471 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f589400a4d0 con 0x5583849c1fa0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 0x558384ac13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.738+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384ac1a70 con 0x558384abefb0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f589b792640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 0x558384ac13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f589b792640 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 0x558384ac13a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f589b792640 1 -- 172.21.15.164:0/3893095471 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f588c0187b0 con 0x558384abefb0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384abde50 con 0x5583849c1fa0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f589bf93640 1 -- 172.21.15.164:0/3893095471 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f589400a4d0 con 0x5583849c1fa0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.739+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384abe2f0 con 0x5583849c1fa0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f589bf93640 1 -- 172.21.15.164:0/3893095471 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f589400a4d0 con 0x5583849c1fa0 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f58a0015800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f58a0015800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5583848b24a0 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33944/0 (socket says 172.21.15.164:33944) 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.740+0000 7f589bf93640 1 -- 172.21.15.164:0/407525814 learned_addr learned my addr 172.21.15.164:0/407525814 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f589bf93640 1 -- 172.21.15.164:0/407525814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558384ad0eb0 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f589bf93640 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x558384abd080 tx=0x7f5894018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f5785602640 1 -- 172.21.15.164:0/407525814 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894014450 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f5785602640 1 -- 172.21.15.164:0/407525814 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58940145f0 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558384ad16e0 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f5785602640 1 -- 172.21.15.164:0/407525814 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894014910 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.741+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558384ad1c80 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f5785602640 1 -- 172.21.15.164:0/407525814 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5894011040 con 0x558384ad0450 2024-09-14T10:55:27.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f5785602640 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 0x7f577403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f5785602640 1 -- 172.21.15.164:0/407525814 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f589401e070 con 0x558384ad0450 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f589b792640 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 0x7f577403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f589b792640 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 0x7f577403f2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558384abd120 tx=0x7f588c052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.742+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f58a0015800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f58a0015800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558384aae3b0 con 0x558384adcf10 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33950/0 (socket says 172.21.15.164:33950) 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f589bf93640 1 -- 172.21.15.164:0/407625225 learned_addr learned my addr 172.21.15.164:0/407625225 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f589bf93640 1 -- 172.21.15.164:0/407625225 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558384add8e0 con 0x558384adcf10 2024-09-14T10:55:27.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f589bf93640 1 --2- 172.21.15.164:0/407625225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5894016fd0 tx=0x7f5894011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2213c9f8fa13733b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f577effd640 1 -- 172.21.15.164:0/407625225 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589404b070 con 0x558384adcf10 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f577effd640 1 -- 172.21.15.164:0/407625225 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894051070 con 0x558384adcf10 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.743+0000 7f577effd640 1 -- 172.21.15.164:0/407625225 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58940167e0 con 0x558384adcf10 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- 172.21.15.164:0/407625225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 msgr2=0x558384add2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 --2- 172.21.15.164:0/407625225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5894016fd0 tx=0x7f5894011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- 172.21.15.164:0/407625225 shutdown_connections 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 --2- 172.21.15.164:0/407625225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384add2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- 172.21.15.164:0/407625225 >> 172.21.15.164:0/407625225 conn(0x558384ad9310 msgr2=0x558384ad7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- 172.21.15.164:0/407625225 shutdown_connections 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- 172.21.15.164:0/407625225 wait complete. 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 Processor -- start 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- start start 2024-09-14T10:55:27.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f58a0015800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558384addf20 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f589bf93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33964/0 (socket says 172.21.15.164:33964) 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.744+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 learned_addr learned my addr 172.21.15.164:0/1439887821 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558384ae4a50 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f589bf93640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5894016fd0 tx=0x7f5894054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f577d7fa640 1 -- 172.21.15.164:0/1439887821 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589404b030 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f577d7fa640 1 -- 172.21.15.164:0/1439887821 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894031030 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f577d7fa640 1 -- 172.21.15.164:0/1439887821 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894016910 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558384ae4ce0 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558384ae5870 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.745+0000 7f577d7fa640 1 -- 172.21.15.164:0/1439887821 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5894045750 con 0x558384adcf10 2024-09-14T10:55:27.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.746+0000 7f577d7fa640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f576403ce60 0x7f576403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.746+0000 7f577d7fa640 1 -- 172.21.15.164:0/1439887821 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f589404c070 con 0x558384adcf10 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.746+0000 7f589b792640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f576403ce60 0x7f576403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.746+0000 7f589b792640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f576403ce60 0x7f576403f320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f588c018ac0 tx=0x7f588c048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558384af0250 0x558384af2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af2e60 con 0x558384af0250 2024-09-14T10:55:27.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f589af91640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558384af0250 0x558384af2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f589af91640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558384af0250 0x558384af2710 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 20 realm 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.747+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af3290 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af3b60 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af3f00 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384af4c60 0x558384af7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af7660 con 0x558384af4c60 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f589bf93640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384af4c60 0x558384af7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.748+0000 7f589bf93640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384af4c60 0x558384af7050 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f58a0015800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f58a0015800 20 searching for the correct realm 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589bf93640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5894014070 0x7f589402c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589b792640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5894014070 0x7f589402c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.749+0000 7f589b792640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5894014070 0x7f589402c770 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589b792640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f588c017050 0x7f588c04b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589af91640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f588c017050 0x7f588c04b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589af91640 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f588c017050 0x7f588c04b640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.750+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.751+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.752+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.753+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.754+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.755+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.756+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af4c60 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x558384af0250 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558384af8f50 con 0x7f5894014070 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af8020 con 0x558384af0250 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.757+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af8870 con 0x558384af0250 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af93d0 con 0x558384af0250 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 zone default found 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 4 Realm: () 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 zonegroup default 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384af9770 con 0x7f588c017050 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.758+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384afb550 con 0x558384af4c60 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384afb9f0 con 0x558384af4c60 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 20 started sync module instance, tier type = 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.759+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afa9f0 con 0x7f5894014070 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.760+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.760+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023355182608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afa650 con 0x7f5894014070 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.760+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afc920 con 0x558384af0250 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.761+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023355182608] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.761+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.761+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023355188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afc890 con 0x558384af0250 2024-09-14T10:55:27.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.761+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd7e0 con 0x558384af4c60 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.762+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023355188336] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.762+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.762+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023355190544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd7e0 con 0x558384af4c60 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.762+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afe200 con 0x7f5894014070 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.763+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023355190544] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.763+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.763+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023355192112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd750 con 0x7f5894014070 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.763+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384aff0f0 con 0x558384af0250 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.764+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.764+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023355199008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384aff990 con 0x558384af0250 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.764+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b00460 con 0x7f588c017050 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.764+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023355192112] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.765+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023355199008] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.766+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.766+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023355203408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384aff490 con 0x7f588c017050 2024-09-14T10:55:27.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.766+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b00d00 con 0x7f588c017050 2024-09-14T10:55:27.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.767+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.767+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023355205600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b010b0 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.767+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b01900 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.767+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023355203408] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023355205600] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023355206656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b014d0 con 0x7f588c017050 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=0 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=1 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=2 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=3 2024-09-14T10:55:27.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=4 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=5 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.768+0000 7f58a0015800 20 add_watcher() i=6 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023355206656] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f58a0015800 20 add_watcher() i=7 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f58a0015800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384b04650 con 0x558384af0250 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.769+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023355220160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b014d0 con 0x558384af0250 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.770+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023355220160] v35'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.770+0000 7f5751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.770+0000 7f58a0015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.770+0000 7f58a0015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.770+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0d010 con 0x558384af0250 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.771+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.771+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0d6a0 con 0x7f588c017050 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.772+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.772+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0dc10 con 0x558384af4c60 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.773+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.773+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0dc10 con 0x558384af0250 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.774+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'113 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.774+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e0b0 con 0x7f5894014070 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.775+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.775+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e0b0 con 0x558384af4c60 2024-09-14T10:55:27.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.776+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.776+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e180 con 0x558384af0250 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.777+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.778+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e180 con 0x7f588c017050 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.778+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.779+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e670 con 0x7f5894014070 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.779+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.779+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e670 con 0x558384af4c60 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.780+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.780+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e670 con 0x7f5894014070 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.781+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.781+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e700 con 0x7f588c017050 2024-09-14T10:55:27.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.783+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.783+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e790 con 0x7f5894014070 2024-09-14T10:55:27.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.783+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.784+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e820 con 0x7f588c017050 2024-09-14T10:55:27.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.785+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.785+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e820 con 0x558384af0250 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.786+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.786+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e820 con 0x558384af4c60 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.787+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.787+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e8b0 con 0x7f5894014070 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.788+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.788+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e8b0 con 0x558384af4c60 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.789+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.789+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e940 con 0x558384af0250 2024-09-14T10:55:27.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.790+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.790+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e940 con 0x558384af0250 2024-09-14T10:55:27.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.791+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'115 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.791+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e940 con 0x558384af4c60 2024-09-14T10:55:27.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.792+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.792+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e940 con 0x7f5894014070 2024-09-14T10:55:27.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.793+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.793+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e940 con 0x558384af4c60 2024-09-14T10:55:27.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.794+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.794+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e980 con 0x558384af4c60 2024-09-14T10:55:27.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.795+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.795+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e9c0 con 0x558384af4c60 2024-09-14T10:55:27.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.796+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.796+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0e9c0 con 0x558384af4c60 2024-09-14T10:55:27.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.796+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.796+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea00 con 0x7f588c017050 2024-09-14T10:55:27.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.798+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.798+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea40 con 0x558384af4c60 2024-09-14T10:55:27.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.798+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.799+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea40 con 0x7f588c017050 2024-09-14T10:55:27.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.800+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.800+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea40 con 0x558384af4c60 2024-09-14T10:55:27.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.801+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.801+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea40 con 0x7f588c017050 2024-09-14T10:55:27.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.802+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.802+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b0ea80 con 0x7f5894014070 2024-09-14T10:55:27.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f5750fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f58a0015800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f58a0015800 20 Filter name: none 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f56ca7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f58a0015800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:27.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f58a0015800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.803+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384b399a0 con 0x7f588c017050 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f58a0015800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f58a0015800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f58a0015800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f58a0015800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558384b3be90 con 0x7f588c017050 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.804+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.803 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:55:27.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.805+0000 7f5751fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.805+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023355220160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b02d90 con 0x558384af0250 2024-09-14T10:55:27.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.806+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94023355220160] v35'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.806+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023355182608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384b040c0 con 0x7f5894014070 2024-09-14T10:55:27.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.807+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94023355182608] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.807+0000 7f58a0015800 20 remove_watcher() i=0 2024-09-14T10:55:27.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.807+0000 7f58a0015800 2 removed watcher, disabling cache 2024-09-14T10:55:27.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.807+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023355188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afae10 con 0x558384af0250 2024-09-14T10:55:27.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.808+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94023355188336] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.808+0000 7f58a0015800 20 remove_watcher() i=1 2024-09-14T10:55:27.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.808+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023355190544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afae10 con 0x558384af4c60 2024-09-14T10:55:27.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.809+0000 7f589bf93640 1 -- 172.21.15.164:0/1439887821 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94023355190544] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589403d070 con 0x558384af4c60 2024-09-14T10:55:27.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.809+0000 7f58a0015800 20 remove_watcher() i=2 2024-09-14T10:55:27.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.809+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023355192112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afae10 con 0x7f5894014070 2024-09-14T10:55:27.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.810+0000 7f589b792640 1 -- 172.21.15.164:0/1439887821 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94023355192112] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f588c0187b0 con 0x7f5894014070 2024-09-14T10:55:27.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.810+0000 7f58a0015800 20 remove_watcher() i=3 2024-09-14T10:55:27.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.810+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023355199008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd330 con 0x558384af0250 2024-09-14T10:55:27.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94023355199008] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x558384af0250 2024-09-14T10:55:27.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f58a0015800 20 remove_watcher() i=4 2024-09-14T10:55:27.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023355203408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afae10 con 0x7f588c017050 2024-09-14T10:55:27.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94023355203408] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f58a0015800 20 remove_watcher() i=5 2024-09-14T10:55:27.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.812+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023355205600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd330 con 0x7f588c017050 2024-09-14T10:55:27.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.813+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94023355205600] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.813+0000 7f58a0015800 20 remove_watcher() i=6 2024-09-14T10:55:27.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.813+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023355206656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558384afd330 con 0x7f588c017050 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94023355206656] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5890051070 con 0x7f588c017050 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 20 remove_watcher() i=7 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f588c017050 msgr2=0x7f588c04b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f588c017050 0x7f588c04b640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558384af0250 msgr2=0x558384af2710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558384af0250 0x558384af2710 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5894014070 msgr2=0x7f589402c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5894014070 0x7f589402c770 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384af4c60 msgr2=0x558384af7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.814+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384af4c60 0x558384af7050 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f576403ce60 msgr2=0x7f576403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f576403ce60 0x7f576403f320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f588c018ac0 tx=0x7f588c048000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 msgr2=0x558384ae44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f589af91640 1 -- 172.21.15.164:0/1439887821 reap_dead start 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5894016fd0 tx=0x7f5894054510 comp rx=0 tx=0).stop 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 shutdown_connections 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/1439887821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384adcf10 0x558384ae44f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 >> 172.21.15.164:0/1439887821 conn(0x558384ad9310 msgr2=0x558384ad7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 shutdown_connections 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/1439887821 wait complete. 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 msgr2=0x7f577403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 0x7f577403f2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x558384abd120 tx=0x7f588c052770 comp rx=0 tx=0).stop 2024-09-14T10:55:27.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 msgr2=0x558384ad0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x558384abd080 tx=0x7f5894018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 shutdown_connections 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f577403ce10 0x7f577403f2d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/407525814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558384ad0450 0x558384ad0870 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 >> 172.21.15.164:0/407525814 conn(0x558384ac4800 msgr2=0x558384ac4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 shutdown_connections 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/407525814 wait complete. 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 msgr2=0x558384abcb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.815+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 0x558384abcb40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 msgr2=0x558384ac13a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 0x558384ac13a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 msgr2=0x7f578003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 0x7f578003f320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5890057000 tx=0x7f5890052000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 msgr2=0x558384ab54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c010 tx=0x7f588c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 shutdown_connections 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558384abefb0 0x558384ac13a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5583849c1fa0 0x558384abcb40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f578003ce60 0x7f578003f320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 --2- 172.21.15.164:0/3893095471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55838492f710 0x558384ab54f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 >> 172.21.15.164:0/3893095471 conn(0x5583849b5fb0 msgr2=0x558384aaee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 shutdown_connections 2024-09-14T10:55:27.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.816+0000 7f58a0015800 1 -- 172.21.15.164:0/3893095471 wait complete. 2024-09-14T10:55:27.822 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:55:27.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-14T10:55:27.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-14T10:55:27.823 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-14T10:55:27.869 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:27.869 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd86410c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e8a8f6c7b0 0x55e8a8ffb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd86410c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8a8fff700 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd86410c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e8a8e837d0 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd861bf6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e8a8f6c7b0 0x55e8a8ffb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd8593f5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55e8a8ffb9e0 0x55e8a8ffdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38804/0 (socket says 172.21.15.164:38804) 2024-09-14T10:55:27.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd8593f5640 1 -- 172.21.15.164:0/3641214545 learned_addr learned my addr 172.21.15.164:0/3641214545 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:27.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd861bf6640 1 -- 172.21.15.164:0/3641214545 >> v1:172.21.15.116:6789/0 conn(0x55e8a8ffb9e0 legacy=0x55e8a8ffdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd861bf6640 1 -- 172.21.15.164:0/3641214545 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a9000930 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.872+0000 7fd8613f5640 1 -- 172.21.15.164:0/3641214545 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26086760 0 0) 0x55e8a8fff700 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.874+0000 7fd861bf6640 1 --2- 172.21.15.164:0/3641214545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a8ffb4a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57190adc7dcd592d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.874+0000 7fd8613f5640 1 -- 172.21.15.164:0/3641214545 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854053570 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.874+0000 7fd8613f5640 1 -- 172.21.15.164:0/3641214545 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854058070 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.874+0000 7fd8613f5640 1 -- 172.21.15.164:0/3641214545 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854053880 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 -- 172.21.15.164:0/3641214545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 msgr2=0x55e8a8ffb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 --2- 172.21.15.164:0/3641214545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a8ffb4a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:27.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 -- 172.21.15.164:0/3641214545 shutdown_connections 2024-09-14T10:55:27.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 --2- 172.21.15.164:0/3641214545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a8ffb4a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 -- 172.21.15.164:0/3641214545 >> 172.21.15.164:0/3641214545 conn(0x55e8a8ff2fd0 msgr2=0x55e8a8ff5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 -- 172.21.15.164:0/3641214545 shutdown_connections 2024-09-14T10:55:27.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.875+0000 7fd86410c800 1 -- 172.21.15.164:0/3641214545 wait complete. 2024-09-14T10:55:27.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd86410c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd86410c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e8a8e90dd0 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd861bf6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd861bf6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33982/0 (socket says 172.21.15.164:33982) 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd861bf6640 1 -- 172.21.15.164:0/2805985769 learned_addr learned my addr 172.21.15.164:0/2805985769 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.889+0000 7fd861bf6640 1 -- 172.21.15.164:0/2805985769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a90e8bb0 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd861bf6640 1 --2- 172.21.15.164:0/2805985769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc26a204c81684b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd74fe07640 1 -- 172.21.15.164:0/2805985769 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854053570 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd74fe07640 1 -- 172.21.15.164:0/2805985769 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854063030 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd74fe07640 1 -- 172.21.15.164:0/2805985769 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854053840 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd86410c800 1 -- 172.21.15.164:0/2805985769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 msgr2=0x55e8a90e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.890+0000 7fd86410c800 1 --2- 172.21.15.164:0/2805985769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854051000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- 172.21.15.164:0/2805985769 shutdown_connections 2024-09-14T10:55:27.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 --2- 172.21.15.164:0/2805985769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90e85c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- 172.21.15.164:0/2805985769 >> 172.21.15.164:0/2805985769 conn(0x55e8a8ff2fd0 msgr2=0x55e8a90e3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- 172.21.15.164:0/2805985769 shutdown_connections 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- 172.21.15.164:0/2805985769 wait complete. 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd86410c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e8a8fffbd0 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd861bf6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd861bf6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33986/0 (socket says 172.21.15.164:33986) 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.891+0000 7fd861bf6640 1 -- 172.21.15.164:0/3277685276 learned_addr learned my addr 172.21.15.164:0/3277685276 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd861bf6640 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a90f0590 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd861bf6640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd74e604640 1 -- 172.21.15.164:0/3277685276 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854078070 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd74e604640 1 -- 172.21.15.164:0/3277685276 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd854068420 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8a90f0820 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd74e604640 1 -- 172.21.15.164:0/3277685276 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd854068700 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.892+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a90f1430 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd74e604640 1 -- 172.21.15.164:0/3277685276 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd85407b070 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd74e604640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 0x7fd74803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd74e604640 1 -- 172.21.15.164:0/3277685276 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd8540982d0 con 0x55e8a8f6c7b0 2024-09-14T10:55:27.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd8593f5640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 0x7fd74803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 0x55e8a90f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.893+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a90f7bc0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd8623f7640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 0x55e8a90f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd8593f5640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 0x7fd74803f320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd84c000c00 tx=0x7fd84c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd8623f7640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 0x55e8a90f7680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd8623f7640 1 -- 172.21.15.164:0/3277685276 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85c00a4d0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a90f7f60 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd8623f7640 1 -- 172.21.15.164:0/3277685276 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd85c00a4d0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 0x55e8a90fbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.894+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a90fc610 con 0x55e8a90f99e0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd861bf6640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 0x55e8a90fbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd861bf6640 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 0x55e8a90fbe80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd861bf6640 1 -- 172.21.15.164:0/3277685276 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd85407a030 con 0x55e8a90f99e0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a90f87b0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd8623f7640 1 -- 172.21.15.164:0/3277685276 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd85c00a4d0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.895+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a90f8b50 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd8623f7640 1 -- 172.21.15.164:0/3277685276 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd85c00a4d0 con 0x55e8a8ffb9e0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd86410c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd86410c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e8a8eef4a0 con 0x55e8a910af80 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:33998/0 (socket says 172.21.15.164:33998) 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.896+0000 7fd8623f7640 1 -- 172.21.15.164:0/1105279264 learned_addr learned my addr 172.21.15.164:0/1105279264 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd8623f7640 1 -- 172.21.15.164:0/1105279264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a910b9e0 con 0x55e8a910af80 2024-09-14T10:55:27.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd8623f7640 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55e8a90f1030 tx=0x7fd85c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd7477fe640 1 -- 172.21.15.164:0/1105279264 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c014450 con 0x55e8a910af80 2024-09-14T10:55:27.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd7477fe640 1 -- 172.21.15.164:0/1105279264 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c014610 con 0x55e8a910af80 2024-09-14T10:55:27.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8a910c210 con 0x55e8a910af80 2024-09-14T10:55:27.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd7477fe640 1 -- 172.21.15.164:0/1105279264 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c014930 con 0x55e8a910af80 2024-09-14T10:55:27.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.897+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a910c7b0 con 0x55e8a910af80 2024-09-14T10:55:27.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.898+0000 7fd7477fe640 1 -- 172.21.15.164:0/1105279264 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd85c011040 con 0x55e8a910af80 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.898+0000 7fd7477fe640 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 0x7fd73c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.898+0000 7fd7477fe640 1 -- 172.21.15.164:0/1105279264 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd85c01e070 con 0x55e8a910af80 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.898+0000 7fd861bf6640 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 0x7fd73c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd861bf6640 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 0x7fd73c03f320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55e8a90f20c0 tx=0x7fd854067e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd86410c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd86410c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e8a90e8f80 con 0x55e8a91179e0 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34008/0 (socket says 172.21.15.164:34008) 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd8623f7640 1 -- 172.21.15.164:0/1362801430 learned_addr learned my addr 172.21.15.164:0/1362801430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd8623f7640 1 -- 172.21.15.164:0/1362801430 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a91183d0 con 0x55e8a91179e0 2024-09-14T10:55:27.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.899+0000 7fd8623f7640 1 --2- 172.21.15.164:0/1362801430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd85c018430 tx=0x7fd85c001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25b8e2ae83aa29 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd7457fa640 1 -- 172.21.15.164:0/1362801430 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c04b070 con 0x55e8a91179e0 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd7457fa640 1 -- 172.21.15.164:0/1362801430 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c051070 con 0x55e8a91179e0 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd7457fa640 1 -- 172.21.15.164:0/1362801430 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c0167c0 con 0x55e8a91179e0 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- 172.21.15.164:0/1362801430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 msgr2=0x55e8a9117de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 --2- 172.21.15.164:0/1362801430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd85c018430 tx=0x7fd85c001440 comp rx=0 tx=0).stop 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- 172.21.15.164:0/1362801430 shutdown_connections 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 --2- 172.21.15.164:0/1362801430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a9117de0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- 172.21.15.164:0/1362801430 >> 172.21.15.164:0/1362801430 conn(0x55e8a9113de0 msgr2=0x55e8a9112020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- 172.21.15.164:0/1362801430 shutdown_connections 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- 172.21.15.164:0/1362801430 wait complete. 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 Processor -- start 2024-09-14T10:55:27.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.900+0000 7fd86410c800 1 -- start start 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd86410c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd86410c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e8a91189f0 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd8623f7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34012/0 (socket says 172.21.15.164:34012) 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 learned_addr learned my addr 172.21.15.164:0/197120490 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a8ff9110 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd8623f7640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd85c049040 tx=0x7fd85c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd7337fe640 1 -- 172.21.15.164:0/197120490 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c04b040 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd7337fe640 1 -- 172.21.15.164:0/197120490 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c031030 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8a8ff74c0 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd7337fe640 1 -- 172.21.15.164:0/197120490 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c0167c0 con 0x55e8a91179e0 2024-09-14T10:55:27.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.901+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a8ff7a00 con 0x55e8a91179e0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.902+0000 7fd7337fe640 1 -- 172.21.15.164:0/197120490 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd85c001770 con 0x55e8a91179e0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.902+0000 7fd7337fe640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd72c03ce10 0x7fd72c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.902+0000 7fd7337fe640 1 -- 172.21.15.164:0/197120490 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd85c00e040 con 0x55e8a91179e0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.902+0000 7fd861bf6640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd72c03ce10 0x7fd72c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd861bf6640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd72c03ce10 0x7fd72c03f2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd854053da0 tx=0x7fd85408f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a912cfd0 0x55e8a912f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a912fbe0 con 0x55e8a912cfd0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd8593f5640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a912cfd0 0x55e8a912f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd8593f5640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a912cfd0 0x55e8a912f490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.903+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55e8a912cfd0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 realm 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a912c320 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a91306d0 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9130fa0 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55e8a912cfd0 2024-09-14T10:55:27.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a91319c0 0x55e8a9133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9134520 con 0x55e8a91319c0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.904+0000 7fd8623f7640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a91319c0 0x55e8a9133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd8623f7640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a91319c0 0x55e8a9133db0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd85c03e070 con 0x55e8a91319c0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd86410c800 20 searching for the correct realm 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd85c03e070 con 0x55e8a91319c0 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd8623f7640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd85c014070 0x7fd85c02c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.905+0000 7fd861bf6640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd85c014070 0x7fd85c02c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd861bf6640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd85c014070 0x7fd85c02c3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd861bf6640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd8540a5040 0x7fd85407c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd8593f5640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd8540a5040 0x7fd85407c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.906+0000 7fd8593f5640 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd8540a5040 0x7fd85407c3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00f5f0 con 0x7fd8540a5040 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55e8a912cfd0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd8540a5040 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.907+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd8540a5040 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c03e070 con 0x55e8a91319c0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd8540a5040 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.908+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c03e070 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.909+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd8540a5040 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.910+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd8540a5040 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.911+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.912+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a91319c0 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd8540a5040 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x55e8a912cfd0 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135e10 con 0x7fd85c014070 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.913+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9134ee0 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9135780 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9136290 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 zone default found 2024-09-14T10:55:27.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 4 Realm: () 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 zonegroup default 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.914+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9136290 con 0x7fd8540a5040 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9138070 con 0x55e8a91319c0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a91384c0 con 0x55e8a91319c0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 started sync module instance, tier type = 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.915+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9137510 con 0x7fd85c014070 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.916+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.916+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94457757397088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9138920 con 0x7fd85c014070 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.916+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9139170 con 0x55e8a912cfd0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.917+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94457757397088] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.917+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.918+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94457757404352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9139590 con 0x55e8a912cfd0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.918+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9139e40 con 0x55e8a91319c0 2024-09-14T10:55:27.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.919+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.919+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94457757406608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a91399f0 con 0x55e8a91319c0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.919+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913ae10 con 0x7fd85c014070 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.919+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94457757404352] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.920+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94457757406608] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.920+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.920+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94457757409840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a91390e0 con 0x7fd85c014070 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.920+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913b710 con 0x55e8a912cfd0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.921+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94457757409840] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.921+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.921+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94457757413888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913bb00 con 0x55e8a912cfd0 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.921+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913c500 con 0x7fd8540a5040 2024-09-14T10:55:27.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.922+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.922+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94457757413888] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.922+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94457757417488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913c470 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.922+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913a930 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.923+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94457757417488] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.923+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.923+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94457757411584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913cf70 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.923+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913d930 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94457757411584] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94457757422720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913d8a0 con 0x7fd8540a5040 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=0 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=1 2024-09-14T10:55:27.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=2 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=3 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=4 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=5 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.924+0000 7fd86410c800 20 add_watcher() i=6 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.925+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94457757422720] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.925+0000 7fd86410c800 20 add_watcher() i=7 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.925+0000 7fd86410c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.925+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9140d00 con 0x55e8a912cfd0 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.925+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.926+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94457757419584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a913e1c0 con 0x55e8a912cfd0 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.926+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94457757419584] v35'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 5 note: GC not initialized 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd7127fc640 20 reqs_thread_entry: start 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 20 Filter name: none 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd683fff640 20 reqs_thread_entry: start 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.927+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a91740f0 con 0x7fd8540a5040 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:55:27.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.928+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9176080 con 0x7fd85c014070 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9177a80 con 0x7fd85c014070 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.929+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9178e20 con 0x7fd8540a5040 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.930+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(65 fud.buckets [call] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.930+0000 7fd86410c800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.930+0000 7fd86410c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.930+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9179220 con 0x7fd85c014070 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd86410c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd86410c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd86410c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd86410c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.931+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a917ee10 con 0x7fd85c014070 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.932+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.932+0000 7fd86410c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.932+0000 7fd86410c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.932+0000 7fd86410c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.932+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94457757673760 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e8a917c320 con 0x7fd8540a5040 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== watch-notify(notify (1) cookie 94457757411584 notify 150323855366 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7fd84c018040 con 0x7fd8540a5040 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd7457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94457757411584 notifier 4528 bl.length()=338 2024-09-14T10:55:27.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd7457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd7457fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(68 notify.6 [notify cookie 94457757673760 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd7457fa640 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fd724003ea0 con 0x7fd8540a5040 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.933+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify_complete (2) cookie 94457757673760 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd84c02fa00 con 0x7fd8540a5040 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.934+0000 7fd7137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:27.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.934+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94457757419584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x55e8a912cfd0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.935+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94457757419584] v35'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.935+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94457757397088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x7fd85c014070 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.936+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94457757397088] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.936+0000 7fd86410c800 20 remove_watcher() i=0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.936+0000 7fd86410c800 2 removed watcher, disabling cache 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.936+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94457757404352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x55e8a912cfd0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.937+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94457757404352] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.937+0000 7fd86410c800 20 remove_watcher() i=1 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.937+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94457757406608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x55e8a91319c0 2024-09-14T10:55:27.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.938+0000 7fd8623f7640 1 -- 172.21.15.164:0/197120490 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94457757406608] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85c063040 con 0x55e8a91319c0 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.938+0000 7fd86410c800 20 remove_watcher() i=2 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.938+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94457757409840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x7fd85c014070 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.939+0000 7fd861bf6640 1 -- 172.21.15.164:0/197120490 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94457757409840] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd85407a030 con 0x7fd85c014070 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.939+0000 7fd86410c800 20 remove_watcher() i=3 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.939+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94457757413888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x55e8a912cfd0 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.940+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94457757413888] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55e8a912cfd0 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.940+0000 7fd86410c800 20 remove_watcher() i=4 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.940+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94457757417488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x7fd8540a5040 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.941+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94457757417488] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.941+0000 7fd86410c800 20 remove_watcher() i=5 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.941+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94457757411584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x7fd8540a5040 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.942+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94457757411584] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.942+0000 7fd86410c800 20 remove_watcher() i=6 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.942+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94457757422720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e8a9171ec0 con 0x7fd8540a5040 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94457757422720] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd8540a5040 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 20 remove_watcher() i=7 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd8540a5040 msgr2=0x7fd85407c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd8540a5040 0x7fd85407c3b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a912cfd0 msgr2=0x55e8a912f490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a912cfd0 0x55e8a912f490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd85c014070 msgr2=0x7fd85c02c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd85c014070 0x7fd85c02c3e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a91319c0 msgr2=0x55e8a9133db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a91319c0 0x55e8a9133db0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd72c03ce10 msgr2=0x7fd72c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd72c03ce10 0x7fd72c03f2d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd854053da0 tx=0x7fd85408f000 comp rx=0 tx=0).stop 2024-09-14T10:55:27.950 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 msgr2=0x55e8a8ff8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd8593f5640 1 -- 172.21.15.164:0/197120490 reap_dead start 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd85c049040 tx=0x7fd85c02b4c0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 shutdown_connections 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/197120490 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a91179e0 0x55e8a8ff8bb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 >> 172.21.15.164:0/197120490 conn(0x55e8a9113de0 msgr2=0x55e8a9111ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 shutdown_connections 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/197120490 wait complete. 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 msgr2=0x7fd73c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.943+0000 7fd86410c800 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 0x7fd73c03f320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55e8a90f20c0 tx=0x7fd854067e60 comp rx=0 tx=0).stop 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 msgr2=0x55e8a910b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55e8a90f1030 tx=0x7fd85c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:27.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 shutdown_connections 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd73c03ce60 0x7fd73c03f320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/1105279264 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a910af80 0x55e8a910b3a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 >> 172.21.15.164:0/1105279264 conn(0x55e8a90ff330 msgr2=0x55e8a90ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 shutdown_connections 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/1105279264 wait complete. 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 msgr2=0x55e8a90f7680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 0x55e8a90f7680 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 msgr2=0x55e8a90fbe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 0x55e8a90fbe80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 msgr2=0x7fd74803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 0x7fd74803f320 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd84c000c00 tx=0x7fd84c0013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 msgr2=0x55e8a90f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fd85400a470 tx=0x7fd854002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 shutdown_connections 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e8a90f99e0 0x55e8a90fbe80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e8a8ffb9e0 0x55e8a90f7680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd74803ce60 0x7fd74803f320 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 --2- 172.21.15.164:0/3277685276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e8a8f6c7b0 0x55e8a90f0030 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 >> 172.21.15.164:0/3277685276 conn(0x55e8a8ff2fd0 msgr2=0x55e8a90e2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 shutdown_connections 2024-09-14T10:55:27.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:27.944+0000 7fd86410c800 1 -- 172.21.15.164:0/3277685276 wait complete. 2024-09-14T10:55:27.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '4d2cef0f-8511-4251-8070-7385f93096af.4241.1'] 2024-09-14T10:55:27.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '4d2cef0f-8511-4251-8070-7385f93096af.4241.1'] 2024-09-14T10:55:27.954 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:28.003 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.003 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe98d41d800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55f82992d7d0 0x55f8299bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe98d41d800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8299c0740 con 0x55f8299bc9f0 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe98d41d800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55f8298447d0 con 0x55f82992d7d0 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe9803ea640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55f8299bc9f0 0x55f8299beeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38808/0 (socket says 172.21.15.164:38808) 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe9803ea640 1 -- 172.21.15.164:0/2219695447 learned_addr learned my addr 172.21.15.164:0/2219695447 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe988beb640 1 --2- 172.21.15.164:0/2219695447 >> v2:172.21.15.116:3300/0 conn(0x55f82992d7d0 0x55f8299bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.006+0000 7fe983fff640 1 -- 172.21.15.164:0/2219695447 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700720278 0 0) 0x55f8299c0740 con 0x55f8299bc9f0 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.007+0000 7fe983fff640 1 -- 172.21.15.164:0/2219695447 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe974001e10 con 0x55f8299bc9f0 2024-09-14T10:55:28.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.007+0000 7fe988beb640 1 -- 172.21.15.164:0/2219695447 >> v1:172.21.15.116:6789/0 conn(0x55f8299bc9f0 legacy=0x55f8299beeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.007+0000 7fe988beb640 1 -- 172.21.15.164:0/2219695447 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8299c1970 con 0x55f82992d7d0 2024-09-14T10:55:28.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.008+0000 7fe988beb640 1 --2- 172.21.15.164:0/2219695447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f8299bc480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe97800a470 tx=0x7fe978045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783d92f0c3ff903f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe983fff640 1 -- 172.21.15.164:0/2219695447 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978059070 con 0x55f82992d7d0 2024-09-14T10:55:28.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe983fff640 1 -- 172.21.15.164:0/2219695447 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978054570 con 0x55f82992d7d0 2024-09-14T10:55:28.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe983fff640 1 -- 172.21.15.164:0/2219695447 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978054870 con 0x55f82992d7d0 2024-09-14T10:55:28.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 -- 172.21.15.164:0/2219695447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 msgr2=0x55f8299bc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 --2- 172.21.15.164:0/2219695447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f8299bc480 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe97800a470 tx=0x7fe978045920 comp rx=0 tx=0).stop 2024-09-14T10:55:28.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 -- 172.21.15.164:0/2219695447 shutdown_connections 2024-09-14T10:55:28.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 --2- 172.21.15.164:0/2219695447 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f8299bc480 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 -- 172.21.15.164:0/2219695447 >> 172.21.15.164:0/2219695447 conn(0x55f8299b3fd0 msgr2=0x55f8299b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 -- 172.21.15.164:0/2219695447 shutdown_connections 2024-09-14T10:55:28.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.009+0000 7fe98d41d800 1 -- 172.21.15.164:0/2219695447 wait complete. 2024-09-14T10:55:28.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.023+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.023+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.023+0000 7fe98d41d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.023+0000 7fe98d41d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f829851dd0 con 0x55f82992d7d0 2024-09-14T10:55:28.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe988beb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe988beb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34032/0 (socket says 172.21.15.164:34032) 2024-09-14T10:55:28.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe988beb640 1 -- 172.21.15.164:0/717518260 learned_addr learned my addr 172.21.15.164:0/717518260 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe988beb640 1 -- 172.21.15.164:0/717518260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829aa9ce0 con 0x55f82992d7d0 2024-09-14T10:55:28.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe988beb640 1 --2- 172.21.15.164:0/717518260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe97800a470 tx=0x7fe97804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4711c4b4a50cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.024+0000 7fe876e0d640 1 -- 172.21.15.164:0/717518260 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978065070 con 0x55f82992d7d0 2024-09-14T10:55:28.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe876e0d640 1 -- 172.21.15.164:0/717518260 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97805a040 con 0x55f82992d7d0 2024-09-14T10:55:28.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe876e0d640 1 -- 172.21.15.164:0/717518260 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978059070 con 0x55f82992d7d0 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 -- 172.21.15.164:0/717518260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 msgr2=0x55f829aa96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 --2- 172.21.15.164:0/717518260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe97800a470 tx=0x7fe97804e000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 -- 172.21.15.164:0/717518260 shutdown_connections 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 --2- 172.21.15.164:0/717518260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829aa96f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 -- 172.21.15.164:0/717518260 >> 172.21.15.164:0/717518260 conn(0x55f8299b3fd0 msgr2=0x55f829aa5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 -- 172.21.15.164:0/717518260 shutdown_connections 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 -- 172.21.15.164:0/717518260 wait complete. 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.025+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe98d41d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe98d41d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f8299c0c10 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe988beb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe988beb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34034/0 (socket says 172.21.15.164:34034) 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe988beb640 1 -- 172.21.15.164:0/389721045 learned_addr learned my addr 172.21.15.164:0/389721045 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe988beb640 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829ab1700 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe988beb640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe978025b20 tx=0x7fe978002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe87560a640 1 -- 172.21.15.164:0/389721045 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978071070 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe87560a640 1 -- 172.21.15.164:0/389721045 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978066040 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe87560a640 1 -- 172.21.15.164:0/389721045 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978065050 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.026+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f829ab1990 con 0x55f82992d7d0 2024-09-14T10:55:28.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.027+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f829ab2390 con 0x55f82992d7d0 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe87560a640 1 -- 172.21.15.164:0/389721045 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe978074070 con 0x55f82992d7d0 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe87560a640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 0x7fe87003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe87560a640 1 -- 172.21.15.164:0/389721045 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe978096ea0 con 0x55f82992d7d0 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe9803ea640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 0x7fe87003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 0x55f829ab87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829ab8d30 con 0x55f8299bc9f0 2024-09-14T10:55:28.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe9893ec640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 0x55f829ab87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe9803ea640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 0x7fe87003f2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe970001db0 tx=0x7fe970001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.028+0000 7fe9893ec640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 0x55f829ab87f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe9893ec640 1 -- 172.21.15.164:0/389721045 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe98400a4d0 con 0x55f8299bc9f0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829ab90d0 con 0x55f8299bc9f0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe9893ec640 1 -- 172.21.15.164:0/389721045 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe98400a4d0 con 0x55f8299bc9f0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 0x55f829abd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829abd7e0 con 0x55f829ababd0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe988beb640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 0x55f829abd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.029+0000 7fe988beb640 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 0x55f829abd050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe988beb640 1 -- 172.21.15.164:0/389721045 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe978073030 con 0x55f829ababd0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829ab9920 con 0x55f8299bc9f0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe9893ec640 1 -- 172.21.15.164:0/389721045 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe98400a4d0 con 0x55f8299bc9f0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829ab9d70 con 0x55f8299bc9f0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe9893ec640 1 -- 172.21.15.164:0/389721045 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe98400a4d0 con 0x55f8299bc9f0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.030+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe98d41d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe98d41d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f8298b04a0 con 0x55f829acc1c0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34048/0 (socket says 172.21.15.164:34048) 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe9893ec640 1 -- 172.21.15.164:0/514919575 learned_addr learned my addr 172.21.15.164:0/514919575 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe9893ec640 1 -- 172.21.15.164:0/514919575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829accc20 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe9893ec640 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe98400a2a0 tx=0x7fe984018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe86e7fc640 1 -- 172.21.15.164:0/514919575 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984014450 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe86e7fc640 1 -- 172.21.15.164:0/514919575 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840145f0 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe86e7fc640 1 -- 172.21.15.164:0/514919575 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984014910 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.031+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f829acd450 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.032+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f829acd9f0 con 0x55f829acc1c0 2024-09-14T10:55:28.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.032+0000 7fe86e7fc640 1 -- 172.21.15.164:0/514919575 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe984011040 con 0x55f829acc1c0 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe86e7fc640 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 0x7fe86003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe86e7fc640 1 -- 172.21.15.164:0/514919575 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe98401e070 con 0x55f829acc1c0 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe988beb640 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 0x7fe86003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe988beb640 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 0x7fe86003f2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55f829ab3290 tx=0x7fe97806a5f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe98d41d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe98d41d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f829aaa050 con 0x55f829ad8c40 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34050/0 (socket says 172.21.15.164:34050) 2024-09-14T10:55:28.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.033+0000 7fe9893ec640 1 -- 172.21.15.164:0/1276416975 learned_addr learned my addr 172.21.15.164:0/1276416975 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe9893ec640 1 -- 172.21.15.164:0/1276416975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829ad9630 con 0x55f829ad8c40 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe9893ec640 1 --2- 172.21.15.164:0/1276416975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9840545f0 tx=0x7fe984001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde42745240fc128 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe85ffff640 1 -- 172.21.15.164:0/1276416975 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98404b070 con 0x55f829ad8c40 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe85ffff640 1 -- 172.21.15.164:0/1276416975 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe984051070 con 0x55f829ad8c40 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe85ffff640 1 -- 172.21.15.164:0/1276416975 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9840167c0 con 0x55f829ad8c40 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 -- 172.21.15.164:0/1276416975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 msgr2=0x55f829ad9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 --2- 172.21.15.164:0/1276416975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9840545f0 tx=0x7fe984001440 comp rx=0 tx=0).stop 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 -- 172.21.15.164:0/1276416975 shutdown_connections 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 --2- 172.21.15.164:0/1276416975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ad9040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 -- 172.21.15.164:0/1276416975 >> 172.21.15.164:0/1276416975 conn(0x55f829ad5040 msgr2=0x55f829ad3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 -- 172.21.15.164:0/1276416975 shutdown_connections 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.034+0000 7fe98d41d800 1 -- 172.21.15.164:0/1276416975 wait complete. 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe98d41d800 1 Processor -- start 2024-09-14T10:55:28.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe98d41d800 1 -- start start 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe98d41d800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe98d41d800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55f829ad9c50 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe9893ec640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34056/0 (socket says 172.21.15.164:34056) 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 learned_addr learned my addr 172.21.15.164:0/153781655 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f829ae07a0 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe9893ec640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe984018430 tx=0x7fe984022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe85e7fc640 1 -- 172.21.15.164:0/153781655 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98404b030 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe85e7fc640 1 -- 172.21.15.164:0/153781655 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe984016440 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.035+0000 7fe85e7fc640 1 -- 172.21.15.164:0/153781655 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9840458f0 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.036+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f829ae0a30 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.036+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f829ae13b0 con 0x55f829ad8c40 2024-09-14T10:55:28.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.036+0000 7fe85e7fc640 1 -- 172.21.15.164:0/153781655 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe984045a90 con 0x55f829ad8c40 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.036+0000 7fe85e7fc640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe85403ce10 0x7fe85403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe85e7fc640 1 -- 172.21.15.164:0/153781655 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe98404c070 con 0x55f829ad8c40 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe988beb640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe85403ce10 0x7fe85403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe988beb640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe85403ce10 0x7fe85403f2d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe97806afd0 tx=0x7fe97807f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f829aebfc0 0x55f829aee480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829aeebd0 con 0x55f829aebfc0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.037+0000 7fe9803ea640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f829aebfc0 0x55f829aee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe9803ea640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f829aebfc0 0x55f829aee480 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe970009050 con 0x55f829aebfc0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 realm 2024-09-14T10:55:28.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829aeb310 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe970009050 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829aef6c0 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe970009050 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.038+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829aeff90 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe970009050 con 0x55f829aebfc0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829af09b0 0x55f829af2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af34e0 con 0x55f829af09b0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829af09b0 0x55f829af2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829af09b0 0x55f829af2da0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 20 searching for the correct realm 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe98404dc20 0x7fe984036440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.039+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe988beb640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe98404dc20 0x7fe984036440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe988beb640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe98404dc20 0x7fe984036440 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe988beb640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe978076060 0x7fe978075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.040+0000 7fe9803ea640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe978076060 0x7fe978075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe978076060 0x7fe978075770 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970009050 con 0x7fe978076060 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970009050 con 0x55f829aebfc0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.041+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.042+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.043+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.044+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.045+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.046+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829af09b0 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.047+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x55f829aebfc0 2024-09-14T10:55:28.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4df0 con 0x7fe98404dc20 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af3ea0 con 0x55f829aebfc0 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af4740 con 0x55f829aebfc0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.048+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af5270 con 0x55f829aebfc0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 zone default found 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 4 Realm: () 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 zonegroup default 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af5610 con 0x7fe978076060 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af74b0 con 0x55f829af09b0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829af78d0 con 0x55f829af09b0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 started sync module instance, tier type = 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.049+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af6940 con 0x7fe98404dc20 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.050+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.050+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94524339612976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af81e0 con 0x7fe98404dc20 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.050+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af8a30 con 0x55f829aebfc0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.052+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.052+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94524339612976] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.052+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94524339619200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af7dd0 con 0x55f829aebfc0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.052+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af9510 con 0x55f829af09b0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.053+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94524339619200] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.053+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.053+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94524339621952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af9510 con 0x55f829af09b0 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.053+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829af9f90 con 0x7fe98404dc20 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.054+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.054+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94524339624608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afa830 con 0x7fe98404dc20 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.054+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afb300 con 0x55f829aebfc0 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.054+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94524339621952] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.055+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.055+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94524339629552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afb6f0 con 0x55f829aebfc0 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.055+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afc130 con 0x7fe978076060 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.055+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94524339624608] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.056+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.056+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94524339633152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afc0f0 con 0x7fe978076060 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.056+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afcb40 con 0x7fe978076060 2024-09-14T10:55:28.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.056+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94524339629552] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.057+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.057+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94524339620256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afcb40 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.057+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afd500 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.057+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94524339633152] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94524339620256] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94524339635856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afd500 con 0x7fe978076060 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=0 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=1 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=2 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=3 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=4 2024-09-14T10:55:28.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=5 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.058+0000 7fe98d41d800 20 add_watcher() i=6 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94524339635856] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe98d41d800 20 add_watcher() i=7 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe98d41d800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829afcb20 con 0x55f829aebfc0 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.059+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94524339638352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829afcb20 con 0x55f829aebfc0 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94524339638352] v35'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe83efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe98d41d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe98d41d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe98d41d800 5 note: GC not initialized 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe83dfe3640 20 reqs_thread_entry: start 2024-09-14T10:55:28.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.060+0000 7fe98d41d800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 20 Filter name: none 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe7af7fe640 20 reqs_thread_entry: start 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829b336c0 con 0x55f829aebfc0 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.061+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829b35650 con 0x7fe98404dc20 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829b36f40 con 0x7fe98404dc20 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.062+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b3b480 con 0x7fe978076060 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.063+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(65 fud.buckets [call] v35'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.063+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b412d0 con 0x7fe98404dc20 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe98d41d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe98d41d800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe98d41d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe98d41d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94524339875504 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829b3b8b0 con 0x7fe978076060 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== watch-notify(notify (1) cookie 94524339635856 notify 150323855367 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fe974001e10 con 0x7fe978076060 2024-09-14T10:55:28.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe85ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94524339635856 notifier 4535 bl.length()=760 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(67 notify.7 [notify cookie 94524339875504 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe85ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe85ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe85ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.064+0000 7fe85ffff640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe84c003ea0 con 0x7fe978076060 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== watch-notify(notify_complete (2) cookie 94524339875504 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe97002d5a0 con 0x7fe978076060 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe98d41d800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe98d41d800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe98d41d800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe98d41d800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:28.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.065+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b36eb0 con 0x7fe98404dc20 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.066+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(69 foo.buckets [call] v35'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.066+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b36eb0 con 0x7fe98404dc20 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe98d41d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe98d41d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe98d41d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94524339875504 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f829b40050 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify (1) cookie 94524339620256 notify 150323855368 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fe97002d8c0 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe85ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94524339620256 notifier 4535 bl.length()=314 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe85ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe85ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(71 notify.6 [notify cookie 94524339875504 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe85ffff640 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe84c003ea0 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.067+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== watch-notify(notify_complete (2) cookie 94524339875504 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe97002db60 con 0x7fe978076060 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.068+0000 7fe83efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.068+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94524339638352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x55f829aebfc0 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.069+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94524339638352] v35'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.069+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94524339612976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x7fe98404dc20 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.070+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94524339612976] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.070+0000 7fe98d41d800 20 remove_watcher() i=0 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.070+0000 7fe98d41d800 2 removed watcher, disabling cache 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.070+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94524339619200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x55f829aebfc0 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.071+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94524339619200] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.071+0000 7fe98d41d800 20 remove_watcher() i=1 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.071+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94524339621952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x55f829af09b0 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.072+0000 7fe9893ec640 1 -- 172.21.15.164:0/153781655 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94524339621952] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe98402a070 con 0x55f829af09b0 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.072+0000 7fe98d41d800 20 remove_watcher() i=2 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.072+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94524339624608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x7fe98404dc20 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.073+0000 7fe988beb640 1 -- 172.21.15.164:0/153781655 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94524339624608] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe978073030 con 0x7fe98404dc20 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.073+0000 7fe98d41d800 20 remove_watcher() i=3 2024-09-14T10:55:28.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.073+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94524339629552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x55f829aebfc0 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.074+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94524339629552] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x55f829aebfc0 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.074+0000 7fe98d41d800 20 remove_watcher() i=4 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.074+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94524339633152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.075+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94524339633152] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.075+0000 7fe98d41d800 20 remove_watcher() i=5 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.075+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94524339620256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.076+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94524339620256] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.076+0000 7fe98d41d800 20 remove_watcher() i=6 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.076+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94524339635856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f829b31470 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94524339635856] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe970029040 con 0x7fe978076060 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 20 remove_watcher() i=7 2024-09-14T10:55:28.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe978076060 msgr2=0x7fe978075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe978076060 0x7fe978075770 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f829aebfc0 msgr2=0x55f829aee480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f829aebfc0 0x55f829aee480 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe98404dc20 msgr2=0x7fe984036440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe98404dc20 0x7fe984036440 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829af09b0 msgr2=0x55f829af2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829af09b0 0x55f829af2da0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe85403ce10 msgr2=0x7fe85403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe85403ce10 0x7fe85403f2d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe97806afd0 tx=0x7fe97807f000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 msgr2=0x55f829ae0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe9803ea640 1 -- 172.21.15.164:0/153781655 reap_dead start 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe984018430 tx=0x7fe984022f30 comp rx=0 tx=0).stop 2024-09-14T10:55:28.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 shutdown_connections 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 --2- 172.21.15.164:0/153781655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829ad8c40 0x55f829ae0240 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 >> 172.21.15.164:0/153781655 conn(0x55f829ad5040 msgr2=0x55f829ad3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 shutdown_connections 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.077+0000 7fe98d41d800 1 -- 172.21.15.164:0/153781655 wait complete. 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 msgr2=0x7fe86003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 0x7fe86003f2d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55f829ab3290 tx=0x7fe97806a5f0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 msgr2=0x55f829acc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe98400a2a0 tx=0x7fe984018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 shutdown_connections 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe86003ce10 0x7fe86003f2d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/514919575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f829acc1c0 0x55f829acc5e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 >> 172.21.15.164:0/514919575 conn(0x55f829ac0570 msgr2=0x55f829ac0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 shutdown_connections 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/514919575 wait complete. 2024-09-14T10:55:28.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 msgr2=0x55f829ab87f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 0x55f829ab87f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 msgr2=0x55f829abd050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 0x55f829abd050 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 msgr2=0x7fe87003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 0x7fe87003f2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe970001db0 tx=0x7fe970001310 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 msgr2=0x55f829ab11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe978025b20 tx=0x7fe978002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 shutdown_connections 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55f829ababd0 0x55f829abd050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55f8299bc9f0 0x55f829ab87f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe87003ce10 0x7fe87003f2d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 --2- 172.21.15.164:0/389721045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f82992d7d0 0x55f829ab11a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 >> 172.21.15.164:0/389721045 conn(0x55f8299b3fd0 msgr2=0x55f829aaaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 shutdown_connections 2024-09-14T10:55:28.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.078+0000 7fe98d41d800 1 -- 172.21.15.164:0/389721045 wait complete. 2024-09-14T10:55:28.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:28.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-14T10:55:28.089 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-14T10:55:28.133 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.133 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.136+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.136+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b67737800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ca6e1e0830 0x55ca6e26f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b67737800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca6e2736e0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b67737800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55ca6e0f77d0 con 0x55ca6e1e0830 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b6347d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ca6e1e0830 0x55ca6e26f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b5ac7c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55ca6e26f9e0 0x55ca6e271e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38820/0 (socket says 172.21.15.164:38820) 2024-09-14T10:55:28.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/2134422941 learned_addr learned my addr 172.21.15.164:0/2134422941 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b6347d640 1 -- 172.21.15.164:0/2134422941 >> v1:172.21.15.116:6789/0 conn(0x55ca6e26f9e0 legacy=0x55ca6e271e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.137+0000 7f1b6347d640 1 -- 172.21.15.164:0/2134422941 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e274910 con 0x55ca6e1e0830 2024-09-14T10:55:28.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.139+0000 7f1b6347d640 1 --2- 172.21.15.164:0/2134422941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26f3e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a470 tx=0x7f1b54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bce371dcff780a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.139+0000 7f1b62c7c640 1 -- 172.21.15.164:0/2134422941 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54053570 con 0x55ca6e1e0830 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.139+0000 7f1b62c7c640 1 -- 172.21.15.164:0/2134422941 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54058070 con 0x55ca6e1e0830 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.139+0000 7f1b62c7c640 1 -- 172.21.15.164:0/2134422941 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54053880 con 0x55ca6e1e0830 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 -- 172.21.15.164:0/2134422941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 msgr2=0x55ca6e26f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 --2- 172.21.15.164:0/2134422941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26f3e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a470 tx=0x7f1b54045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 -- 172.21.15.164:0/2134422941 shutdown_connections 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 --2- 172.21.15.164:0/2134422941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26f3e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 -- 172.21.15.164:0/2134422941 >> 172.21.15.164:0/2134422941 conn(0x55ca6e266fb0 msgr2=0x55ca6e2693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 -- 172.21.15.164:0/2134422941 shutdown_connections 2024-09-14T10:55:28.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.140+0000 7f1b67737800 1 -- 172.21.15.164:0/2134422941 wait complete. 2024-09-14T10:55:28.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.153+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.153+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b67737800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b67737800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e104dd0 con 0x55ca6e1e0830 2024-09-14T10:55:28.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b6347d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b6347d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34074/0 (socket says 172.21.15.164:34074) 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b6347d640 1 -- 172.21.15.164:0/1552881629 learned_addr learned my addr 172.21.15.164:0/1552881629 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b6347d640 1 -- 172.21.15.164:0/1552881629 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e26d170 con 0x55ca6e1e0830 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.154+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1552881629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b54025c20 tx=0x7f1b54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945dfde87c1bc270 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1a5160a640 1 -- 172.21.15.164:0/1552881629 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54053a20 con 0x55ca6e1e0830 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1a5160a640 1 -- 172.21.15.164:0/1552881629 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54063070 con 0x55ca6e1e0830 2024-09-14T10:55:28.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1a5160a640 1 -- 172.21.15.164:0/1552881629 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54053cf0 con 0x55ca6e1e0830 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 -- 172.21.15.164:0/1552881629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 msgr2=0x55ca6e26cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 --2- 172.21.15.164:0/1552881629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1b54025c20 tx=0x7f1b54051000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 -- 172.21.15.164:0/1552881629 shutdown_connections 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 --2- 172.21.15.164:0/1552881629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e26cb80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 -- 172.21.15.164:0/1552881629 >> 172.21.15.164:0/1552881629 conn(0x55ca6e266fb0 msgr2=0x55ca6e358130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 -- 172.21.15.164:0/1552881629 shutdown_connections 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.155+0000 7f1b67737800 1 -- 172.21.15.164:0/1552881629 wait complete. 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b67737800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b67737800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e273bb0 con 0x55ca6e1e0830 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b6347d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b6347d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34090/0 (socket says 172.21.15.164:34090) 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b6347d640 1 -- 172.21.15.164:0/70477293 learned_addr learned my addr 172.21.15.164:0/70477293 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b6347d640 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e3669d0 con 0x55ca6e1e0830 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.156+0000 7f1b6347d640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1b54025c20 tx=0x7f1b54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1a4fe07640 1 -- 172.21.15.164:0/70477293 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54068660 con 0x55ca6e1e0830 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1a4fe07640 1 -- 172.21.15.164:0/70477293 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54068800 con 0x55ca6e1e0830 2024-09-14T10:55:28.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e366c60 con 0x55ca6e1e0830 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1a4fe07640 1 -- 172.21.15.164:0/70477293 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54068ae0 con 0x55ca6e1e0830 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e367870 con 0x55ca6e1e0830 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.157+0000 7f1a4fe07640 1 -- 172.21.15.164:0/70477293 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b54068c80 con 0x55ca6e1e0830 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1a4fe07640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 0x7f1a4803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1a4fe07640 1 -- 172.21.15.164:0/70477293 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b54098c10 con 0x55ca6e1e0830 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 0x7f1a4803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 0x55ca6e36dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e36e000 con 0x55ca6e26f9e0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 0x55ca6e36dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 0x7f1a4803f2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001d70 tx=0x7f1b4c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 0x55ca6e36dac0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.158+0000 7f1b63c7e640 1 -- 172.21.15.164:0/70477293 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b5c00a4d0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e36e3a0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b63c7e640 1 -- 172.21.15.164:0/70477293 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b5c00a4d0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 0x55ca6e372300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e372a90 con 0x55ca6e36fe60 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b6347d640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 0x55ca6e372300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b6347d640 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 0x55ca6e372300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b6347d640 1 -- 172.21.15.164:0/70477293 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b54051070 con 0x55ca6e36fe60 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.159+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e36ebf0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b63c7e640 1 -- 172.21.15.164:0/70477293 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b5c00a4d0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e36efd0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b63c7e640 1 -- 172.21.15.164:0/70477293 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b5c00a4d0 con 0x55ca6e26f9e0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.160+0000 7f1b67737800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b67737800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e1634a0 con 0x55ca6e3814a0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34098/0 (socket says 172.21.15.164:34098) 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b63c7e640 1 -- 172.21.15.164:0/4073761190 learned_addr learned my addr 172.21.15.164:0/4073761190 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b63c7e640 1 -- 172.21.15.164:0/4073761190 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e381f00 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55ca6e367470 tx=0x7f1b5c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1a4d602640 1 -- 172.21.15.164:0/4073761190 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c014450 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1a4d602640 1 -- 172.21.15.164:0/4073761190 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c014610 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e382730 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1a4d602640 1 -- 172.21.15.164:0/4073761190 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c014930 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.161+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e382cd0 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.162+0000 7f1a4d602640 1 -- 172.21.15.164:0/4073761190 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b5c011040 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.162+0000 7f1a4d602640 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 0x7f1a3c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.162+0000 7f1a4d602640 1 -- 172.21.15.164:0/4073761190 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b5c01e070 con 0x55ca6e3814a0 2024-09-14T10:55:28.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.162+0000 7f1b6347d640 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 0x7f1a3c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b6347d640 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 0x7f1a3c03f2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55ca6e368540 tx=0x7f1b5405d660 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b67737800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b67737800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e26b590 con 0x55ca6e38df40 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34106/0 (socket says 172.21.15.164:34106) 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b63c7e640 1 -- 172.21.15.164:0/970927377 learned_addr learned my addr 172.21.15.164:0/970927377 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b63c7e640 1 -- 172.21.15.164:0/970927377 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e38e930 con 0x55ca6e38df40 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.163+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/970927377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c016fd0 tx=0x7f1b5c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932934519fb1368d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1a46ffd640 1 -- 172.21.15.164:0/970927377 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c04b070 con 0x55ca6e38df40 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1a46ffd640 1 -- 172.21.15.164:0/970927377 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c051070 con 0x55ca6e38df40 2024-09-14T10:55:28.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1a46ffd640 1 -- 172.21.15.164:0/970927377 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c045510 con 0x55ca6e38df40 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- 172.21.15.164:0/970927377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 msgr2=0x55ca6e38e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 --2- 172.21.15.164:0/970927377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c016fd0 tx=0x7f1b5c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- 172.21.15.164:0/970927377 shutdown_connections 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 --2- 172.21.15.164:0/970927377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e38e340 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- 172.21.15.164:0/970927377 >> 172.21.15.164:0/970927377 conn(0x55ca6e38a340 msgr2=0x55ca6e388580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- 172.21.15.164:0/970927377 shutdown_connections 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- 172.21.15.164:0/970927377 wait complete. 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 Processor -- start 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- start start 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e395540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.164+0000 7f1b67737800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ca6e38ef50 con 0x55ca6e38df40 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e395540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b63c7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e395540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34112/0 (socket says 172.21.15.164:34112) 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 learned_addr learned my addr 172.21.15.164:0/1606396980 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca6e395aa0 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e395540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c049040 tx=0x7f1b5c054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1a457fa640 1 -- 172.21.15.164:0/1606396980 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c04b030 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1a457fa640 1 -- 172.21.15.164:0/1606396980 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c031030 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca6e395d30 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1a457fa640 1 -- 172.21.15.164:0/1606396980 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c011330 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.165+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca6e3966b0 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.166+0000 7f1a457fa640 1 -- 172.21.15.164:0/1606396980 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b5c014ad0 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.166+0000 7f1a457fa640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a2c03ce10 0x7f1a2c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.166+0000 7f1a457fa640 1 -- 172.21.15.164:0/1606396980 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f1b5c04c070 con 0x55ca6e38df40 2024-09-14T10:55:28.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.166+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a2c03ce10 0x7f1a2c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a2c03ce10 0x7f1a2c03f2d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b5405d6f0 tx=0x7f1b54082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e3a12b0 0x55ca6e3a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a3ec0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e3a12b0 0x55ca6e3a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.167+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e3a12b0 0x55ca6e3a3770 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b4c009050 con 0x55ca6e3a12b0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 realm 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a0600 con 0x55ca6e3a12b0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b4c009050 con 0x55ca6e3a12b0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a49b0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b4c009050 con 0x55ca6e3a12b0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a5280 con 0x55ca6e3a12b0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b4c009050 con 0x55ca6e3a12b0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e3a5ca0 0x55ca6e3a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.168+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a87d0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e3a5ca0 0x55ca6e3a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e3a5ca0 0x55ca6e3a8090 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b67737800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b67737800 20 searching for the correct realm 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b5c014070 0x7f1b5c02d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.169+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b5c014070 0x7f1b5c02d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.170+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b5c014070 0x7f1b5c02d450 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.170+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.170+0000 7f1b6347d640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1b5405f040 0x7f1b54074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.170+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.170+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1b5405f040 0x7f1b54074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1b5405f040 0x7f1b54074480 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c009050 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c009050 con 0x55ca6e3a12b0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.171+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.172+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.173+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.174+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.175+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.176+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5405f040 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa0c0 con 0x7f1b5c014070 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.177+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a91c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3a9a10 con 0x55ca6e3a12b0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa540 con 0x55ca6e3a12b0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 zone default found 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 4 Realm: () 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 zonegroup default 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3aa8e0 con 0x7f1b5405f040 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.178+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ac6c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3acba0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 20 started sync module instance, tier type = 2024-09-14T10:55:28.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.179+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3abb60 con 0x7f1b5c014070 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.180+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.180+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327921096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ad000 con 0x7f1b5c014070 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.180+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ad850 con 0x55ca6e3a12b0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.181+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327921096368] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.181+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.181+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327921103776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3adc70 con 0x55ca6e3a12b0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.181+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ae540 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.182+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327921103776] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.182+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.182+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327921104832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ae090 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.182+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3af000 con 0x7f1b5c014070 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.183+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327921104832] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.184+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.184+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327921109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ae090 con 0x7f1b5c014070 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.184+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3afa90 con 0x55ca6e3a12b0 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.185+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.185+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327921109712] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.185+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327921112416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ae090 con 0x55ca6e3a12b0 2024-09-14T10:55:28.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.185+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b0500 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.186+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.186+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327921112416] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.186+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327921115120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b04c0 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.186+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3adbe0 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.187+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327921115120] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.187+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.187+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327921105888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b0f70 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.187+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b1930 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327921105888] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327921117216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b1930 con 0x7f1b5405f040 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=0 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=1 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=2 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=3 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=4 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=5 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.188+0000 7f1b67737800 20 add_watcher() i=6 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327921117216] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b67737800 20 add_watcher() i=7 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b67737800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b4c90 con 0x55ca6e3a12b0 2024-09-14T10:55:28.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.189+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327921120752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3b1ec0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.190+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327921120752] v35'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.190+0000 7f1a19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.190+0000 7f1b67737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.190+0000 7f1b67737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.190+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bd6b0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.191+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.191+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bdce0 con 0x7f1b5405f040 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.192+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.192+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3be140 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.193+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.193+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3be120 con 0x55ca6e3a12b0 2024-09-14T10:55:28.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.194+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'122 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.194+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3be790 con 0x7f1b5c014070 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.195+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.195+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bec40 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.196+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.196+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bec40 con 0x55ca6e3a12b0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.197+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.197+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bec40 con 0x7f1b5405f040 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.198+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.198+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bebf0 con 0x7f1b5c014070 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.199+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.199+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bec10 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.200+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.200+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3becd0 con 0x7f1b5c014070 2024-09-14T10:55:28.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.201+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.201+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bee00 con 0x7f1b5405f040 2024-09-14T10:55:28.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.202+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.202+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf1e0 con 0x7f1b5c014070 2024-09-14T10:55:28.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.203+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.203+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3befc0 con 0x7f1b5405f040 2024-09-14T10:55:28.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.204+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.204+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3befc0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.205+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.205+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3befc0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.206+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.206+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf080 con 0x7f1b5c014070 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.207+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.207+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf080 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.208+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.208+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf090 con 0x55ca6e3a12b0 2024-09-14T10:55:28.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.209+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.209+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf090 con 0x55ca6e3a12b0 2024-09-14T10:55:28.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.210+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'124 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.210+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf090 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.211+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'30 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.211+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf0d0 con 0x7f1b5c014070 2024-09-14T10:55:28.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.212+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.212+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf110 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.213+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.213+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf150 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.214+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.214+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf190 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.215+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.215+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf190 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.216+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.216+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf1d0 con 0x7f1b5405f040 2024-09-14T10:55:28.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.217+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.217+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf210 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.218+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.218+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf210 con 0x7f1b5405f040 2024-09-14T10:55:28.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.219+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.219+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf210 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.220+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.220+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf210 con 0x7f1b5405f040 2024-09-14T10:55:28.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.221+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.221+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3bf250 con 0x7f1b5c014070 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1a18fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b67737800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b67737800 20 Filter name: none 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f19927fc640 20 reqs_thread_entry: start 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b67737800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:55:28.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b67737800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.222+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ea170 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec6f0 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.223+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ea700 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b67737800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:28.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94327921353440 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ebfd0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== watch-notify(notify (1) cookie 94327921104832 notify 150323855369 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ca6e3be120 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1a46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94327921104832 notifier 4542 bl.length()=170 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(97 notify.2 [notify cookie 94327921353440 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1a46ffd640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1a28003d60 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.224+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== watch-notify(notify_complete (2) cookie 94327921353440 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ca6e395d30 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b67737800 10 removing email index: 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b67737800 10 removing user buckets index 2024-09-14T10:55:28.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ea2b0 con 0x7f1b5405f040 2024-09-14T10:55:28.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(99 fud.buckets [delete] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.225+0000 7f1b67737800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-14T10:55:28.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94327921353392 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ebb20 con 0x7f1b5405f040 2024-09-14T10:55:28.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== watch-notify(notify (1) cookie 94327921105888 notify 150323855369 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ca6e3bdcc0 con 0x7f1b5405f040 2024-09-14T10:55:28.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1a46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94327921105888 notifier 4542 bl.length()=160 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(100 notify.6 [notify cookie 94327921353392 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1a46ffd640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1a28003d60 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== watch-notify(notify_complete (2) cookie 94327921353392 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ca6e3966b0 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b67737800 10 removing user index: fud 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.226+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ea2b0 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(102 fud [call,call,delete] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b67737800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b67737800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94327921353392 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== watch-notify(notify (1) cookie 94327921115120 notify 150323855370 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ca6e3966b0 con 0x7f1b5405f040 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1a467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94327921115120 notifier 4542 bl.length()=152 2024-09-14T10:55:28.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(103 notify.5 [notify cookie 94327921353392 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.227+0000 7f1a467fc640 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f19980032c0 con 0x7f1b5405f040 2024-09-14T10:55:28.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.228+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== watch-notify(notify_complete (2) cookie 94327921353392 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ca6e3bd880 con 0x7f1b5405f040 2024-09-14T10:55:28.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.228+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.228+0000 7f1a19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.228+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327921120752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.229+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94327921120752] v35'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.229+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327921096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5c014070 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.230+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94327921096368] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.230+0000 7f1b67737800 20 remove_watcher() i=0 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.230+0000 7f1b67737800 2 removed watcher, disabling cache 2024-09-14T10:55:28.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.230+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327921103776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.232+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94327921103776] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.232+0000 7f1b67737800 20 remove_watcher() i=1 2024-09-14T10:55:28.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.232+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327921104832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.233+0000 7f1b63c7e640 1 -- 172.21.15.164:0/1606396980 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94327921104832] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b5c02a070 con 0x55ca6e3a5ca0 2024-09-14T10:55:28.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.233+0000 7f1b67737800 20 remove_watcher() i=2 2024-09-14T10:55:28.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.233+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327921109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5c014070 2024-09-14T10:55:28.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.234+0000 7f1b6347d640 1 -- 172.21.15.164:0/1606396980 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94327921109712] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b54051070 con 0x7f1b5c014070 2024-09-14T10:55:28.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.234+0000 7f1b67737800 20 remove_watcher() i=3 2024-09-14T10:55:28.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.234+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327921112416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x55ca6e3a12b0 2024-09-14T10:55:28.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.235+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94327921112416] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x55ca6e3a12b0 2024-09-14T10:55:28.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.235+0000 7f1b67737800 20 remove_watcher() i=4 2024-09-14T10:55:28.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.235+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327921115120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5405f040 2024-09-14T10:55:28.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.236+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94327921115120] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.236+0000 7f1b67737800 20 remove_watcher() i=5 2024-09-14T10:55:28.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.236+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327921105888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5405f040 2024-09-14T10:55:28.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.237+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94327921105888] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.237+0000 7f1b67737800 20 remove_watcher() i=6 2024-09-14T10:55:28.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.237+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327921117216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55ca6e3ec3c0 con 0x7f1b5405f040 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94327921117216] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c029040 con 0x7f1b5405f040 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 20 remove_watcher() i=7 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1b5405f040 msgr2=0x7f1b54074480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1b5405f040 0x7f1b54074480 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e3a12b0 msgr2=0x55ca6e3a3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e3a12b0 0x55ca6e3a3770 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b5c014070 msgr2=0x7f1b5c02d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b5c014070 0x7f1b5c02d450 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e3a5ca0 msgr2=0x55ca6e3a8090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e3a5ca0 0x55ca6e3a8090 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a2c03ce10 msgr2=0x7f1a2c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a2c03ce10 0x7f1a2c03f2d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b5405d6f0 tx=0x7f1b54082000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 msgr2=0x55ca6e395540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/1606396980 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e38df40 0x55ca6e395540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c049040 tx=0x7f1b5c054530 comp rx=0 tx=0).stop 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 reap_dead start 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b5ac7c640 1 -- 172.21.15.164:0/1606396980 reap_dead start 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 shutdown_connections 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 >> 172.21.15.164:0/1606396980 conn(0x55ca6e38a340 msgr2=0x55ca6e388550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 shutdown_connections 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/1606396980 wait complete. 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 msgr2=0x7f1a3c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 0x7f1a3c03f2d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55ca6e368540 tx=0x7f1b5405d660 comp rx=0 tx=0).stop 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 msgr2=0x55ca6e3818c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x55ca6e367470 tx=0x7f1b5c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 shutdown_connections 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3c03ce10 0x7f1a3c03f2d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 --2- 172.21.15.164:0/4073761190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e3814a0 0x55ca6e3818c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 >> 172.21.15.164:0/4073761190 conn(0x55ca6e375850 msgr2=0x55ca6e375c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 shutdown_connections 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.238+0000 7f1b67737800 1 -- 172.21.15.164:0/4073761190 wait complete. 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 msgr2=0x55ca6e36dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 0x55ca6e36dac0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 msgr2=0x55ca6e372300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 0x55ca6e372300 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 msgr2=0x7f1a4803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 0x7f1a4803f2d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001d70 tx=0x7f1b4c0012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 msgr2=0x55ca6e366470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1b54025c20 tx=0x7f1b54002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 shutdown_connections 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ca6e36fe60 0x55ca6e372300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ca6e26f9e0 0x55ca6e36dac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4803ce10 0x7f1a4803f2d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 --2- 172.21.15.164:0/70477293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca6e1e0830 0x55ca6e366470 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 >> 172.21.15.164:0/70477293 conn(0x55ca6e266fb0 msgr2=0x55ca6e357c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 shutdown_connections 2024-09-14T10:55:28.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.239+0000 7f1b67737800 1 -- 172.21.15.164:0/70477293 wait complete. 2024-09-14T10:55:28.245 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:55:28.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-14T10:55:28.246 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-14T10:55:28.300 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.301 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.303+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc328736800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e7035fec70 0x55e7036010c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc328736800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e703601740 con 0x55e70356df50 2024-09-14T10:55:28.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc328736800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e7034857d0 con 0x55e7035fec70 2024-09-14T10:55:28.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc323cb6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e7035fec70 0x55e7036010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc3244b7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55e70356df50 0x55e7035fd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38834/0 (socket says 172.21.15.164:38834) 2024-09-14T10:55:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc323cb6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e7035fec70 0x55e7036010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34120/0 (socket says 172.21.15.164:34120) 2024-09-14T10:55:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc3244b7640 1 -- 172.21.15.164:0/3922268930 learned_addr learned my addr 172.21.15.164:0/3922268930 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc323cb6640 1 -- 172.21.15.164:0/3922268930 >> v1:172.21.15.116:6789/0 conn(0x55e70356df50 legacy=0x55e7035fd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.304+0000 7fc323cb6640 1 -- 172.21.15.164:0/3922268930 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e703602970 con 0x55e7035fec70 2024-09-14T10:55:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.306+0000 7fc323cb6640 1 --2- 172.21.15.164:0/3922268930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7035fec70 0x55e7036010c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00a470 tx=0x7fc30c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a457431228c5b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.306+0000 7fc3234b5640 1 -- 172.21.15.164:0/3922268930 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c053570 con 0x55e7035fec70 2024-09-14T10:55:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.306+0000 7fc3234b5640 1 -- 172.21.15.164:0/3922268930 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c058070 con 0x55e7035fec70 2024-09-14T10:55:28.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.306+0000 7fc3234b5640 1 -- 172.21.15.164:0/3922268930 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc30c053880 con 0x55e7035fec70 2024-09-14T10:55:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 -- 172.21.15.164:0/3922268930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7035fec70 msgr2=0x55e7036010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 --2- 172.21.15.164:0/3922268930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7035fec70 0x55e7036010c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00a470 tx=0x7fc30c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 -- 172.21.15.164:0/3922268930 shutdown_connections 2024-09-14T10:55:28.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 --2- 172.21.15.164:0/3922268930 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e7035fec70 0x55e7036010c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 -- 172.21.15.164:0/3922268930 >> 172.21.15.164:0/3922268930 conn(0x55e7035f4fe0 msgr2=0x55e7035f7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 -- 172.21.15.164:0/3922268930 shutdown_connections 2024-09-14T10:55:28.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.307+0000 7fc328736800 1 -- 172.21.15.164:0/3922268930 wait complete. 2024-09-14T10:55:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.320+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc328736800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc328736800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e703492dd0 con 0x55e70356df50 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc3244b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc3244b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34136/0 (socket says 172.21.15.164:34136) 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc3244b7640 1 -- 172.21.15.164:0/642056758 learned_addr learned my addr 172.21.15.164:0/642056758 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc3244b7640 1 -- 172.21.15.164:0/642056758 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7036eaf00 con 0x55e70356df50 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.321+0000 7fc3244b7640 1 --2- 172.21.15.164:0/642056758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001e40 tx=0x7fc31c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f35971571cf14f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc21260c640 1 -- 172.21.15.164:0/642056758 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c012020 con 0x55e70356df50 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc21260c640 1 -- 172.21.15.164:0/642056758 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c00e5a0 con 0x55e70356df50 2024-09-14T10:55:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc21260c640 1 -- 172.21.15.164:0/642056758 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c00e8a0 con 0x55e70356df50 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 -- 172.21.15.164:0/642056758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 msgr2=0x55e7036ea910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 --2- 172.21.15.164:0/642056758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc31c001e40 tx=0x7fc31c001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 -- 172.21.15.164:0/642056758 shutdown_connections 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 --2- 172.21.15.164:0/642056758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036ea910 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 -- 172.21.15.164:0/642056758 >> 172.21.15.164:0/642056758 conn(0x55e7035f4fe0 msgr2=0x55e7036e6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 -- 172.21.15.164:0/642056758 shutdown_connections 2024-09-14T10:55:28.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.322+0000 7fc328736800 1 -- 172.21.15.164:0/642056758 wait complete. 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc328736800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc328736800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e703601c10 con 0x55e70356df50 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc3244b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc3244b7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34152/0 (socket says 172.21.15.164:34152) 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc3244b7640 1 -- 172.21.15.164:0/4066907342 learned_addr learned my addr 172.21.15.164:0/4066907342 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.323+0000 7fc3244b7640 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7036f29c0 con 0x55e70356df50 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc3244b7640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c010 tx=0x7fc31c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc210e09640 1 -- 172.21.15.164:0/4066907342 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c012030 con 0x55e70356df50 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc210e09640 1 -- 172.21.15.164:0/4066907342 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c0014a0 con 0x55e70356df50 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e7036f2c50 con 0x55e70356df50 2024-09-14T10:55:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc210e09640 1 -- 172.21.15.164:0/4066907342 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31c01a7a0 con 0x55e70356df50 2024-09-14T10:55:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.324+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7036f3650 con 0x55e70356df50 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc210e09640 1 -- 172.21.15.164:0/4066907342 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc31c015020 con 0x55e70356df50 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc210e09640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 0x7fc20c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc210e09640 1 -- 172.21.15.164:0/4066907342 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc31c020030 con 0x55e70356df50 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc323cb6640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 0x7fc20c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 0x55e7036f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7036f41c0 con 0x55e7035fec70 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc324cb8640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 0x55e7036f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.325+0000 7fc323cb6640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 0x7fc20c03f320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc30c057000 tx=0x7fc30c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc324cb8640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 0x55e7036f9ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc324cb8640 1 -- 172.21.15.164:0/4066907342 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc31400a4d0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7036f3ae0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc324cb8640 1 -- 172.21.15.164:0/4066907342 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc31400a4d0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 0x55e7036fe310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7036fe9e0 con 0x55e7036fbf20 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc3244b7640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 0x55e7036fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.326+0000 7fc3244b7640 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 0x55e7036fe310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.327+0000 7fc3244b7640 1 -- 172.21.15.164:0/4066907342 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc31c0187b0 con 0x55e7036fbf20 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.327+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7036fadc0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.327+0000 7fc324cb8640 1 -- 172.21.15.164:0/4066907342 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc31400a4d0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.327+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7036fb260 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.327+0000 7fc324cb8640 1 -- 172.21.15.164:0/4066907342 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc31400a4d0 con 0x55e7035fec70 2024-09-14T10:55:28.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc328736800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc328736800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7034f14a0 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34154/0 (socket says 172.21.15.164:34154) 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc324cb8640 1 -- 172.21.15.164:0/3101854613 learned_addr learned my addr 172.21.15.164:0/3101854613 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc324cb8640 1 -- 172.21.15.164:0/3101854613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e70370de20 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.328+0000 7fc324cb8640 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55e7036f9ff0 tx=0x7fc314018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc209ffb640 1 -- 172.21.15.164:0/3101854613 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314014450 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc209ffb640 1 -- 172.21.15.164:0/3101854613 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3140145f0 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc209ffb640 1 -- 172.21.15.164:0/3101854613 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314014910 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e70370e650 con 0x55e70370d3c0 2024-09-14T10:55:28.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e70370ebf0 con 0x55e70370d3c0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.329+0000 7fc209ffb640 1 -- 172.21.15.164:0/3101854613 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc314011040 con 0x55e70370d3c0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc209ffb640 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 0x7fc1fc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc209ffb640 1 -- 172.21.15.164:0/3101854613 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc31401e070 con 0x55e70370d3c0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc3244b7640 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 0x7fc1fc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc3244b7640 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 0x7fc1fc03f2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55e7036fa090 tx=0x7fc31c052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc328736800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.330+0000 7fc328736800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e7036eb330 con 0x55e703719e80 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34160/0 (socket says 172.21.15.164:34160) 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc324cb8640 1 -- 172.21.15.164:0/3703084665 learned_addr learned my addr 172.21.15.164:0/3703084665 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc324cb8640 1 -- 172.21.15.164:0/3703084665 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e70371a850 con 0x55e703719e80 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc324cb8640 1 --2- 172.21.15.164:0/3703084665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc314016fd0 tx=0x7fc314011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3a1f2670bf7d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc1fb7fe640 1 -- 172.21.15.164:0/3703084665 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31404b070 con 0x55e703719e80 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc1fb7fe640 1 -- 172.21.15.164:0/3703084665 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314051070 con 0x55e703719e80 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.331+0000 7fc1fb7fe640 1 -- 172.21.15.164:0/3703084665 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314011d50 con 0x55e703719e80 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- 172.21.15.164:0/3703084665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 msgr2=0x55e70371a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 --2- 172.21.15.164:0/3703084665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc314016fd0 tx=0x7fc314011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- 172.21.15.164:0/3703084665 shutdown_connections 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 --2- 172.21.15.164:0/3703084665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e70371a260 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- 172.21.15.164:0/3703084665 >> 172.21.15.164:0/3703084665 conn(0x55e703716280 msgr2=0x55e7037144c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- 172.21.15.164:0/3703084665 shutdown_connections 2024-09-14T10:55:28.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- 172.21.15.164:0/3703084665 wait complete. 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 Processor -- start 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- start start 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e703721460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc328736800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e70371ae90 con 0x55e703719e80 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e703721460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc324cb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e703721460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34168/0 (socket says 172.21.15.164:34168) 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.332+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 learned_addr learned my addr 172.21.15.164:0/1839874786 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7037219c0 con 0x55e703719e80 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc324cb8640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e703721460 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc314014fa0 tx=0x7fc314054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc1f9ffb640 1 -- 172.21.15.164:0/1839874786 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc31404b030 con 0x55e703719e80 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e703721c50 con 0x55e703719e80 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc1f9ffb640 1 -- 172.21.15.164:0/1839874786 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3140547d0 con 0x55e703719e80 2024-09-14T10:55:28.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc1f9ffb640 1 -- 172.21.15.164:0/1839874786 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc314011460 con 0x55e703719e80 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.333+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7037227e0 con 0x55e703719e80 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.334+0000 7fc1f9ffb640 1 -- 172.21.15.164:0/1839874786 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc3140457a0 con 0x55e703719e80 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.334+0000 7fc1f9ffb640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ec03ce10 0x7fc1ec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.334+0000 7fc1f9ffb640 1 -- 172.21.15.164:0/1839874786 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fc31404c070 con 0x55e703719e80 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.334+0000 7fc3244b7640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ec03ce10 0x7fc1ec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.334+0000 7fc3244b7640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ec03ce10 0x7fc1ec03f2d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc31c018ac0 tx=0x7fc31c048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e70372d1a0 0x55e70372f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e70372fdb0 con 0x55e70372d1a0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc323cb6640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e70372d1a0 0x55e70372f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc323cb6640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e70372d1a0 0x55e70372f660 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 20 realm 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.335+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037301e0 con 0x55e70372d1a0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703730ab0 con 0x55e70372d1a0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703730e50 con 0x55e70372d1a0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e703731bb0 0x55e703733fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037345b0 con 0x55e703731bb0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.336+0000 7fc324cb8640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e703731bb0 0x55e703733fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc324cb8640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e703731bb0 0x55e703733fa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc328736800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc328736800 20 searching for the correct realm 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc324cb8640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc314058040 0x7fc314045150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc3244b7640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc314058040 0x7fc314045150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.337+0000 7fc3244b7640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc314058040 0x7fc314045150 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.338+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.338+0000 7fc3244b7640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc31c017050 0x7fc31c04b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.338+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.338+0000 7fc323cb6640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc31c017050 0x7fc31c04b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.338+0000 7fc323cb6640 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc31c017050 0x7fc31c04b640 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.339+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.340+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.341+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.342+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.343+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.344+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e703731bb0 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc31c017050 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.345+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x55e70372d1a0 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e703735ea0 con 0x7fc314058040 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703734f70 con 0x55e70372d1a0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037357c0 con 0x55e70372d1a0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.346+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703736320 con 0x55e70372d1a0 2024-09-14T10:55:28.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 zone default found 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 4 Realm: () 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 zonegroup default 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037366c0 con 0x7fc31c017050 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037384a0 con 0x55e703731bb0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.347+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703738980 con 0x55e703731bb0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.348+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.348+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.348+0000 7fc328736800 20 started sync module instance, tier type = 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.348+0000 7fc328736800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.348+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703737940 con 0x7fc314058040 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.349+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.349+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94450683706672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7037375a0 con 0x7fc314058040 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.349+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7037398b0 con 0x55e70372d1a0 2024-09-14T10:55:28.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.350+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94450683706672] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.350+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.350+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94450683712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703739cd0 con 0x55e70372d1a0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.350+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373a690 con 0x55e703731bb0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.351+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94450683712512] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.351+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.351+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94450683716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703739cd0 con 0x55e703731bb0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.351+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373b0a0 con 0x7fc314058040 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.352+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94450683716544] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.352+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.352+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94450683718640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373b440 con 0x7fc314058040 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.352+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373bf10 con 0x55e70372d1a0 2024-09-14T10:55:28.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.353+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.353+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94450683722192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373c7b0 con 0x55e70372d1a0 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.353+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373d290 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.353+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94450683718640] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.354+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.354+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94450683722192] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.354+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94450683727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373d290 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.354+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373c300 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.355+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94450683727264] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.356+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.356+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94450683713568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373d7f0 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.356+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373e1b0 con 0x7fc31c017050 2024-09-14T10:55:28.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.356+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94450683713568] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94450683724464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373e1b0 con 0x7fc31c017050 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=0 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=1 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=2 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=3 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=4 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=5 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=6 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94450683724464] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 20 add_watcher() i=7 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.357+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037414e0 con 0x55e70372d1a0 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.358+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.358+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94450683731568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e70373e740 con 0x55e70372d1a0 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94450683731568] v35'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc1da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 5 note: GC not initialized 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc1d97e2640 20 reqs_thread_entry: start 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 20 Filter name: none 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc14affd640 20 reqs_thread_entry: start 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.359+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703774970 con 0x7fc31c017050 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703772f60 con 0x7fc31c017050 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:55:28.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.360+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e7037774f0 con 0x7fc31c017050 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.361+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v35'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.361+0000 7fc328736800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.361+0000 7fc328736800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.361+0000 7fc328736800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.361+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94450683965104 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e703778060 con 0x7fc314058040 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== watch-notify(notify (1) cookie 94450683718640 notify 150323855372 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fc31c033070 con 0x7fc314058040 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc1fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94450683718640 notifier 4549 bl.length()=610 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.3 [notify cookie 94450683965104 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc1fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc1fb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:55:28.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc1fb7fe640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc1e8003ea0 con 0x7fc314058040 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== watch-notify(notify_complete (2) cookie 94450683965104 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc31c04de30 con 0x7fc314058040 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.362+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703776e80 con 0x7fc31c017050 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v35'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc328736800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc328736800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc328736800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94450683965056 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e7037763a0 con 0x55e703731bb0 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94450683716544 notify 150323855370 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55e7037227e0 con 0x55e703731bb0 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc1fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94450683716544 notifier 4549 bl.length()=192 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc1fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc1fb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:55:28.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 notify.2 [notify cookie 94450683965056 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.363+0000 7fc1fb7fe640 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc1e8003ea0 con 0x55e703731bb0 2024-09-14T10:55:28.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.364+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== watch-notify(notify_complete (2) cookie 94450683965056 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc314070040 con 0x55e703731bb0 2024-09-14T10:55:28.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.364+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.374 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:55:28.361570Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:28.361560Z","tags":[],"group_ids":[]} 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.364+0000 7fc1da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.364+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94450683731568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x55e70372d1a0 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.365+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94450683731568] v35'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.365+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94450683706672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x7fc314058040 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.366+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94450683706672] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.366+0000 7fc328736800 20 remove_watcher() i=0 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.366+0000 7fc328736800 2 removed watcher, disabling cache 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.366+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94450683712512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x55e70372d1a0 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.368+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94450683712512] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.368+0000 7fc328736800 20 remove_watcher() i=1 2024-09-14T10:55:28.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.368+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94450683716544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x55e703731bb0 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.369+0000 7fc324cb8640 1 -- 172.21.15.164:0/1839874786 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94450683716544] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31402a070 con 0x55e703731bb0 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.369+0000 7fc328736800 20 remove_watcher() i=2 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.369+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94450683718640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x7fc314058040 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.370+0000 7fc3244b7640 1 -- 172.21.15.164:0/1839874786 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94450683718640] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc31c0187b0 con 0x7fc314058040 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.370+0000 7fc328736800 20 remove_watcher() i=3 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.370+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94450683722192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x55e70372d1a0 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.371+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94450683722192] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x55e70372d1a0 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.371+0000 7fc328736800 20 remove_watcher() i=4 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.371+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94450683727264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x7fc31c017050 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.372+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94450683727264] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.372+0000 7fc328736800 20 remove_watcher() i=5 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.372+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94450683713568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x7fc31c017050 2024-09-14T10:55:28.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.373+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94450683713568] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.373+0000 7fc328736800 20 remove_watcher() i=6 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.373+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94450683724464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e703772530 con 0x7fc31c017050 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94450683724464] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc30c051070 con 0x7fc31c017050 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 20 remove_watcher() i=7 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc31c017050 msgr2=0x7fc31c04b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc31c017050 0x7fc31c04b640 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e70372d1a0 msgr2=0x55e70372f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e70372d1a0 0x55e70372f660 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc314058040 msgr2=0x7fc314045150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc314058040 0x7fc314045150 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e703731bb0 msgr2=0x55e703733fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e703731bb0 0x55e703733fa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ec03ce10 msgr2=0x7fc1ec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ec03ce10 0x7fc1ec03f2d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc31c018ac0 tx=0x7fc31c048000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 msgr2=0x55e703721460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 --2- 172.21.15.164:0/1839874786 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e703719e80 0x55e703721460 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc314014fa0 tx=0x7fc314054560 comp rx=0 tx=0).stop 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 reap_dead start 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc323cb6640 1 -- 172.21.15.164:0/1839874786 reap_dead start 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 shutdown_connections 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 >> 172.21.15.164:0/1839874786 conn(0x55e703716280 msgr2=0x55e703714490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 shutdown_connections 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.374+0000 7fc328736800 1 -- 172.21.15.164:0/1839874786 wait complete. 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 msgr2=0x7fc1fc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 0x7fc1fc03f2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55e7036fa090 tx=0x7fc31c052770 comp rx=0 tx=0).stop 2024-09-14T10:55:28.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 msgr2=0x55e70370d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55e7036f9ff0 tx=0x7fc314018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 shutdown_connections 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1fc03ce10 0x7fc1fc03f2d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/3101854613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70370d3c0 0x55e70370d7e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 >> 172.21.15.164:0/3101854613 conn(0x55e703701770 msgr2=0x55e703701b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 shutdown_connections 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/3101854613 wait complete. 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 msgr2=0x55e7036f9ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 0x55e7036f9ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 msgr2=0x55e7036fe310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 0x55e7036fe310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 msgr2=0x7fc20c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 0x7fc20c03f320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc30c057000 tx=0x7fc30c052000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 msgr2=0x55e7036f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c010 tx=0x7fc31c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 shutdown_connections 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e7036fbf20 0x55e7036fe310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e7035fec70 0x55e7036f9ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc20c03ce60 0x7fc20c03f320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 --2- 172.21.15.164:0/4066907342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e70356df50 0x55e7036f2460 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 >> 172.21.15.164:0/4066907342 conn(0x55e7035f4fe0 msgr2=0x55e7036ebe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 shutdown_connections 2024-09-14T10:55:28.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.375+0000 7fc328736800 1 -- 172.21.15.164:0/4066907342 wait complete. 2024-09-14T10:55:28.385 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:55:28.361570Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:28.361560Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:28.385 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:55:28.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:55:28.386 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-14T10:55:28.434 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.434 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.437+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.437+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.437+0000 7f3d9910c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x563e1a70d7b0 0x563e1a70dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d9910c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e1a70f490 con 0x563e1a70e8d0 2024-09-14T10:55:28.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d9910c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x563e1a5997d0 con 0x563e1a70d7b0 2024-09-14T10:55:28.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d96bfd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x563e1a70d7b0 0x563e1a70dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d963fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x563e1a70e8d0 0x563e1a70ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38838/0 (socket says 172.21.15.164:38838) 2024-09-14T10:55:28.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d963fc640 1 -- 172.21.15.164:0/2755630926 learned_addr learned my addr 172.21.15.164:0/2755630926 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d96bfd640 1 -- 172.21.15.164:0/2755630926 >> v1:172.21.15.116:6789/0 conn(0x563e1a70e8d0 legacy=0x563e1a70ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d95bfb640 1 -- 172.21.15.164:0/2755630926 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4232999476 0 0) 0x563e1a70f490 con 0x563e1a70e8d0 2024-09-14T10:55:28.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.438+0000 7f3d96bfd640 1 -- 172.21.15.164:0/2755630926 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a70f660 con 0x563e1a70d7b0 2024-09-14T10:55:28.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.440+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/2755630926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a70dbb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800a600 tx=0x7f3d88047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab41b79521f30ced server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.440+0000 7f3d95bfb640 1 -- 172.21.15.164:0/2755630926 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88056070 con 0x563e1a70d7b0 2024-09-14T10:55:28.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.440+0000 7f3d95bfb640 1 -- 172.21.15.164:0/2755630926 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8800a200 con 0x563e1a70d7b0 2024-09-14T10:55:28.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.440+0000 7f3d95bfb640 1 -- 172.21.15.164:0/2755630926 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88008590 con 0x563e1a70d7b0 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 -- 172.21.15.164:0/2755630926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 msgr2=0x563e1a70dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 --2- 172.21.15.164:0/2755630926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a70dbb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800a600 tx=0x7f3d88047cb0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 -- 172.21.15.164:0/2755630926 shutdown_connections 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 --2- 172.21.15.164:0/2755630926 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a70dbb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 -- 172.21.15.164:0/2755630926 >> 172.21.15.164:0/2755630926 conn(0x563e1a708fa0 msgr2=0x563e1a70b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 -- 172.21.15.164:0/2755630926 shutdown_connections 2024-09-14T10:55:28.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.441+0000 7f3d9910c800 1 -- 172.21.15.164:0/2755630926 wait complete. 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.454+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d9910c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d9910c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e1a5a6dd0 con 0x563e1a70d7b0 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d96bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d96bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34188/0 (socket says 172.21.15.164:34188) 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d96bfd640 1 -- 172.21.15.164:0/910558408 learned_addr learned my addr 172.21.15.164:0/910558408 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d96bfd640 1 -- 172.21.15.164:0/910558408 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a7fca10 con 0x563e1a70d7b0 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.455+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/910558408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d88027ae0 tx=0x7f3d88053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b927a970d1de84 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3c84e09640 1 -- 172.21.15.164:0/910558408 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88009810 con 0x563e1a70d7b0 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3c84e09640 1 -- 172.21.15.164:0/910558408 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d880099b0 con 0x563e1a70d7b0 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3c84e09640 1 -- 172.21.15.164:0/910558408 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88009cb0 con 0x563e1a70d7b0 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 -- 172.21.15.164:0/910558408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 msgr2=0x563e1a7fc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 --2- 172.21.15.164:0/910558408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3d88027ae0 tx=0x7f3d88053000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 -- 172.21.15.164:0/910558408 shutdown_connections 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 --2- 172.21.15.164:0/910558408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a7fc420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 -- 172.21.15.164:0/910558408 >> 172.21.15.164:0/910558408 conn(0x563e1a708fa0 msgr2=0x563e1a7f7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 -- 172.21.15.164:0/910558408 shutdown_connections 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.456+0000 7f3d9910c800 1 -- 172.21.15.164:0/910558408 wait complete. 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d9910c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d9910c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e1a681630 con 0x563e1a70d7b0 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d96bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d96bfd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34198/0 (socket says 172.21.15.164:34198) 2024-09-14T10:55:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.457+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3694970226 learned_addr learned my addr 172.21.15.164:0/3694970226 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a8043f0 con 0x563e1a70d7b0 2024-09-14T10:55:28.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3d88027ae0 tx=0x7f3d88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3c83606640 1 -- 172.21.15.164:0/3694970226 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88051760 con 0x563e1a70d7b0 2024-09-14T10:55:28.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3c83606640 1 -- 172.21.15.164:0/3694970226 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88051920 con 0x563e1a70d7b0 2024-09-14T10:55:28.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1a804680 con 0x563e1a70d7b0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3c83606640 1 -- 172.21.15.164:0/3694970226 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d88051c40 con 0x563e1a70d7b0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.458+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1a805080 con 0x563e1a70d7b0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3c83606640 1 -- 172.21.15.164:0/3694970226 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d88075060 con 0x563e1a70d7b0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3c83606640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 0x7f3c7c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3c83606640 1 -- 172.21.15.164:0/3694970226 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d8806a040 con 0x563e1a70d7b0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 0x7f3c7c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 0x563e1a80b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a80ba20 con 0x563e1a70e8d0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.459+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 0x563e1a80b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 0x7f3c7c03f320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d80000c00 tx=0x7f3d800013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 0x563e1a80b4e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d973fe640 1 -- 172.21.15.164:0/3694970226 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d9000a4d0 con 0x563e1a70e8d0 2024-09-14T10:55:28.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a80bdc0 con 0x563e1a70e8d0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d973fe640 1 -- 172.21.15.164:0/3694970226 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d9000a4d0 con 0x563e1a70e8d0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 0x563e1a80fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a8104b0 con 0x563e1a80d880 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.460+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 0x563e1a80fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.461+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 0x563e1a80fd20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.461+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3694970226 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d88058030 con 0x563e1a80d880 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.461+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a80c610 con 0x563e1a70e8d0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.461+0000 7f3d973fe640 1 -- 172.21.15.164:0/3694970226 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d9000a4d0 con 0x563e1a70e8d0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.461+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a80c9b0 con 0x563e1a70e8d0 2024-09-14T10:55:28.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d973fe640 1 -- 172.21.15.164:0/3694970226 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d9000a4d0 con 0x563e1a70e8d0 2024-09-14T10:55:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d9910c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d9910c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e1a6054a0 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34210/0 (socket says 172.21.15.164:34210) 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.462+0000 7f3d973fe640 1 -- 172.21.15.164:0/1644540734 learned_addr learned my addr 172.21.15.164:0/1644540734 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3d973fe640 1 -- 172.21.15.164:0/1644540734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a81f880 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3d973fe640 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x563e1a804e90 tx=0x7f3d90018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3c80e01640 1 -- 172.21.15.164:0/1644540734 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90014450 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3c80e01640 1 -- 172.21.15.164:0/1644540734 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90014610 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1a8200b0 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3c80e01640 1 -- 172.21.15.164:0/1644540734 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90014930 con 0x563e1a81ee20 2024-09-14T10:55:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.463+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1a820650 con 0x563e1a81ee20 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3c80e01640 1 -- 172.21.15.164:0/1644540734 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d90011040 con 0x563e1a81ee20 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3c80e01640 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 0x7f3c7003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3c80e01640 1 -- 172.21.15.164:0/1644540734 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d9001e070 con 0x563e1a81ee20 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 0x7f3c7003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 0x7f3c7003f2d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x563e1a805f60 tx=0x7f3d8808b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d9910c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.464+0000 7f3d9910c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e1a7fcd80 con 0x563e1a82b8c0 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34222/0 (socket says 172.21.15.164:34222) 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3d973fe640 1 -- 172.21.15.164:0/1809999297 learned_addr learned my addr 172.21.15.164:0/1809999297 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3d973fe640 1 -- 172.21.15.164:0/1809999297 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a82c2b0 con 0x563e1a82b8c0 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3d973fe640 1 --2- 172.21.15.164:0/1809999297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3d90016fd0 tx=0x7f3d90011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de84f10459d0f12 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3c7a7fc640 1 -- 172.21.15.164:0/1809999297 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9004b070 con 0x563e1a82b8c0 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3c7a7fc640 1 -- 172.21.15.164:0/1809999297 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90051070 con 0x563e1a82b8c0 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.465+0000 7f3c7a7fc640 1 -- 172.21.15.164:0/1809999297 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90045510 con 0x563e1a82b8c0 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- 172.21.15.164:0/1809999297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 msgr2=0x563e1a82bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1809999297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3d90016fd0 tx=0x7f3d90011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- 172.21.15.164:0/1809999297 shutdown_connections 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1809999297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a82bcc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- 172.21.15.164:0/1809999297 >> 172.21.15.164:0/1809999297 conn(0x563e1a827cc0 msgr2=0x563e1a825f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- 172.21.15.164:0/1809999297 shutdown_connections 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- 172.21.15.164:0/1809999297 wait complete. 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 Processor -- start 2024-09-14T10:55:28.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- start start 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d9910c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e1a82c8d0 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.466+0000 7f3d973fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34228/0 (socket says 172.21.15.164:34228) 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 learned_addr learned my addr 172.21.15.164:0/3684336072 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e1a833420 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3d90049040 tx=0x7f3d90054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3c78ff9640 1 -- 172.21.15.164:0/3684336072 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d9004b030 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3c78ff9640 1 -- 172.21.15.164:0/3684336072 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90031030 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e1a8336b0 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3c78ff9640 1 -- 172.21.15.164:0/3684336072 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d90011330 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.467+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e1a834030 con 0x563e1a82b8c0 2024-09-14T10:55:28.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.468+0000 7f3c78ff9640 1 -- 172.21.15.164:0/3684336072 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d90014ad0 con 0x563e1a82b8c0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.468+0000 7f3c78ff9640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6003ce60 0x7f3c6003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.468+0000 7f3c78ff9640 1 -- 172.21.15.164:0/3684336072 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3d9004c070 con 0x563e1a82b8c0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.468+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6003ce60 0x7f3c6003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.468+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6003ce60 0x7f3c6003f320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d88097980 tx=0x7f3d8808f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a83ec20 0x563e1a8410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a841830 con 0x563e1a83ec20 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a83ec20 0x563e1a8410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a83ec20 0x563e1a8410e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8000f5f0 con 0x563e1a83ec20 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 20 realm 2024-09-14T10:55:28.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.469+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a83df70 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8000f5f0 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a842320 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8000f5f0 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a842bf0 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d8000f5f0 con 0x563e1a83ec20 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a843610 0x563e1a845a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a846170 con 0x563e1a843610 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a843610 0x563e1a845a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.470+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a843610 0x563e1a845a00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d9910c800 20 searching for the correct realm 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d973fe640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d90014070 0x7f3d900137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d90014070 0x7f3d900137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.471+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d90014070 0x7f3d900137b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d96bfd640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d88077070 0x7f3d88096130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d88077070 0x7f3d88096130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d963fc640 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d88077070 0x7f3d88096130 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8000f5f0 con 0x7f3d88077070 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.472+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8000f5f0 con 0x563e1a83ec20 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x7f3d88077070 2024-09-14T10:55:28.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x7f3d88077070 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.473+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x7f3d88077070 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.474+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.475+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x7f3d88077070 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.476+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x7f3d88077070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8002b040 con 0x563e1a83ec20 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.477+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.478+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a843610 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d88077070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x563e1a83ec20 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847a60 con 0x7f3d90014070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.479+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a846b30 con 0x563e1a83ec20 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a8473d0 con 0x563e1a83ec20 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847ee0 con 0x563e1a83ec20 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 zone default found 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 4 Realm: () 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 zonegroup default 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a847ee0 con 0x7f3d88077070 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.480+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a849d80 con 0x563e1a843610 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84a120 con 0x563e1a843610 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 20 started sync module instance, tier type = 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.481+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a8491c0 con 0x7f3d90014070 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.482+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.482+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94824732855568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84a560 con 0x7f3d90014070 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.482+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84adb0 con 0x563e1a83ec20 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.483+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94824732855568] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.483+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.483+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94824732862720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84b1d0 con 0x563e1a83ec20 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.483+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84ba60 con 0x563e1a843610 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.484+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94824732862720] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.485+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.485+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94824732863776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84b5f0 con 0x563e1a843610 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.485+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84c4d0 con 0x7f3d90014070 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.486+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.486+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94824732868544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84cd70 con 0x7f3d90014070 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.486+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84d850 con 0x563e1a83ec20 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.486+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94824732863776] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.487+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94824732868544] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.487+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.487+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94824732870848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84b140 con 0x563e1a83ec20 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.487+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84e130 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.488+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.488+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94824732875760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84e560 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.488+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84f080 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.488+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94824732870848] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.489+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94824732875760] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.489+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.489+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94824732879696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84e010 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.489+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84f660 con 0x7f3d88077070 2024-09-14T10:55:28.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94824732881328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84fa80 con 0x7f3d88077070 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=0 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=1 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=2 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=3 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=4 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=5 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94824732879696] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.490+0000 7f3d9910c800 20 add_watcher() i=6 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.492+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94824732881328] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.492+0000 7f3d9910c800 20 add_watcher() i=7 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.492+0000 7f3d9910c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.493+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84fa80 con 0x563e1a83ec20 2024-09-14T10:55:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.493+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.493+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94824732882384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a84f9f0 con 0x563e1a83ec20 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94824732882384] v35'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3c4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d9910c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d9910c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d9910c800 5 note: GC not initialized 2024-09-14T10:55:28.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3bc7fff640 20 reqs_thread_entry: start 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d9910c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.494+0000 7f3d9910c800 20 Filter name: none 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3bc5ffb640 20 reqs_thread_entry: start 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a885f40 con 0x7f3d88077070 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:28.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.495+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a887a20 con 0x7f3d90014070 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a8895a0 con 0x7f3d90014070 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.496+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88d9d0 con 0x7f3d90014070 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.498+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 foo.buckets [call] v35'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.498+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:425cf0a7:root::.bucket.meta.testx%3amyfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a8912e0 con 0x7f3d90014070 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [create,call,writefull 0~420,setxattr (203)] v35'6 uv6 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d9910c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x7 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d9910c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d9910c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d9910c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94824733142768 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a890b70 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== watch-notify(notify (1) cookie 94824732879696 notify 150323855371 ret 0) ==== 897+0+0 (crc 0 0 0) 0x7f3d80018040 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(67 notify.6 [notify cookie 94824733142768 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3c79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 94824732879696 notifier 4556 bl.length()=855 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3c79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x7 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3c79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3c79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3c79ffb640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3bcc003550 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.499+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== watch-notify(notify_complete (2) cookie 94824733142768 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3d8002f820 con 0x7f3d88077070 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.500+0000 7f3d9910c800 20 handle_bi_update(): bucket=testx:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.500+0000 7f3d9910c800 20 handle_bi_update(): bucket=testx:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.500+0000 7f3d9910c800 20 handle_bi_update(): bucket=testx:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.500+0000 7f3d9910c800 20 handle_bi_update(): bucket=testx:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.500+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88cbe0 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.501+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v35'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.501+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88c730 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v35'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d9910c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d9910c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d9910c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94824733134096 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88d130 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94824732870848 notify 150323855371 ret 0) ==== 390+0+0 (crc 0 0 0) 0x563e1a88cad0 con 0x563e1a83ec20 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3c79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 94824732870848 notifier 4556 bl.length()=348 2024-09-14T10:55:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3c79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3c79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3c79ffb640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3bcc003580 con 0x563e1a83ec20 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(71 notify.4 [notify cookie 94824733134096 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94824733134096 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e1a891530 con 0x563e1a83ec20 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.502+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88ff00 con 0x7f3d90014070 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(73 myfoo [call,delete] v35'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d9910c800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d9910c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94824733134096 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88d130 con 0x7f3d88077070 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify (1) cookie 94824732879696 notify 150323855372 ret 0) ==== 191+0+0 (crc 0 0 0) 0x563e1a891530 con 0x7f3d88077070 2024-09-14T10:55:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3c7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94824732879696 notifier 4556 bl.length()=149 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(74 notify.6 [notify cookie 94824733134096 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3c7a7fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3c5c003d60 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== watch-notify(notify_complete (2) cookie 94824733134096 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3d8002f820 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.504+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:76 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88eef0 con 0x7f3d90014070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(76 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call,delete] v35'7 uv7 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d9910c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 from cache 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d9910c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94824733119760 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563e1a88dee0 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== watch-notify(notify (1) cookie 94824732881328 notify 150323855373 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f3d8002f820 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3c7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94824732881328 notifier 4556 bl.length()=206 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(77 notify.7 [notify cookie 94824733119760 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.505+0000 7f3c7a7fc640 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3c5c003d60 con 0x7f3d88077070 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.506+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.506+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== watch-notify(notify_complete (2) cookie 94824733119760 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3d80041450 con 0x7f3d88077070 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.507+0000 7f3c4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.507+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94824732882384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x563e1a83ec20 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.507+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94824732882384] v35'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.508+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94824732855568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x7f3d90014070 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.508+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94824732855568] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.508+0000 7f3d9910c800 20 remove_watcher() i=0 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.508+0000 7f3d9910c800 2 removed watcher, disabling cache 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.508+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94824732862720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x563e1a83ec20 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.509+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94824732862720] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.509+0000 7f3d9910c800 20 remove_watcher() i=1 2024-09-14T10:55:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.509+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94824732863776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x563e1a843610 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.510+0000 7f3d973fe640 1 -- 172.21.15.164:0/3684336072 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94824732863776] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d9002a070 con 0x563e1a843610 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.510+0000 7f3d9910c800 20 remove_watcher() i=2 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.510+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94824732868544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x7f3d90014070 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.511+0000 7f3d96bfd640 1 -- 172.21.15.164:0/3684336072 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94824732868544] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d88058030 con 0x7f3d90014070 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.511+0000 7f3d9910c800 20 remove_watcher() i=3 2024-09-14T10:55:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.511+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94824732870848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x563e1a83ec20 2024-09-14T10:55:28.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.512+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94824732870848] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x563e1a83ec20 2024-09-14T10:55:28.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.512+0000 7f3d9910c800 20 remove_watcher() i=4 2024-09-14T10:55:28.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.512+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94824732875760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.513+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94824732875760] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.513+0000 7f3d9910c800 20 remove_watcher() i=5 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.513+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94824732879696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.514+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94824732879696] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.514+0000 7f3d9910c800 20 remove_watcher() i=6 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.514+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94824732881328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563e1a883b50 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94824732881328] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8003b040 con 0x7f3d88077070 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 20 remove_watcher() i=7 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d88077070 msgr2=0x7f3d88096130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d88077070 0x7f3d88096130 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a83ec20 msgr2=0x563e1a8410e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a83ec20 0x563e1a8410e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d90014070 msgr2=0x7f3d900137b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d90014070 0x7f3d900137b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a843610 msgr2=0x563e1a845a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.515+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a843610 0x563e1a845a00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6003ce60 msgr2=0x7f3c6003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6003ce60 0x7f3c6003f320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d88097980 tx=0x7f3d8808f000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 msgr2=0x563e1a832ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3d90049040 tx=0x7f3d90054530 comp rx=0 tx=0).stop 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d963fc640 1 -- 172.21.15.164:0/3684336072 reap_dead start 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 shutdown_connections 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3684336072 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a82b8c0 0x563e1a832ec0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 >> 172.21.15.164:0/3684336072 conn(0x563e1a827cc0 msgr2=0x563e1a825ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 shutdown_connections 2024-09-14T10:55:28.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3684336072 wait complete. 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 msgr2=0x7f3c7003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 0x7f3c7003f2d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x563e1a805f60 tx=0x7f3d8808b040 comp rx=0 tx=0).stop 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 msgr2=0x563e1a81f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x563e1a804e90 tx=0x7f3d90018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 shutdown_connections 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7003ce10 0x7f3c7003f2d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/1644540734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a81ee20 0x563e1a81f240 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 >> 172.21.15.164:0/1644540734 conn(0x563e1a8131d0 msgr2=0x563e1a8135b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 shutdown_connections 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/1644540734 wait complete. 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 msgr2=0x563e1a80b4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 0x563e1a80b4e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 msgr2=0x563e1a80fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.516+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 0x563e1a80fd20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 msgr2=0x7f3c7c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 0x7f3c7c03f320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3d80000c00 tx=0x7f3d800013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 msgr2=0x563e1a803e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3d88027ae0 tx=0x7f3d88002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 shutdown_connections 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e1a80d880 0x563e1a80fd20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e1a70e8d0 0x563e1a80b4e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c7c03ce60 0x7f3c7c03f320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 --2- 172.21.15.164:0/3694970226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e1a70d7b0 0x563e1a803e90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 >> 172.21.15.164:0/3694970226 conn(0x563e1a708fa0 msgr2=0x563e1a7fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 shutdown_connections 2024-09-14T10:55:28.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.517+0000 7f3d9910c800 1 -- 172.21.15.164:0/3694970226 wait complete. 2024-09-14T10:55:28.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-14T10:55:28.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-14T10:55:28.527 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-14T10:55:28.570 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.570 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2eb620800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a35085a010 0x55a3508e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2eb620800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3508ed6d0 con 0x55a3508e99d0 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2eb620800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55a3507717d0 con 0x55a35085a010 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2e910a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a35085a010 0x55a3508e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2e0909640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55a3508e99d0 0x55a3508ebe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38842/0 (socket says 172.21.15.164:38842) 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.573+0000 7fd2e0909640 1 -- 172.21.15.164:0/3224603770 learned_addr learned my addr 172.21.15.164:0/3224603770 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.574+0000 7fd2e910a640 1 -- 172.21.15.164:0/3224603770 >> v1:172.21.15.116:6789/0 conn(0x55a3508e99d0 legacy=0x55a3508ebe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.574+0000 7fd2e910a640 1 -- 172.21.15.164:0/3224603770 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3508ee900 con 0x55a35085a010 2024-09-14T10:55:28.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.574+0000 7fd2e8909640 1 -- 172.21.15.164:0/3224603770 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449766448 0 0) 0x55a3508ed6d0 con 0x55a3508e99d0 2024-09-14T10:55:28.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2e910a640 1 --2- 172.21.15.164:0/3224603770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3508e93d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73a4f4b2d710567 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2e8909640 1 -- 172.21.15.164:0/3224603770 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc053570 con 0x55a35085a010 2024-09-14T10:55:28.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2e8909640 1 -- 172.21.15.164:0/3224603770 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc058070 con 0x55a35085a010 2024-09-14T10:55:28.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2e8909640 1 -- 172.21.15.164:0/3224603770 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc053880 con 0x55a35085a010 2024-09-14T10:55:28.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 -- 172.21.15.164:0/3224603770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 msgr2=0x55a3508e93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 --2- 172.21.15.164:0/3224603770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3508e93d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:28.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 -- 172.21.15.164:0/3224603770 shutdown_connections 2024-09-14T10:55:28.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 --2- 172.21.15.164:0/3224603770 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3508e93d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 -- 172.21.15.164:0/3224603770 >> 172.21.15.164:0/3224603770 conn(0x55a3508e0f80 msgr2=0x55a3508e33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 -- 172.21.15.164:0/3224603770 shutdown_connections 2024-09-14T10:55:28.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.576+0000 7fd2eb620800 1 -- 172.21.15.164:0/3224603770 wait complete. 2024-09-14T10:55:28.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.590+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.590+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.590+0000 7fd2eb620800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.590+0000 7fd2eb620800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a35077edd0 con 0x55a35085a010 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd2e910a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd2e910a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34250/0 (socket says 172.21.15.164:34250) 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd2e910a640 1 -- 172.21.15.164:0/2824698757 learned_addr learned my addr 172.21.15.164:0/2824698757 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd2e910a640 1 -- 172.21.15.164:0/2824698757 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3509d6c50 con 0x55a35085a010 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2824698757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d5e006e178ccac server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd1d7606640 1 -- 172.21.15.164:0/2824698757 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc053570 con 0x55a35085a010 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd1d7606640 1 -- 172.21.15.164:0/2824698757 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc063030 con 0x55a35085a010 2024-09-14T10:55:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.591+0000 7fd1d7606640 1 -- 172.21.15.164:0/2824698757 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc053840 con 0x55a35085a010 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- 172.21.15.164:0/2824698757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 msgr2=0x55a3509d6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2824698757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc051000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- 172.21.15.164:0/2824698757 shutdown_connections 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2824698757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509d6660 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- 172.21.15.164:0/2824698757 >> 172.21.15.164:0/2824698757 conn(0x55a3508e0f80 msgr2=0x55a3509d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- 172.21.15.164:0/2824698757 shutdown_connections 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- 172.21.15.164:0/2824698757 wait complete. 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.592+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2eb620800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2eb620800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a3508edba0 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2e910a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2e910a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34256/0 (socket says 172.21.15.164:34256) 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2e910a640 1 -- 172.21.15.164:0/2260903086 learned_addr learned my addr 172.21.15.164:0/2260903086 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2e910a640 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3509de5e0 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.593+0000 7fd1d5e03640 1 -- 172.21.15.164:0/2260903086 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc078070 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.594+0000 7fd1d5e03640 1 -- 172.21.15.164:0/2260903086 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc068420 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.594+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3509de870 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.594+0000 7fd1d5e03640 1 -- 172.21.15.164:0/2260903086 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2dc068700 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.594+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3509df480 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.594+0000 7fd1d5e03640 1 -- 172.21.15.164:0/2260903086 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd2dc07b070 con 0x55a35085a010 2024-09-14T10:55:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd1d5e03640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 0x7fd1d003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd1d5e03640 1 -- 172.21.15.164:0/2260903086 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd2dc0982e0 con 0x55a35085a010 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2e0909640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 0x7fd1d003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 0x55a3509e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3509e5c10 con 0x55a3508e99d0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2e990b640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 0x55a3509e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2e0909640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 0x7fd1d003f2d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2e990b640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 0x55a3509e56d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2e990b640 1 -- 172.21.15.164:0/2260903086 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2e400a4d0 con 0x55a3508e99d0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.595+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3509e5fb0 con 0x55a3508e99d0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2e990b640 1 -- 172.21.15.164:0/2260903086 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2e400a4d0 con 0x55a3508e99d0 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 0x55a3509e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3509ea660 con 0x55a3509e7a30 2024-09-14T10:55:28.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 0x55a3509e9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 0x55a3509e9ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2e910a640 1 -- 172.21.15.164:0/2260903086 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2dc07a030 con 0x55a3509e7a30 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.596+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3509e6800 con 0x55a3508e99d0 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2e990b640 1 -- 172.21.15.164:0/2260903086 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2e400a4d0 con 0x55a3508e99d0 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a3509e6ba0 con 0x55a3508e99d0 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2e990b640 1 -- 172.21.15.164:0/2260903086 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2e400a4d0 con 0x55a3508e99d0 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2eb620800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.597+0000 7fd2eb620800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a3507dd4a0 con 0x55a3508e6b60 2024-09-14T10:55:28.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34272/0 (socket says 172.21.15.164:34272) 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2e990b640 1 -- 172.21.15.164:0/2513200995 learned_addr learned my addr 172.21.15.164:0/2513200995 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2e990b640 1 -- 172.21.15.164:0/2513200995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3508e7080 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2e990b640 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55a3509df080 tx=0x7fd2e4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd1ceffd640 1 -- 172.21.15.164:0/2513200995 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4014450 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd1ceffd640 1 -- 172.21.15.164:0/2513200995 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4014610 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd1ceffd640 1 -- 172.21.15.164:0/2513200995 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4014930 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3508e5910 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.598+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3508e5e60 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.599+0000 7fd1ceffd640 1 -- 172.21.15.164:0/2513200995 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd2e4011040 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.599+0000 7fd1ceffd640 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 0x7fd1c003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.599+0000 7fd1ceffd640 1 -- 172.21.15.164:0/2513200995 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd2e401e070 con 0x55a3508e6b60 2024-09-14T10:55:28.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.599+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 0x7fd1c003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e910a640 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 0x7fd1c003f2d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a3509e0110 tx=0x7fd2dc0525d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2eb620800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2eb620800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a3509d7020 con 0x55a350a07c70 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34286/0 (socket says 172.21.15.164:34286) 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e990b640 1 -- 172.21.15.164:0/2172823675 learned_addr learned my addr 172.21.15.164:0/2172823675 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e990b640 1 -- 172.21.15.164:0/2172823675 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a350a08640 con 0x55a350a07c70 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.600+0000 7fd2e990b640 1 --2- 172.21.15.164:0/2172823675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4018430 tx=0x7fd2e4014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c46716698a2150 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd1ccff9640 1 -- 172.21.15.164:0/2172823675 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e404b070 con 0x55a350a07c70 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd1ccff9640 1 -- 172.21.15.164:0/2172823675 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4051070 con 0x55a350a07c70 2024-09-14T10:55:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd1ccff9640 1 -- 172.21.15.164:0/2172823675 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e4011da0 con 0x55a350a07c70 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 -- 172.21.15.164:0/2172823675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 msgr2=0x55a350a08050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2172823675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4018430 tx=0x7fd2e4014ea0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 -- 172.21.15.164:0/2172823675 shutdown_connections 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2172823675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a08050 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 -- 172.21.15.164:0/2172823675 >> 172.21.15.164:0/2172823675 conn(0x55a350a04070 msgr2=0x55a350a022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 -- 172.21.15.164:0/2172823675 shutdown_connections 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 -- 172.21.15.164:0/2172823675 wait complete. 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.601+0000 7fd2eb620800 1 Processor -- start 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2eb620800 1 -- start start 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2eb620800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2eb620800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a350a08c80 con 0x55a350a07c70 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2e990b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34300/0 (socket says 172.21.15.164:34300) 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 learned_addr learned my addr 172.21.15.164:0/1620394952 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a350a0f770 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.602+0000 7fd2e990b640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4049040 tx=0x7fd2e40544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd1beffd640 1 -- 172.21.15.164:0/1620394952 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e404b040 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd1beffd640 1 -- 172.21.15.164:0/1620394952 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4031030 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd1beffd640 1 -- 172.21.15.164:0/1620394952 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2e40168f0 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a350a0fa00 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a350a10380 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.603+0000 7fd1beffd640 1 -- 172.21.15.164:0/1620394952 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fd2e4011330 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd1beffd640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1b403ce60 0x7fd1b403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd1beffd640 1 -- 172.21.15.164:0/1620394952 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fd2e400e040 con 0x55a350a07c70 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2e910a640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1b403ce60 0x7fd1b403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a350a1af80 0x55a350a1d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a1db90 con 0x55a350a1af80 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2e0909640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a350a1af80 0x55a350a1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2e910a640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1b403ce60 0x7fd1b403f320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc098250 tx=0x7fd2dc090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.604+0000 7fd2e0909640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a350a1af80 0x55a350a1d440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d400f5f0 con 0x55a350a1af80 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 realm 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a1a320 con 0x55a350a1af80 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d400f5f0 con 0x55a350a1af80 2024-09-14T10:55:28.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a1e670 con 0x55a350a1af80 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d400f5f0 con 0x55a350a1af80 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a1ef40 con 0x55a350a1af80 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2d400f5f0 con 0x55a350a1af80 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a350a1f840 0x55a350a21c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a223b0 con 0x55a350a1f840 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.605+0000 7fd2e990b640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a350a1f840 0x55a350a21c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e990b640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a350a1f840 0x55a350a21c50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd2e403e070 con 0x55a350a1f840 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2eb620800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2eb620800 20 searching for the correct realm 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd2e403e070 con 0x55a350a1f840 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e990b640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd2e4014070 0x7fd2e4001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.606+0000 7fd2e910a640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd2e4014070 0x7fd2e4001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.607+0000 7fd2e910a640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd2e4014070 0x7fd2e4001770 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.607+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.607+0000 7fd2e910a640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd2dc0a5040 0x7fd2dc05e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.607+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.607+0000 7fd2e0909640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd2dc0a5040 0x7fd2dc05e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd2dc0a5040 0x7fd2dc05e950 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d400f5f0 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d400f5f0 con 0x55a350a1af80 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.608+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e403e070 con 0x55a350a1f840 2024-09-14T10:55:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.609+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e403e070 con 0x55a350a1f840 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.610+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e403e070 con 0x55a350a1f840 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.611+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.612+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d402b040 con 0x55a350a1af80 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.613+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1f840 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2dc0a5040 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x55a350a1af80 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.614+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23d70 con 0x7fd2e4014070 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a22e60 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a22aa0 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a23780 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 zone default found 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 4 Realm: () 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 zonegroup default 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.615+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a24220 con 0x7fd2dc0a5040 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a25d10 con 0x55a350a1f840 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.616+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a26170 con 0x55a350a1f840 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.617+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.617+0000 7fd2eb620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.617+0000 7fd2eb620800 20 started sync module instance, tier type = 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.617+0000 7fd2eb620800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.617+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a250b0 con 0x7fd2e4014070 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.618+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.618+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94159920845984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a26a80 con 0x7fd2e4014070 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.618+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a272d0 con 0x55a350a1af80 2024-09-14T10:55:28.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.619+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94159920845984] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.619+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.619+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94159920852512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a276f0 con 0x55a350a1af80 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.619+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a27f40 con 0x55a350a1f840 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.620+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94159920852512] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.620+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.620+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94159920854048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a27e50 con 0x55a350a1f840 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.620+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a28950 con 0x7fd2e4014070 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.621+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94159920854048] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.621+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.621+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94159920858176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a28d70 con 0x7fd2e4014070 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.621+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a297b0 con 0x55a350a1af80 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.622+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94159920858176] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.622+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.622+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94159920861824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a29ba0 con 0x55a350a1af80 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.622+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2a5c0 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.623+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.623+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94159920865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2a580 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.623+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2b580 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.623+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94159920861824] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.624+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.624+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94159920855200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2b580 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.624+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2bfc0 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.624+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94159920865456] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94159920855200] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94159920869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2bb10 con 0x7fd2dc0a5040 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=0 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=1 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=2 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=3 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=4 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=5 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.625+0000 7fd2eb620800 20 add_watcher() i=6 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94159920869504] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2eb620800 20 add_watcher() i=7 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2eb620800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2eff0 con 0x55a350a1af80 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.626+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94159920872208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2c3e0 con 0x55a350a1af80 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.627+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94159920872208] v35'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.627+0000 7fd19ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 5 note: GC not initialized 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd19efe5640 20 reqs_thread_entry: start 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 20 Filter name: none 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd19cfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.628+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a350a61c60 con 0x55a350a1af80 2024-09-14T10:55:28.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.629+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.629+0000 7fd2eb620800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T10:55:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.629+0000 7fd19ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.629+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94159920872208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2c3e0 con 0x55a350a1af80 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.630+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94159920872208] v35'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.630+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94159920845984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a2bfc0 con 0x7fd2e4014070 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.631+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94159920845984] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.631+0000 7fd2eb620800 20 remove_watcher() i=0 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.631+0000 7fd2eb620800 2 removed watcher, disabling cache 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.631+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94159920852512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a254a0 con 0x55a350a1af80 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.633+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94159920852512] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.633+0000 7fd2eb620800 20 remove_watcher() i=1 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.633+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94159920854048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a26e20 con 0x55a350a1f840 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.634+0000 7fd2e990b640 1 -- 172.21.15.164:0/1620394952 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94159920854048] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2e4067040 con 0x55a350a1f840 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.634+0000 7fd2eb620800 20 remove_watcher() i=2 2024-09-14T10:55:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.634+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94159920858176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a26e20 con 0x7fd2e4014070 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.635+0000 7fd2e910a640 1 -- 172.21.15.164:0/1620394952 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94159920858176] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2dc08b040 con 0x7fd2e4014070 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.635+0000 7fd2eb620800 20 remove_watcher() i=3 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.635+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94159920861824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a28440 con 0x55a350a1af80 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.636+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94159920861824] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x55a350a1af80 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.636+0000 7fd2eb620800 20 remove_watcher() i=4 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.636+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94159920865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a26e20 con 0x7fd2dc0a5040 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.637+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94159920865456] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.637+0000 7fd2eb620800 20 remove_watcher() i=5 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.637+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94159920855200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a29280 con 0x7fd2dc0a5040 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.637+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94159920855200] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.637+0000 7fd2eb620800 20 remove_watcher() i=6 2024-09-14T10:55:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.638+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94159920869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a350a28440 con 0x7fd2dc0a5040 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.638+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94159920869504] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd2d403b040 con 0x7fd2dc0a5040 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.638+0000 7fd2eb620800 20 remove_watcher() i=7 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.638+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd2dc0a5040 msgr2=0x7fd2dc05e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fd2dc0a5040 0x7fd2dc05e950 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a350a1af80 msgr2=0x55a350a1d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a350a1af80 0x55a350a1d440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd2e4014070 msgr2=0x7fd2e4001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fd2e4014070 0x7fd2e4001770 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a350a1f840 msgr2=0x55a350a21c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a350a1f840 0x55a350a21c50 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1b403ce60 msgr2=0x7fd1b403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1b403ce60 0x7fd1b403f320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc098250 tx=0x7fd2dc090000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 msgr2=0x55a350a0f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4049040 tx=0x7fd2e40544e0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2e0909640 1 -- 172.21.15.164:0/1620394952 reap_dead start 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 shutdown_connections 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/1620394952 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a350a07c70 0x55a350a0f210 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 >> 172.21.15.164:0/1620394952 conn(0x55a350a04070 msgr2=0x55a350a02280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 shutdown_connections 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/1620394952 wait complete. 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 msgr2=0x7fd1c003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 0x7fd1c003f2d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a3509e0110 tx=0x7fd2dc0525d0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 msgr2=0x55a3508e53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55a3509df080 tx=0x7fd2e4018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 shutdown_connections 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1c003ce10 0x7fd1c003f2d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2513200995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a3508e6b60 0x55a3508e53d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 >> 172.21.15.164:0/2513200995 conn(0x55a3509ed3c0 msgr2=0x55a3509ed7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 shutdown_connections 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.639+0000 7fd2eb620800 1 -- 172.21.15.164:0/2513200995 wait complete. 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 msgr2=0x55a3509e56d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 0x55a3509e56d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 msgr2=0x55a3509e9ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 0x55a3509e9ed0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 msgr2=0x7fd1d003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 0x7fd1d003f2d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d40013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 msgr2=0x55a3509de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00a470 tx=0x7fd2dc002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 shutdown_connections 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a3509e7a30 0x55a3509e9ed0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a3508e99d0 0x55a3509e56d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fd1d003ce10 0x7fd1d003f2d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 --2- 172.21.15.164:0/2260903086 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a35085a010 0x55a3509de080 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 >> 172.21.15.164:0/2260903086 conn(0x55a3508e0f80 msgr2=0x55a3509d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 shutdown_connections 2024-09-14T10:55:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.640+0000 7fd2eb620800 1 -- 172.21.15.164:0/2260903086 wait complete. 2024-09-14T10:55:28.649 INFO:teuthology.orchestra.run.smithi164.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"9a0c6t3fjlXrVNokx0p29AKs","ver":2},"mtime":"2024-09-14T10:55:28.501869Z","data":{"bucket":{"name":"myfoo","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","bucket_id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-14T10:55:26.137796Z","linked":true,"has_bucket_info":false}} 2024-09-14T10:55:28.649 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '9a0c6t3fjlXrVNokx0p29AKs', 'ver': 2}, 'mtime': '2024-09-14T10:55:28.501869Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'bucket_id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-14T10:55:26.137796Z', 'linked': True, 'has_bucket_info': False}} 2024-09-14T10:55:28.649 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-14T10:55:28.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-14T10:55:28.650 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-14T10:55:28.738 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.738 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.741+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.741+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.741+0000 7f3c24b23800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559ce5f43fb0 0x559ce5fd3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.741+0000 7f3c24b23800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ce5fd7730 con 0x559ce5fd39e0 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.741+0000 7f3c24b23800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x559ce5e5b7d0 con 0x559ce5f43fb0 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.742+0000 7f3c2080c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559ce5f43fb0 0x559ce5fd3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.742+0000 7f3c2000b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x559ce5fd39e0 0x559ce5fd5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38854/0 (socket says 172.21.15.164:38854) 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.742+0000 7f3c2000b640 1 -- 172.21.15.164:0/2699327431 learned_addr learned my addr 172.21.15.164:0/2699327431 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.742+0000 7f3c2080c640 1 -- 172.21.15.164:0/2699327431 >> v1:172.21.15.116:6789/0 conn(0x559ce5fd39e0 legacy=0x559ce5fd5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.742+0000 7f3c2080c640 1 -- 172.21.15.164:0/2699327431 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce5fd8960 con 0x559ce5f43fb0 2024-09-14T10:55:28.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2699327431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd3470 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005fd0 tx=0x7f3c10045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f18d29751055c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c1f80a640 1 -- 172.21.15.164:0/2699327431 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10058530 con 0x559ce5f43fb0 2024-09-14T10:55:28.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c1f80a640 1 -- 172.21.15.164:0/2699327431 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c100586d0 con 0x559ce5f43fb0 2024-09-14T10:55:28.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c1f80a640 1 -- 172.21.15.164:0/2699327431 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c100589d0 con 0x559ce5f43fb0 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 -- 172.21.15.164:0/2699327431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 msgr2=0x559ce5fd3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2699327431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd3470 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005fd0 tx=0x7f3c10045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 -- 172.21.15.164:0/2699327431 shutdown_connections 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2699327431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd3470 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 -- 172.21.15.164:0/2699327431 >> 172.21.15.164:0/2699327431 conn(0x559ce5fcafa0 msgr2=0x559ce5fcd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 -- 172.21.15.164:0/2699327431 shutdown_connections 2024-09-14T10:55:28.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.744+0000 7f3c24b23800 1 -- 172.21.15.164:0/2699327431 wait complete. 2024-09-14T10:55:28.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c24b23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c24b23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ce5e68dd0 con 0x559ce5f43fb0 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c2080c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c2080c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34314/0 (socket says 172.21.15.164:34314) 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c2080c640 1 -- 172.21.15.164:0/3058700090 learned_addr learned my addr 172.21.15.164:0/3058700090 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.759+0000 7f3c2080c640 1 -- 172.21.15.164:0/3058700090 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce5fd11e0 con 0x559ce5f43fb0 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c2080c640 1 --2- 172.21.15.164:0/3058700090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3c10025a60 tx=0x7f3c10051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9ac19709ceea87 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3b0ee0d640 1 -- 172.21.15.164:0/3058700090 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c100589b0 con 0x559ce5f43fb0 2024-09-14T10:55:28.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3b0ee0d640 1 -- 172.21.15.164:0/3058700090 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10068070 con 0x559ce5f43fb0 2024-09-14T10:55:28.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3b0ee0d640 1 -- 172.21.15.164:0/3058700090 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10058c80 con 0x559ce5f43fb0 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c24b23800 1 -- 172.21.15.164:0/3058700090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 msgr2=0x559ce5fd0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3058700090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3c10025a60 tx=0x7f3c10051000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c24b23800 1 -- 172.21.15.164:0/3058700090 shutdown_connections 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3058700090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce5fd0bf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.760+0000 7f3c24b23800 1 -- 172.21.15.164:0/3058700090 >> 172.21.15.164:0/3058700090 conn(0x559ce5fcafa0 msgr2=0x559ce60bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 -- 172.21.15.164:0/3058700090 shutdown_connections 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 -- 172.21.15.164:0/3058700090 wait complete. 2024-09-14T10:55:28.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c24b23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ce5fd7c00 con 0x559ce5f43fb0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c2080c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c2080c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34320/0 (socket says 172.21.15.164:34320) 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.761+0000 7f3c2080c640 1 -- 172.21.15.164:0/3679047247 learned_addr learned my addr 172.21.15.164:0/3679047247 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3c2080c640 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce60ca990 con 0x559ce5f43fb0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3c2080c640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c10025a60 tx=0x7f3c10003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3b0d60a640 1 -- 172.21.15.164:0/3679047247 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10063650 con 0x559ce5f43fb0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3b0d60a640 1 -- 172.21.15.164:0/3679047247 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c100637f0 con 0x559ce5f43fb0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3b0d60a640 1 -- 172.21.15.164:0/3679047247 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c10063af0 con 0x559ce5f43fb0 2024-09-14T10:55:28.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ce60cac20 con 0x559ce5f43fb0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.762+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ce60cb830 con 0x559ce5f43fb0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3b0d60a640 1 -- 172.21.15.164:0/3679047247 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c10063c90 con 0x559ce5f43fb0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3b0d60a640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 0x7f3b0803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3b0d60a640 1 -- 172.21.15.164:0/3679047247 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c100985b0 con 0x559ce5f43fb0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3c2000b640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 0x7f3b0803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 0x559ce60d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce60d1fc0 con 0x559ce5fd39e0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.763+0000 7f3c2100d640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 0x559ce60d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2000b640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 0x7f3b0803f2d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c08004170 tx=0x7f3c08001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2100d640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 0x559ce60d1a80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2100d640 1 -- 172.21.15.164:0/3679047247 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c180083e0 con 0x559ce5fd39e0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce60d2360 con 0x559ce5fd39e0 2024-09-14T10:55:28.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2100d640 1 -- 172.21.15.164:0/3679047247 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c180083e0 con 0x559ce5fd39e0 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 0x559ce60d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce60d6a50 con 0x559ce60d3e20 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2080c640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 0x559ce60d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.764+0000 7f3c2080c640 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 0x559ce60d62c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.765+0000 7f3c2080c640 1 -- 172.21.15.164:0/3679047247 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c100743e0 con 0x559ce60d3e20 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.765+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce60d2bb0 con 0x559ce5fd39e0 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.765+0000 7f3c2100d640 1 -- 172.21.15.164:0/3679047247 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c180083e0 con 0x559ce5fd39e0 2024-09-14T10:55:28.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.765+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce60d2f90 con 0x559ce5fd39e0 2024-09-14T10:55:28.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.765+0000 7f3c2100d640 1 -- 172.21.15.164:0/3679047247 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c180083e0 con 0x559ce5fd39e0 2024-09-14T10:55:28.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c24b23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c24b23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ce5ec74a0 con 0x559ce60e5490 2024-09-14T10:55:28.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34332/0 (socket says 172.21.15.164:34332) 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.766+0000 7f3c2100d640 1 -- 172.21.15.164:0/2996475019 learned_addr learned my addr 172.21.15.164:0/2996475019 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3c2100d640 1 -- 172.21.15.164:0/2996475019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce60e5ef0 con 0x559ce60e5490 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3c2100d640 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x559ce60cc320 tx=0x7f3c1800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3b067fc640 1 -- 172.21.15.164:0/2996475019 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c18007d60 con 0x559ce60e5490 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3b067fc640 1 -- 172.21.15.164:0/2996475019 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1801e020 con 0x559ce60e5490 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ce60e6720 con 0x559ce60e5490 2024-09-14T10:55:28.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3b067fc640 1 -- 172.21.15.164:0/2996475019 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c18019590 con 0x559ce60e5490 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.767+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ce60e6cc0 con 0x559ce60e5490 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3b067fc640 1 -- 172.21.15.164:0/2996475019 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c18016040 con 0x559ce60e5490 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3b067fc640 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 0x7f3af803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3b067fc640 1 -- 172.21.15.164:0/2996475019 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c1801f030 con 0x559ce60e5490 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 0x7f3af803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.768+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 0x7f3af803f2d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x559ce60cc500 tx=0x7f3c1007e600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c24b23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c24b23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ce5fcf580 con 0x559ce60f1ed0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34334/0 (socket says 172.21.15.164:34334) 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c2100d640 1 -- 172.21.15.164:0/4110385384 learned_addr learned my addr 172.21.15.164:0/4110385384 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c2100d640 1 -- 172.21.15.164:0/4110385384 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce60f28c0 con 0x559ce60f1ed0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3c2100d640 1 --2- 172.21.15.164:0/4110385384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3c18054440 tx=0x7f3c18045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b943d203c2158c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3af7fff640 1 -- 172.21.15.164:0/4110385384 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c1801d040 con 0x559ce60f1ed0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3af7fff640 1 -- 172.21.15.164:0/4110385384 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18017e00 con 0x559ce60f1ed0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.769+0000 7f3af7fff640 1 -- 172.21.15.164:0/4110385384 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c180184e0 con 0x559ce60f1ed0 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- 172.21.15.164:0/4110385384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 msgr2=0x559ce60f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 --2- 172.21.15.164:0/4110385384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3c18054440 tx=0x7f3c18045490 comp rx=0 tx=0).stop 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- 172.21.15.164:0/4110385384 shutdown_connections 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 --2- 172.21.15.164:0/4110385384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f22d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- 172.21.15.164:0/4110385384 >> 172.21.15.164:0/4110385384 conn(0x559ce60ee2d0 msgr2=0x559ce60ec510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- 172.21.15.164:0/4110385384 shutdown_connections 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- 172.21.15.164:0/4110385384 wait complete. 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 Processor -- start 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- start start 2024-09-14T10:55:28.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c24b23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ce60f2ee0 con 0x559ce60f1ed0 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c2100d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34342/0 (socket says 172.21.15.164:34342) 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.770+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 learned_addr learned my addr 172.21.15.164:0/2877266244 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce60f99f0 con 0x559ce60f1ed0 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3c2100d640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c18017fd0 tx=0x7f3c180543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3af67fc640 1 -- 172.21.15.164:0/2877266244 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c1801d030 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3af67fc640 1 -- 172.21.15.164:0/2877266244 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18016330 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ce60f9c80 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3af67fc640 1 -- 172.21.15.164:0/2877266244 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c18016650 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.771+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ce60fa810 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.772+0000 7f3af67fc640 1 -- 172.21.15.164:0/2877266244 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3c180169f0 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.772+0000 7f3af67fc640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3aec03ce10 0x7f3aec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.772+0000 7f3af67fc640 1 -- 172.21.15.164:0/2877266244 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f3c18034030 con 0x559ce60f1ed0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.772+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3aec03ce10 0x7f3aec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.772+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3aec03ce10 0x7f3aec03f2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c1004ef20 tx=0x7f3c10085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce6105000 0x559ce61074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6107c10 con 0x559ce6105000 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c2000b640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce6105000 0x559ce61074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c2000b640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce6105000 0x559ce61074c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c08009050 con 0x559ce6105000 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 realm 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6104350 con 0x559ce6105000 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c08009050 con 0x559ce6105000 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.773+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6108700 con 0x559ce6105000 2024-09-14T10:55:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c08009050 con 0x559ce6105000 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6108fd0 con 0x559ce6105000 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c08009050 con 0x559ce6105000 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce61099f0 0x559ce610bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce610c4b0 con 0x559ce61099f0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c2100d640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce61099f0 0x559ce610bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.774+0000 7f3c2100d640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce61099f0 0x559ce610bde0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c1805a040 con 0x559ce61099f0 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c24b23800 20 searching for the correct realm 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c1805a040 con 0x559ce61099f0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2100d640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c18019040 0x7f3c18053de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c18019040 0x7f3c18053de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.775+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c18019040 0x7f3c18053de0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2080c640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c100951c0 0x7f3c10098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2000b640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c100951c0 0x7f3c10098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2000b640 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c100951c0 0x7f3c10098990 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08009050 con 0x7f3c100951c0 2024-09-14T10:55:28.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.776+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08009050 con 0x559ce6105000 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.777+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1805a040 con 0x559ce61099f0 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.778+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c1805a040 con 0x559ce61099f0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.779+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.780+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.781+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce61099f0 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.782+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c100951c0 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x559ce6105000 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ddc0 con 0x7f3c18019040 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce610ce70 con 0x559ce6105000 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce610d710 con 0x559ce6105000 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.783+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce610e240 con 0x559ce6105000 2024-09-14T10:55:28.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 zone default found 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 4 Realm: () 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 zonegroup default 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce610e5e0 con 0x7f3c100951c0 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6110480 con 0x559ce61099f0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.784+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6110820 con 0x559ce61099f0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.785+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.785+0000 7f3c24b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.785+0000 7f3c24b23800 20 started sync module instance, tier type = 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.785+0000 7f3c24b23800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.785+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce610f8c0 con 0x7f3c18019040 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.786+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.786+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94132363129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6110c80 con 0x7f3c18019040 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.786+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce61114d0 con 0x559ce6105000 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.787+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94132363129872] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.787+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.787+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94132363137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce61118f0 con 0x559ce6105000 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.787+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce61122b0 con 0x559ce61099f0 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.788+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94132363137056] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.788+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.788+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94132363138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce61122b0 con 0x559ce61099f0 2024-09-14T10:55:28.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.788+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6112cb0 con 0x7f3c18019040 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.789+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94132363138592] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.789+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.789+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94132363140608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6112220 con 0x7f3c18019040 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.789+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6113b70 con 0x559ce6105000 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.790+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94132363140608] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.790+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.790+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94132363146944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6113f90 con 0x559ce6105000 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.790+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6114950 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.791+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.791+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94132363150496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6114d70 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.791+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94132363146944] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.791+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6113b20 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.792+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94132363150496] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.793+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.793+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94132363151552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6114ce0 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.793+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6115dd0 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.793+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94132363151552] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94132363154176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6115dd0 con 0x7f3c100951c0 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=0 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=1 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=2 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=3 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=4 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=5 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=6 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94132363154176] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 20 add_watcher() i=7 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.794+0000 7f3c24b23800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.795+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce61190a0 con 0x559ce6105000 2024-09-14T10:55:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.795+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.795+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94132363156112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6116360 con 0x559ce6105000 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94132363156112] v35'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3ad77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c24b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c24b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c24b23800 5 note: GC not initialized 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3ad67e4640 20 reqs_thread_entry: start 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c24b23800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.796+0000 7f3c24b23800 20 Filter name: none 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3acffff640 20 reqs_thread_entry: start 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce614c3d0 con 0x559ce6105000 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce614e360 con 0x559ce6105000 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.797+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.2 8:425cf0a7:root::.bucket.meta.testx%3amyfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce614fc00 con 0x7f3c18019040 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv6 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.798+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce61546c0 con 0x559ce6105000 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.799+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v35'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.799+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6157fd0 con 0x7f3c18019040 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [create,call,writefull 0~387,setxattr (123)] v35'8 uv8 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c24b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x7 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c24b23800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c24b23800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c24b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.800+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94132363418368 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6157840 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== watch-notify(notify (1) cookie 94132363154176 notify 150323855374 ret 0) ==== 778+0+0 (crc 0 0 0) 0x559ce5fd7730 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3af7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 94132363154176 notifier 4570 bl.length()=736 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3af7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x7 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3af7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3af7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(67 notify.7 [notify cookie 94132363418368 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3af7fff640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3ae4003ea0 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify_complete (2) cookie 94132363418368 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c0802d670 con 0x7f3c100951c0 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c24b23800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c24b23800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c24b23800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c24b23800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.801+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6156af0 con 0x7f3c18019040 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.802+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(69 foo.buckets [call] v35'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.802+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6153760 con 0x7f3c18019040 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.803+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.803+0000 7f3c24b23800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.803+0000 7f3c24b23800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.803+0000 7f3c24b23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.803+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94132363418288 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce6156380 con 0x7f3c100951c0 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== watch-notify(notify (1) cookie 94132363151552 notify 150323855375 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f3c0802d9b0 con 0x7f3c100951c0 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3af7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94132363151552 notifier 4570 bl.length()=314 2024-09-14T10:55:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3af7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3af7fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(71 notify.6 [notify cookie 94132363418288 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3af7fff640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3ae4003ea0 con 0x7f3c100951c0 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== watch-notify(notify_complete (2) cookie 94132363418288 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c0802dc50 con 0x7f3c100951c0 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.804+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6155ed0 con 0x559ce6105000 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v35'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c24b23800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c24b23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94132363382432 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce614d770 con 0x559ce6105000 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== watch-notify(notify (1) cookie 94132363146944 notify 150323855372 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f3c0802dc50 con 0x559ce6105000 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3af7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94132363146944 notifier 4570 bl.length()=155 2024-09-14T10:55:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3af7fff640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3ae4003ea0 con 0x559ce6105000 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.805+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(74 notify.4 [notify cookie 94132363382432 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.806+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== watch-notify(notify_complete (2) cookie 94132363382432 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c0803c420 con 0x559ce6105000 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.806+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.806+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:76 8.2 8:425cf0a7:root::.bucket.meta.testx%3amyfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce6154e80 con 0x7f3c18019040 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.807+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call,delete] v35'9 uv9 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.807+0000 7f3c24b23800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 from cache 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.807+0000 7f3c24b23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.807+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94132363395776 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559ce614d350 con 0x7f3c100951c0 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== watch-notify(notify (1) cookie 94132363151552 notify 150323855376 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f3c0803c420 con 0x7f3c100951c0 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3af77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 94132363151552 notifier 4570 bl.length()=212 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3af77fe640 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3a48003330 con 0x7f3c100951c0 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(77 notify.6 [notify cookie 94132363395776 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.808+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== watch-notify(notify_complete (2) cookie 94132363395776 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c0803c6c0 con 0x7f3c100951c0 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.809+0000 7f3ad77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.809+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94132363156112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x559ce6105000 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.810+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94132363156112] v35'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.810+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94132363129872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x7f3c18019040 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.812+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94132363129872] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.812+0000 7f3c24b23800 20 remove_watcher() i=0 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.812+0000 7f3c24b23800 2 removed watcher, disabling cache 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.812+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94132363137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x559ce6105000 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.814+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94132363137056] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.814+0000 7f3c24b23800 20 remove_watcher() i=1 2024-09-14T10:55:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.814+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94132363138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x559ce61099f0 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c2100d640 1 -- 172.21.15.164:0/2877266244 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94132363138592] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c18068040 con 0x559ce61099f0 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c24b23800 20 remove_watcher() i=2 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94132363140608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x7f3c18019040 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c2080c640 1 -- 172.21.15.164:0/2877266244 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94132363140608] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c100743e0 con 0x7f3c18019040 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c24b23800 20 remove_watcher() i=3 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.815+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94132363146944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x559ce6105000 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94132363146944] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x559ce6105000 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c24b23800 20 remove_watcher() i=4 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94132363150496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x7f3c100951c0 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94132363150496] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c24b23800 20 remove_watcher() i=5 2024-09-14T10:55:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.817+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94132363151552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x7f3c100951c0 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.818+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94132363151552] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.818+0000 7f3c24b23800 20 remove_watcher() i=6 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.819+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94132363154176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559ce614a1e0 con 0x7f3c100951c0 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.819+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94132363154176] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c08029040 con 0x7f3c100951c0 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.819+0000 7f3c24b23800 20 remove_watcher() i=7 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c100951c0 msgr2=0x7f3c10098990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3c100951c0 0x7f3c10098990 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce6105000 msgr2=0x559ce61074c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce6105000 0x559ce61074c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c18019040 msgr2=0x7f3c18053de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3c18019040 0x7f3c18053de0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce61099f0 msgr2=0x559ce610bde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce61099f0 0x559ce610bde0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3aec03ce10 msgr2=0x7f3aec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3aec03ce10 0x7f3aec03f2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3c1004ef20 tx=0x7f3c10085000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 msgr2=0x559ce60f9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c2000b640 1 -- 172.21.15.164:0/2877266244 reap_dead start 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3c18017fd0 tx=0x7f3c180543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 shutdown_connections 2024-09-14T10:55:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2877266244 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60f1ed0 0x559ce60f9490 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 >> 172.21.15.164:0/2877266244 conn(0x559ce60ee2d0 msgr2=0x559ce60ec4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 shutdown_connections 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2877266244 wait complete. 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 msgr2=0x7f3af803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 0x7f3af803f2d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x559ce60cc500 tx=0x7f3c1007e600 comp rx=0 tx=0).stop 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 msgr2=0x559ce60e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x559ce60cc320 tx=0x7f3c1800af20 comp rx=0 tx=0).stop 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 shutdown_connections 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3af803ce10 0x7f3af803f2d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 --2- 172.21.15.164:0/2996475019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce60e5490 0x559ce60e58b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 >> 172.21.15.164:0/2996475019 conn(0x559ce60d9840 msgr2=0x559ce60d9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 shutdown_connections 2024-09-14T10:55:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.820+0000 7f3c24b23800 1 -- 172.21.15.164:0/2996475019 wait complete. 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 msgr2=0x559ce60d1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 0x559ce60d1a80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 msgr2=0x559ce60d62c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 0x559ce60d62c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 msgr2=0x7f3b0803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 0x7f3b0803f2d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c08004170 tx=0x7f3c08001330 comp rx=0 tx=0).stop 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 msgr2=0x559ce60ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3c10025a60 tx=0x7f3c10003330 comp rx=0 tx=0).stop 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 shutdown_connections 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ce60d3e20 0x559ce60d62c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ce5fd39e0 0x559ce60d1a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3b0803ce10 0x7f3b0803f2d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 --2- 172.21.15.164:0/3679047247 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ce5f43fb0 0x559ce60ca430 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 >> 172.21.15.164:0/3679047247 conn(0x559ce5fcafa0 msgr2=0x559ce60bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 shutdown_connections 2024-09-14T10:55:28.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.821+0000 7f3c24b23800 1 -- 172.21.15.164:0/3679047247 wait complete. 2024-09-14T10:55:28.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:55:28.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-14T10:55:28.838 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-14T10:55:28.885 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:28.885 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc8a0e800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562ce6302bc0 0x562ce6305080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc8a0e800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ce6305730 con 0x562ce6271fb0 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc8a0e800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x562ce61897d0 con 0x562ce6302bc0 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc38ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562ce6302bc0 0x562ce6305080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc40cb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x562ce6271fb0 0x562ce6301470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38858/0 (socket says 172.21.15.164:38858) 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc40cb640 1 -- 172.21.15.164:0/711291365 learned_addr learned my addr 172.21.15.164:0/711291365 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.888+0000 7fcbc38ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562ce6302bc0 0x562ce6305080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34348/0 (socket says 172.21.15.164:34348) 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.889+0000 7fcbc38ca640 1 -- 172.21.15.164:0/711291365 >> v1:172.21.15.116:6789/0 conn(0x562ce6271fb0 legacy=0x562ce6301470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.889+0000 7fcbc38ca640 1 -- 172.21.15.164:0/711291365 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce6306960 con 0x562ce6302bc0 2024-09-14T10:55:28.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.890+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/711291365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6302bc0 0x562ce6305080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800a470 tx=0x7fcbb8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19fc3d47967d0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc30c9640 1 -- 172.21.15.164:0/711291365 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb8053570 con 0x562ce6302bc0 2024-09-14T10:55:28.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc30c9640 1 -- 172.21.15.164:0/711291365 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb8058070 con 0x562ce6302bc0 2024-09-14T10:55:28.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc30c9640 1 -- 172.21.15.164:0/711291365 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb8053880 con 0x562ce6302bc0 2024-09-14T10:55:28.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/711291365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6302bc0 msgr2=0x562ce6305080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/711291365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6302bc0 0x562ce6305080 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800a470 tx=0x7fcbb8045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/711291365 shutdown_connections 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/711291365 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6302bc0 0x562ce6305080 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/711291365 >> 172.21.15.164:0/711291365 conn(0x562ce62f8fa0 msgr2=0x562ce62fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/711291365 shutdown_connections 2024-09-14T10:55:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.891+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/711291365 wait complete. 2024-09-14T10:55:28.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.905+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.905+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.905+0000 7fcbc8a0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.905+0000 7fcbc8a0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ce6196dd0 con 0x562ce6271fb0 2024-09-14T10:55:28.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcbc40cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcbc40cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34360/0 (socket says 172.21.15.164:34360) 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcbc40cb640 1 -- 172.21.15.164:0/434867140 learned_addr learned my addr 172.21.15.164:0/434867140 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcbc40cb640 1 -- 172.21.15.164:0/434867140 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce63eede0 con 0x562ce6271fb0 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/434867140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4001df0 tx=0x7fcbb400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9671dcc9c4d723 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcab260c640 1 -- 172.21.15.164:0/434867140 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb4012020 con 0x562ce6271fb0 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcab260c640 1 -- 172.21.15.164:0/434867140 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb400e470 con 0x562ce6271fb0 2024-09-14T10:55:28.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.906+0000 7fcab260c640 1 -- 172.21.15.164:0/434867140 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb400e7f0 con 0x562ce6271fb0 2024-09-14T10:55:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/434867140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 msgr2=0x562ce63ee7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/434867140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4001df0 tx=0x7fcbb400b6c0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/434867140 shutdown_connections 2024-09-14T10:55:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/434867140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63ee7f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/434867140 >> 172.21.15.164:0/434867140 conn(0x562ce62f8fa0 msgr2=0x562ce63ea170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/434867140 shutdown_connections 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/434867140 wait complete. 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.907+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc8a0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc8a0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ce6305c00 con 0x562ce6271fb0 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc40cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc40cb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34364/0 (socket says 172.21.15.164:34364) 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc40cb640 1 -- 172.21.15.164:0/2762445213 learned_addr learned my addr 172.21.15.164:0/2762445213 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc40cb640 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce63f6850 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x562ce63ef780 tx=0x7fcbb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcab0e09640 1 -- 172.21.15.164:0/2762445213 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb4012030 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcab0e09640 1 -- 172.21.15.164:0/2762445213 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb401a6d0 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ce63f6ae0 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcab0e09640 1 -- 172.21.15.164:0/2762445213 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbb401a9d0 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.908+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce63f74e0 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.909+0000 7fcab0e09640 1 -- 172.21.15.164:0/2762445213 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbb4015020 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.909+0000 7fcab0e09640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 0x7fcaac03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.909+0000 7fcab0e09640 1 -- 172.21.15.164:0/2762445213 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbb4020030 con 0x562ce6271fb0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 0x7fcaac03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 0x562ce63fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce63fde80 con 0x562ce6302bc0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 0x562ce63fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 0x7fcaac03f2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8057000 tx=0x7fcbb8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 0x562ce63fd940 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2762445213 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbbc00a4d0 con 0x562ce6302bc0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.910+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce63fe220 con 0x562ce6302bc0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2762445213 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbbc00a4d0 con 0x562ce6302bc0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 0x562ce64021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce6402960 con 0x562ce63ffd60 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 0x562ce64021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 0x562ce64021d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc40cb640 1 -- 172.21.15.164:0/2762445213 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbb401ad50 con 0x562ce63ffd60 2024-09-14T10:55:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.911+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce63fea70 con 0x562ce6302bc0 2024-09-14T10:55:28.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2762445213 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbbc00a4d0 con 0x562ce6302bc0 2024-09-14T10:55:28.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce63feed0 con 0x562ce6302bc0 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2762445213 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbbc00a4d0 con 0x562ce6302bc0 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc8a0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc8a0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ce61f54a0 con 0x562ce6411370 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.912+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34368/0 (socket says 172.21.15.164:34368) 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2561026516 learned_addr learned my addr 172.21.15.164:0/2561026516 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc48cc640 1 -- 172.21.15.164:0/2561026516 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce6411dd0 con 0x562ce6411370 2024-09-14T10:55:28.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562ce63f76b0 tx=0x7fcbbc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcaa9ffb640 1 -- 172.21.15.164:0/2561026516 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc014450 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcaa9ffb640 1 -- 172.21.15.164:0/2561026516 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc014610 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ce6412600 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcaa9ffb640 1 -- 172.21.15.164:0/2561026516 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc014930 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.913+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce6412ba0 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcaa9ffb640 1 -- 172.21.15.164:0/2561026516 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbbc011040 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcaa9ffb640 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 0x7fca9c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcaa9ffb640 1 -- 172.21.15.164:0/2561026516 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbbc01e070 con 0x562ce6411370 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 0x7fca9c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.914+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 0x7fca9c03f2d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562ce63f8410 tx=0x7fcbb40011d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc8a0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc8a0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ce63ef210 con 0x562ce641de30 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34384/0 (socket says 172.21.15.164:34384) 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc48cc640 1 -- 172.21.15.164:0/512328368 learned_addr learned my addr 172.21.15.164:0/512328368 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc48cc640 1 -- 172.21.15.164:0/512328368 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce641e800 con 0x562ce641de30 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/512328368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc022ea0 tx=0x7fcbbc045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73363d538f11330f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcaa37fe640 1 -- 172.21.15.164:0/512328368 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc04b070 con 0x562ce641de30 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcaa37fe640 1 -- 172.21.15.164:0/512328368 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc051070 con 0x562ce641de30 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.915+0000 7fcaa37fe640 1 -- 172.21.15.164:0/512328368 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc0168f0 con 0x562ce641de30 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/512328368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 msgr2=0x562ce641e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/512328368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc022ea0 tx=0x7fcbbc045490 comp rx=0 tx=0).stop 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/512328368 shutdown_connections 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/512328368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce641e210 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/512328368 >> 172.21.15.164:0/512328368 conn(0x562ce641a230 msgr2=0x562ce6418470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/512328368 shutdown_connections 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/512328368 wait complete. 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 Processor -- start 2024-09-14T10:55:28.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- start start 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc8a0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ce641ee40 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc48cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34390/0 (socket says 172.21.15.164:34390) 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.916+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 learned_addr learned my addr 172.21.15.164:0/3443294638 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce62ff0e0 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc022ea0 tx=0x7fcbbc054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcaa1ffb640 1 -- 172.21.15.164:0/3443294638 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc04b030 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcaa1ffb640 1 -- 172.21.15.164:0/3443294638 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc031070 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ce62fd490 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcaa1ffb640 1 -- 172.21.15.164:0/3443294638 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbbc045760 con 0x562ce641de30 2024-09-14T10:55:28.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.917+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce62fd9d0 con 0x562ce641de30 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.918+0000 7fcaa1ffb640 1 -- 172.21.15.164:0/3443294638 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcbbc045900 con 0x562ce641de30 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.918+0000 7fcaa1ffb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9403ce60 0x7fca9403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.918+0000 7fcaa1ffb640 1 -- 172.21.15.164:0/3443294638 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fcbbc04c070 con 0x562ce641de30 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.918+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9403ce60 0x7fca9403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.918+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9403ce60 0x7fca9403f320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4052be0 tx=0x7fcbb4046070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6433350 0x562ce6435810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce6435f60 con 0x562ce6433350 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6433350 0x562ce6435810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6433350 0x562ce6435810 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 20 realm 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.919+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce6436390 con 0x562ce6433350 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce6436c60 con 0x562ce6433350 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce6437000 con 0x562ce6433350 2024-09-14T10:55:28.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce6437d60 0x562ce643a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643a760 con 0x562ce6437d60 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce6437d60 0x562ce643a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.920+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce6437d60 0x562ce643a150 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc8a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc8a0e800 20 searching for the correct realm 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc48cc640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbbc014070 0x7fcbbc02c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbbc014070 0x7fcbbc02c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.921+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbbc014070 0x7fcbbc02c3e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc40cb640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbb4017050 0x7fcbb4042240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbb4017050 0x7fcbb4042240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc38ca640 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbb4017050 0x7fcbb4042240 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.922+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.923+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.924+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.925+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.926+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.927+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.928+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6437d60 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbb4017050 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x562ce6433350 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c050 con 0x7fcbbc014070 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.929+0000 7fcbc8a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643b150 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643b9a0 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c4d0 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:28.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 zone default found 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 4 Realm: () 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 zonegroup default 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.930+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643c870 con 0x7fcbb4017050 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643e6b0 con 0x562ce6437d60 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce643ec90 con 0x562ce6437d60 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 started sync module instance, tier type = 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.931+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643db20 con 0x7fcbbc014070 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.932+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.932+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94750841755248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643f0f0 con 0x7fcbbc014070 2024-09-14T10:55:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.932+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643f940 con 0x562ce6433350 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.933+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94750841755248] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.934+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.934+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94750841757504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643f940 con 0x562ce6433350 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.934+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6440430 con 0x562ce6437d60 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.934+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94750841757504] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.935+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.935+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94750841765632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643f940 con 0x562ce6437d60 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.935+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6440ec0 con 0x7fcbbc014070 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.936+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.936+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94750841768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6441760 con 0x7fcbbc014070 2024-09-14T10:55:28.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.936+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6442260 con 0x562ce6433350 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.936+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94750841765632] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.937+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94750841768336] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.937+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.937+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94750841770672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce643f490 con 0x562ce6433350 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.937+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6442c70 con 0x7fcbb4017050 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.938+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94750841770672] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.938+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.938+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94750841773392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6442c70 con 0x7fcbb4017050 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.938+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6443500 con 0x7fcbb4017050 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.939+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94750841773392] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.939+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.939+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94750841776064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64436e0 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.939+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6443f30 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94750841776064] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94750841779936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6443fb0 con 0x7fcbb4017050 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=0 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=1 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=2 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=3 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=4 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=5 2024-09-14T10:55:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.940+0000 7fcbc8a0e800 20 add_watcher() i=6 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94750841779936] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc8a0e800 20 add_watcher() i=7 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc8a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce64472c0 con 0x562ce6433350 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.941+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94750841781360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6444540 con 0x562ce6433350 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.942+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94750841781360] v35'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.942+0000 7fca7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.942+0000 7fcbc8a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.942+0000 7fcbc8a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:28.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.942+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce644fc80 con 0x562ce6433350 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.943+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.943+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6450310 con 0x7fcbb4017050 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.944+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.945+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6450880 con 0x562ce6437d60 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.946+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.946+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6450880 con 0x562ce6433350 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.946+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'135 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.947+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6450d20 con 0x7fcbbc014070 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.947+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.948+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64510c0 con 0x562ce6437d60 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.948+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.948+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64511f0 con 0x562ce6433350 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.949+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.950+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce644f580 con 0x7fcbb4017050 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.951+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.951+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64516f0 con 0x7fcbbc014070 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.952+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.952+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64516f0 con 0x562ce6437d60 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.953+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.953+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64516f0 con 0x7fcbbc014070 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.954+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.954+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64516f0 con 0x7fcbb4017050 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.955+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.955+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x7fcbbc014070 2024-09-14T10:55:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.956+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.956+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x7fcbb4017050 2024-09-14T10:55:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.957+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.957+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.958+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.958+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6437d60 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.959+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.959+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x7fcbbc014070 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.960+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.960+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6437d60 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.961+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.961+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.962+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.962+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.964+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'137 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.964+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451780 con 0x562ce6437d60 2024-09-14T10:55:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.964+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.965+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64517f0 con 0x7fcbbc014070 2024-09-14T10:55:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.965+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.965+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451850 con 0x562ce6437d60 2024-09-14T10:55:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.966+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.966+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451850 con 0x562ce6437d60 2024-09-14T10:55:28.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.967+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.967+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451850 con 0x562ce6437d60 2024-09-14T10:55:28.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.968+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.968+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451850 con 0x562ce6437d60 2024-09-14T10:55:28.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.969+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.969+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce6451890 con 0x7fcbb4017050 2024-09-14T10:55:28.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.970+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.970+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64518b0 con 0x562ce6437d60 2024-09-14T10:55:28.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.971+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.971+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64518b0 con 0x7fcbb4017050 2024-09-14T10:55:28.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.972+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.972+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64518b0 con 0x562ce6437d60 2024-09-14T10:55:28.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.974+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.974+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64518b0 con 0x7fcbb4017050 2024-09-14T10:55:28.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.975+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.975+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce64518d0 con 0x7fcbbc014070 2024-09-14T10:55:28.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fca797e2640 20 reqs_thread_entry: start 2024-09-14T10:55:28.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc8a0e800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:28.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc8a0e800 20 Filter name: none 2024-09-14T10:55:28.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fc9eaffd640 20 reqs_thread_entry: start 2024-09-14T10:55:28.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc8a0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-14T10:55:28.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc8a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:28.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.976+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce647c830 con 0x7fcbb4017050 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc8a0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc8a0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc8a0e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc8a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.977+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce647c7e0 con 0x562ce6433350 2024-09-14T10:55:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.978+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.978+0000 7fcbc8a0e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:55:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.978+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647c7b0 con 0x7fcbb4017050 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.978+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc8a0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94750842018832 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f4f0 con 0x562ce6437d60 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== watch-notify(notify (1) cookie 94750841765632 notify 150323855371 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562ce644f720 con 0x562ce6437d60 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 94750841765632 notifier 4577 bl.length()=170 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(97 notify.2 [notify cookie 94750842018832 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcaa37fe640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fca88003d60 con 0x562ce6437d60 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== watch-notify(notify_complete (2) cookie 94750842018832 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562ce62fd490 con 0x562ce6437d60 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc8a0e800 10 removing email index: 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc8a0e800 10 removing user buckets index 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.979+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647d0b0 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.980+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v35'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.980+0000 7fcbc8a0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.980+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94750842018544 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f3d0 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== watch-notify(notify (1) cookie 94750841770672 notify 150323855373 ret 0) ==== 217+0+0 (crc 0 0 0) 0x562ce6450310 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcaa2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94750841770672 notifier 4577 bl.length()=175 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(100 notify.4 [notify cookie 94750842018544 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcaa2ffd640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc9f80032c0 con 0x562ce6433350 2024-09-14T10:55:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== watch-notify(notify_complete (2) cookie 94750842018544 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562ce64506b0 con 0x562ce6433350 2024-09-14T10:55:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc8a0e800 10 removing user index: testx$tenanteduser 2024-09-14T10:55:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.981+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbb4017050 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.982+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v35'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.982+0000 7fcbc8a0e800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.982+0000 7fcbc8a0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.982+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94750842023008 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbbc014070 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== watch-notify(notify (1) cookie 94750841768336 notify 150323855373 ret 0) ==== 209+0+0 (crc 0 0 0) 0x562ce64509b0 con 0x7fcbbc014070 2024-09-14T10:55:28.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcaa37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94750841768336 notifier 4577 bl.length()=167 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(103 notify.3 [notify cookie 94750842023008 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcaa37fe640 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fca88003d60 con 0x7fcbbc014070 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.983+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== watch-notify(notify_complete (2) cookie 94750842023008 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcbb4033040 con 0x7fcbbc014070 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.984+0000 7fca7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:28.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.984+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94750841781360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x562ce6433350 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.985+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94750841781360] v35'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.985+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94750841755248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbbc014070 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.986+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94750841755248] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.986+0000 7fcbc8a0e800 20 remove_watcher() i=0 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.986+0000 7fcbc8a0e800 2 removed watcher, disabling cache 2024-09-14T10:55:28.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.986+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94750841757504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x562ce6433350 2024-09-14T10:55:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.987+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94750841757504] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.987+0000 7fcbc8a0e800 20 remove_watcher() i=1 2024-09-14T10:55:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.987+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94750841765632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x562ce6437d60 2024-09-14T10:55:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.988+0000 7fcbc48cc640 1 -- 172.21.15.164:0/3443294638 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94750841765632] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbbc02a070 con 0x562ce6437d60 2024-09-14T10:55:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.988+0000 7fcbc8a0e800 20 remove_watcher() i=2 2024-09-14T10:55:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.988+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94750841768336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbbc014070 2024-09-14T10:55:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.989+0000 7fcbc40cb640 1 -- 172.21.15.164:0/3443294638 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94750841768336] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb401ad50 con 0x7fcbbc014070 2024-09-14T10:55:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.989+0000 7fcbc8a0e800 20 remove_watcher() i=3 2024-09-14T10:55:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.989+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94750841770672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x562ce6433350 2024-09-14T10:55:28.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.991+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94750841770672] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x562ce6433350 2024-09-14T10:55:28.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.991+0000 7fcbc8a0e800 20 remove_watcher() i=4 2024-09-14T10:55:28.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.991+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94750841773392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbb4017050 2024-09-14T10:55:28.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.992+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94750841773392] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.992+0000 7fcbc8a0e800 20 remove_watcher() i=5 2024-09-14T10:55:28.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.992+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94750841776064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbb4017050 2024-09-14T10:55:28.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.993+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94750841776064] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.993+0000 7fcbc8a0e800 20 remove_watcher() i=6 2024-09-14T10:55:28.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.993+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94750841779936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562ce647f180 con 0x7fcbb4017050 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94750841779936] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb8051070 con 0x7fcbb4017050 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 20 remove_watcher() i=7 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbb4017050 msgr2=0x7fcbb4042240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcbb4017050 0x7fcbb4042240 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6433350 msgr2=0x562ce6435810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6433350 0x562ce6435810 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbbc014070 msgr2=0x7fcbbc02c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcbbc014070 0x7fcbbc02c3e0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce6437d60 msgr2=0x562ce643a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce6437d60 0x562ce643a150 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9403ce60 msgr2=0x7fca9403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9403ce60 0x7fca9403f320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4052be0 tx=0x7fcbb4046070 comp rx=0 tx=0).stop 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 msgr2=0x562ce62feb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc38ca640 1 -- 172.21.15.164:0/3443294638 reap_dead start 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc022ea0 tx=0x7fcbbc054520 comp rx=0 tx=0).stop 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 shutdown_connections 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/3443294638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce641de30 0x562ce62feb80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 >> 172.21.15.164:0/3443294638 conn(0x562ce641a230 msgr2=0x562ce6418440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 shutdown_connections 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/3443294638 wait complete. 2024-09-14T10:55:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 msgr2=0x7fca9c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 0x7fca9c03f2d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x562ce63f8410 tx=0x7fcbb40011d0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 msgr2=0x562ce6411790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562ce63f76b0 tx=0x7fcbbc018830 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 shutdown_connections 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca9c03ce10 0x7fca9c03f2d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.994+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2561026516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6411370 0x562ce6411790 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 >> 172.21.15.164:0/2561026516 conn(0x562ce6405720 msgr2=0x562ce6405b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 shutdown_connections 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2561026516 wait complete. 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 msgr2=0x562ce63fd940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 0x562ce63fd940 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 msgr2=0x562ce64021d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 0x562ce64021d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 msgr2=0x7fcaac03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 0x7fcaac03f2d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8057000 tx=0x7fcbb8052000 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 msgr2=0x562ce63f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x562ce63ef780 tx=0x7fcbb4000bc0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 shutdown_connections 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ce63ffd60 0x562ce64021d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ce6302bc0 0x562ce63fd940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcaac03ce10 0x7fcaac03f2d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 --2- 172.21.15.164:0/2762445213 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ce6271fb0 0x562ce63f62f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 >> 172.21.15.164:0/2762445213 conn(0x562ce62f8fa0 msgr2=0x562ce63efce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 shutdown_connections 2024-09-14T10:55:28.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:28.995+0000 7fcbc8a0e800 1 -- 172.21.15.164:0/2762445213 wait complete. 2024-09-14T10:55:29.008 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-14T10:55:29.011 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-14T10:55:29.014 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:29.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-14T10:55:29.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-14T10:55:29.014 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-14T10:55:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.060 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.063+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.063+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.063+0000 7fbd93d40800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x556cd77a3bd0 0x556cd77a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.063+0000 7fbd93d40800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556cd77a66f0 con 0x556cd7713030 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.063+0000 7fbd93d40800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x556cd762a7d0 con 0x556cd77a3bd0 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8f2ec640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x556cd77a3bd0 0x556cd77a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8faed640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x556cd7713030 0x556cd77a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:38866/0 (socket says 172.21.15.164:38866) 2024-09-14T10:55:29.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8faed640 1 -- 172.21.15.164:0/4052565566 learned_addr learned my addr 172.21.15.164:0/4052565566 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/4052565566 >> v1:172.21.15.116:6789/0 conn(0x556cd7713030 legacy=0x556cd77a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8eaeb640 1 -- 172.21.15.164:0/4052565566 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010265725 0 0) 0x556cd77a66f0 con 0x556cd7713030 2024-09-14T10:55:29.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.064+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/4052565566 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd77a7920 con 0x556cd77a3bd0 2024-09-14T10:55:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.066+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/4052565566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd77a3bd0 0x556cd77a6070 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a470 tx=0x7fbd78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400e762e6aa8fb99 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.066+0000 7fbd8eaeb640 1 -- 172.21.15.164:0/4052565566 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78053570 con 0x556cd77a3bd0 2024-09-14T10:55:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.066+0000 7fbd8eaeb640 1 -- 172.21.15.164:0/4052565566 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd78058070 con 0x556cd77a3bd0 2024-09-14T10:55:29.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.066+0000 7fbd8eaeb640 1 -- 172.21.15.164:0/4052565566 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd78053880 con 0x556cd77a3bd0 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 -- 172.21.15.164:0/4052565566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd77a3bd0 msgr2=0x556cd77a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 --2- 172.21.15.164:0/4052565566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd77a3bd0 0x556cd77a6070 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800a470 tx=0x7fbd78045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 -- 172.21.15.164:0/4052565566 shutdown_connections 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 --2- 172.21.15.164:0/4052565566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd77a3bd0 0x556cd77a6070 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 -- 172.21.15.164:0/4052565566 >> 172.21.15.164:0/4052565566 conn(0x556cd7799fa0 msgr2=0x556cd779c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 -- 172.21.15.164:0/4052565566 shutdown_connections 2024-09-14T10:55:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.067+0000 7fbd93d40800 1 -- 172.21.15.164:0/4052565566 wait complete. 2024-09-14T10:55:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.080+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.080+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd93d40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd93d40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd7637dd0 con 0x556cd7713030 2024-09-14T10:55:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd8faed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd8faed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34422/0 (socket says 172.21.15.164:34422) 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd8faed640 1 -- 172.21.15.164:0/2462440745 learned_addr learned my addr 172.21.15.164:0/2462440745 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd8faed640 1 -- 172.21.15.164:0/2462440745 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd788fbe0 con 0x556cd7713030 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2462440745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001ea0 tx=0x7fbd8000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b7c43eda8ec66b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbc7de0b640 1 -- 172.21.15.164:0/2462440745 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd80008070 con 0x556cd7713030 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.081+0000 7fbc7de0b640 1 -- 172.21.15.164:0/2462440745 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8000d500 con 0x556cd7713030 2024-09-14T10:55:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbc7de0b640 1 -- 172.21.15.164:0/2462440745 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000d880 con 0x556cd7713030 2024-09-14T10:55:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 -- 172.21.15.164:0/2462440745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 msgr2=0x556cd788f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2462440745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbd80001ea0 tx=0x7fbd8000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 -- 172.21.15.164:0/2462440745 shutdown_connections 2024-09-14T10:55:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2462440745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd788f5f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 -- 172.21.15.164:0/2462440745 >> 172.21.15.164:0/2462440745 conn(0x556cd7799fa0 msgr2=0x556cd788af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 -- 172.21.15.164:0/2462440745 shutdown_connections 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 -- 172.21.15.164:0/2462440745 wait complete. 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.082+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd93d40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd93d40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd77a6bc0 con 0x556cd7713030 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd8faed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd8faed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34426/0 (socket says 172.21.15.164:34426) 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd8faed640 1 -- 172.21.15.164:0/2673803307 learned_addr learned my addr 172.21.15.164:0/2673803307 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.083+0000 7fbd8faed640 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd7897690 con 0x556cd7713030 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbd800012f0 tx=0x7fbd80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbc77fff640 1 -- 172.21.15.164:0/2673803307 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8000f9d0 con 0x556cd7713030 2024-09-14T10:55:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cd7897920 con 0x556cd7713030 2024-09-14T10:55:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbc77fff640 1 -- 172.21.15.164:0/2673803307 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8000fb70 con 0x556cd7713030 2024-09-14T10:55:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd7898320 con 0x556cd7713030 2024-09-14T10:55:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.084+0000 7fbc77fff640 1 -- 172.21.15.164:0/2673803307 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8002b060 con 0x556cd7713030 2024-09-14T10:55:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbc77fff640 1 -- 172.21.15.164:0/2673803307 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbd80017040 con 0x556cd7713030 2024-09-14T10:55:29.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbc77fff640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 0x7fbc7803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbc77fff640 1 -- 172.21.15.164:0/2673803307 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbd80015020 con 0x556cd7713030 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 0x7fbc7803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 0x556cd789e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd789ecc0 con 0x556cd77a3bd0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd902ee640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 0x556cd789e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 0x7fbc7803f2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd78057000 tx=0x7fbd78052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.085+0000 7fbd902ee640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 0x556cd789e780 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd902ee640 1 -- 172.21.15.164:0/2673803307 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd8800a4d0 con 0x556cd77a3bd0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd789f060 con 0x556cd77a3bd0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd902ee640 1 -- 172.21.15.164:0/2673803307 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd8800a4d0 con 0x556cd77a3bd0 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 0x556cd78a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78a3730 con 0x556cd78a0b20 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 0x556cd78a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.086+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 0x556cd78a2fa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.087+0000 7fbd8faed640 1 -- 172.21.15.164:0/2673803307 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd8002d070 con 0x556cd78a0b20 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.087+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd789f8b0 con 0x556cd77a3bd0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.087+0000 7fbd902ee640 1 -- 172.21.15.164:0/2673803307 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd8800a4d0 con 0x556cd77a3bd0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.087+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd789fc90 con 0x556cd77a3bd0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.087+0000 7fbd902ee640 1 -- 172.21.15.164:0/2673803307 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd8800a4d0 con 0x556cd77a3bd0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd93d40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd93d40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd76964a0 con 0x556cd78b2140 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34432/0 (socket says 172.21.15.164:34432) 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd902ee640 1 -- 172.21.15.164:0/2683192887 learned_addr learned my addr 172.21.15.164:0/2683192887 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.088+0000 7fbd902ee640 1 -- 172.21.15.164:0/2683192887 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd78b2ba0 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbd902ee640 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x556cd7898130 tx=0x7fbd88018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbc757fa640 1 -- 172.21.15.164:0/2683192887 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88014450 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbc757fa640 1 -- 172.21.15.164:0/2683192887 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88014610 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cd78b33d0 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbc757fa640 1 -- 172.21.15.164:0/2683192887 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88014930 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.089+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd78b3970 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbc757fa640 1 -- 172.21.15.164:0/2683192887 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbd88011040 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbc757fa640 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 0x7fbc6803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbc757fa640 1 -- 172.21.15.164:0/2683192887 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbd8801e070 con 0x556cd78b2140 2024-09-14T10:55:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 0x7fbc6803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd8faed640 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 0x7fbc6803f2d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556cd78991e0 tx=0x7fbd8001b440 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd93d40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.090+0000 7fbd93d40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd7890010 con 0x556cd78bebe0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34438/0 (socket says 172.21.15.164:34438) 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbd902ee640 1 -- 172.21.15.164:0/1344841058 learned_addr learned my addr 172.21.15.164:0/1344841058 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbd902ee640 1 -- 172.21.15.164:0/1344841058 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd78bf5d0 con 0x556cd78bebe0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbd902ee640 1 --2- 172.21.15.164:0/1344841058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbd88016fd0 tx=0x7fbd88011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6aaa4fc9fde5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbc6effd640 1 -- 172.21.15.164:0/1344841058 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8804b070 con 0x556cd78bebe0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbc6effd640 1 -- 172.21.15.164:0/1344841058 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88051070 con 0x556cd78bebe0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.091+0000 7fbc6effd640 1 -- 172.21.15.164:0/1344841058 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd88022df0 con 0x556cd78bebe0 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- 172.21.15.164:0/1344841058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 msgr2=0x556cd78befe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1344841058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbd88016fd0 tx=0x7fbd88011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- 172.21.15.164:0/1344841058 shutdown_connections 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1344841058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78befe0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- 172.21.15.164:0/1344841058 >> 172.21.15.164:0/1344841058 conn(0x556cd78bafe0 msgr2=0x556cd78b9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- 172.21.15.164:0/1344841058 shutdown_connections 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- 172.21.15.164:0/1344841058 wait complete. 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 Processor -- start 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- start start 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd93d40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x556cd78bfbf0 con 0x556cd78bebe0 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd902ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:34442/0 (socket says 172.21.15.164:34442) 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 learned_addr learned my addr 172.21.15.164:0/1378603147 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.092+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cd78c6780 con 0x556cd78bebe0 2024-09-14T10:55:29.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbd902ee640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78c6220 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd88053400 tx=0x7fbd88054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbc6d7fa640 1 -- 172.21.15.164:0/1378603147 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd8804b040 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbc6d7fa640 1 -- 172.21.15.164:0/1378603147 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd88031030 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbc6d7fa640 1 -- 172.21.15.164:0/1378603147 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd880167c0 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556cd78c6a10 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.093+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cd78c75a0 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.094+0000 7fbc6d7fa640 1 -- 172.21.15.164:0/1378603147 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbd88011330 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.094+0000 7fbc6d7fa640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc5803ce60 0x7fbc5803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.094+0000 7fbc6d7fa640 1 -- 172.21.15.164:0/1378603147 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fbd8800e040 con 0x556cd78bebe0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.094+0000 7fbd8faed640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc5803ce60 0x7fbc5803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.094+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd78d1fb0 0x556cd78d4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d4bc0 con 0x556cd78d1fb0 2024-09-14T10:55:29.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd78d1fb0 0x556cd78d4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd8faed640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc5803ce60 0x7fbc5803f320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd8001a4d0 tx=0x7fbd80051000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd78d1fb0 0x556cd78d4470 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 20 realm 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d4ff0 con 0x556cd78d1fb0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.095+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d58c0 con 0x556cd78d1fb0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d5c60 con 0x556cd78d1fb0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78d69c0 0x556cd78d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d93c0 con 0x556cd78d69c0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd902ee640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78d69c0 0x556cd78d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.096+0000 7fbd902ee640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78d69c0 0x556cd78d8db0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd8803e070 con 0x556cd78d69c0 2024-09-14T10:55:29.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd93d40800 20 searching for the correct realm 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd8803e070 con 0x556cd78d69c0 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd902ee640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbd88014070 0x7fbd8802d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd8faed640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbd88014070 0x7fbd8802d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.097+0000 7fbd8faed640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbd88014070 0x7fbd8802d450 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8faed640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbd8004b450 0x7fbd8004b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbd8004b450 0x7fbd8004b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8f2ec640 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbd8004b450 0x7fbd8004b870 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.098+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.099+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8803e070 con 0x556cd78d69c0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.100+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd8803e070 con 0x556cd78d69c0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.101+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.102+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.103+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x556cd78d1fb0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd78051070 con 0x7fbd8004b450 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.104+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d69c0 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd8004b450 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.105+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x556cd78d1fb0 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dacb0 con 0x7fbd88014070 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:29.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78d9d80 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78da5d0 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.106+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78db130 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:29.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 zone default found 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 4 Realm: () 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 zonegroup default 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78db130 con 0x7fbd8004b450 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dcf40 con 0x556cd78d69c0 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.107+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dd410 con 0x556cd78d69c0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.108+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.108+0000 7fbd93d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.108+0000 7fbd93d40800 20 started sync module instance, tier type = 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.108+0000 7fbd93d40800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.108+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dc3e0 con 0x7fbd88014070 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.109+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.109+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93925961222096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dc040 con 0x7fbd88014070 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.109+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78de340 con 0x556cd78d1fb0 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.110+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93925961222096] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.110+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.110+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93925961227920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78de760 con 0x556cd78d1fb0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.110+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78df120 con 0x556cd78d69c0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.111+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.111+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93925961231472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78df580 con 0x556cd78d69c0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.111+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e00a0 con 0x7fbd88014070 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.111+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93925961227920] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.112+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93925961231472] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.112+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.112+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93925961235312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78df090 con 0x7fbd88014070 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.112+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e0ab0 con 0x556cd78d1fb0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.113+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.113+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93925961238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e11e0 con 0x556cd78d1fb0 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.113+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e1ce0 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.113+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93925961235312] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.114+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.114+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93925961242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e1ca0 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.114+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2760 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.114+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93925961238288] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.115+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93925961242576] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.115+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.115+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93925961228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2270 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.115+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2c30 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93925961246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2ba0 con 0x7fbd8004b450 2024-09-14T10:55:29.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=0 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=1 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=2 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=3 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=4 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=5 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93925961228976] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.116+0000 7fbd93d40800 20 add_watcher() i=6 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93925961246592] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd93d40800 20 add_watcher() i=7 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd93d40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e0c30 con 0x556cd78d1fb0 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.117+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93925961248720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e0c30 con 0x556cd78d1fb0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.118+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93925961248720] v35'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.118+0000 7fbc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.118+0000 7fbd93d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.118+0000 7fbd93d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.118+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee9d0 con 0x556cd78d1fb0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.119+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.119+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee9d0 con 0x7fbd8004b450 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.120+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.120+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee9d0 con 0x556cd78d69c0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.122+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.122+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee9d0 con 0x556cd78d1fb0 2024-09-14T10:55:29.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.122+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'140 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.122+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee9d0 con 0x7fbd88014070 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.123+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.123+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee040 con 0x556cd78d69c0 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.124+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.124+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee040 con 0x556cd78d1fb0 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.125+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.125+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee210 con 0x7fbd8004b450 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.126+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.126+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ee210 con 0x7fbd88014070 2024-09-14T10:55:29.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.127+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.127+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x556cd78d69c0 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.128+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.128+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x7fbd88014070 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.129+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.129+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x7fbd8004b450 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.130+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.130+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x7fbd88014070 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.131+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.131+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x7fbd8004b450 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.132+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.132+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x556cd78d1fb0 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.133+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.133+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x556cd78d69c0 2024-09-14T10:55:29.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.134+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.134+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0920 con 0x7fbd88014070 2024-09-14T10:55:29.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.135+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.135+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78f0af0 con 0x556cd78d69c0 2024-09-14T10:55:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.136+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.136+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d1fb0 2024-09-14T10:55:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.137+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.137+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d1fb0 2024-09-14T10:55:29.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.138+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'142 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.138+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.139+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'36 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.139+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x7fbd88014070 2024-09-14T10:55:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.140+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.140+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.141+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.141+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.142+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.142+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.143+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.143+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.144+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.144+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x7fbd8004b450 2024-09-14T10:55:29.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.145+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.145+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.146+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.146+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x7fbd8004b450 2024-09-14T10:55:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.147+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.147+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x556cd78d69c0 2024-09-14T10:55:29.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.148+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.148+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x7fbd8004b450 2024-09-14T10:55:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.149+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.149+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78ede70 con 0x7fbd88014070 2024-09-14T10:55:29.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.150+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbc44fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 20 Filter name: none 2024-09-14T10:55:29.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbbbe7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd791b9f0 con 0x7fbd88014070 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.151+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd791d400 con 0x7fbd88014070 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(95 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:29.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 get_obj_state: octx=0x7fbd880367a0 obj=myfoo:four state=0x556cd791e1b8 s->prefetch_data=0 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 3.2as0 3:5453b794:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1_four:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556cd7920460 con 0x556cd78d1fb0 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(96 4d2cef0f-8511-4251-8070-7385f93096af.4241.1_four [call out=24b,getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 276+0+891 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 10 manifest: total_size = 4 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.16912233472896689283 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 get_obj_state: octx=0x7fbd880367a0 obj=myfoo:four state=0x556cd791e1b8 s->prefetch_data=0 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 prepare_atomic_modification: state is not atomic. state=0x556cd791e1b8 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 2024-09-14T10:55:29.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.152+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd7923f90 con 0x556cd78d69c0 2024-09-14T10:55:29.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.153+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(97 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.153+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 3.2as0 3:5453b794:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd7923f90 con 0x556cd78d1fb0 2024-09-14T10:55:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.154+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(98 4d2cef0f-8511-4251-8070-7385f93096af.4241.1_four [call] v35'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.154+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd7924a20 con 0x556cd78d69c0 2024-09-14T10:55:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.156+0000 7fbc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.156+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93925961248720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd7924a20 con 0x556cd78d1fb0 2024-09-14T10:55:29.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.157+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(99 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.157+0000 7fbc6effd640 20 handle_completion(): completion ok for obj=four 2024-09-14T10:55:29.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.157+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 93925961248720] v35'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.157+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93925961222096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd7924a20 con 0x7fbd88014070 2024-09-14T10:55:29.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.158+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 93925961222096] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.158+0000 7fbd93d40800 20 remove_watcher() i=0 2024-09-14T10:55:29.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.158+0000 7fbd93d40800 2 removed watcher, disabling cache 2024-09-14T10:55:29.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.158+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93925961227920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2fd0 con 0x556cd78d1fb0 2024-09-14T10:55:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.159+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 93925961227920] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.159+0000 7fbd93d40800 20 remove_watcher() i=1 2024-09-14T10:55:29.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.159+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93925961231472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dc7d0 con 0x556cd78d69c0 2024-09-14T10:55:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.160+0000 7fbd902ee640 1 -- 172.21.15.164:0/1378603147 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 93925961231472] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd88063040 con 0x556cd78d69c0 2024-09-14T10:55:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.160+0000 7fbd93d40800 20 remove_watcher() i=2 2024-09-14T10:55:29.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.160+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93925961235312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dde90 con 0x7fbd88014070 2024-09-14T10:55:29.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.161+0000 7fbd8faed640 1 -- 172.21.15.164:0/1378603147 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 93925961235312] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd80039070 con 0x7fbd88014070 2024-09-14T10:55:29.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.161+0000 7fbd93d40800 20 remove_watcher() i=3 2024-09-14T10:55:29.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.161+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93925961238288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2fd0 con 0x556cd78d1fb0 2024-09-14T10:55:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.162+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 93925961238288] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x556cd78d1fb0 2024-09-14T10:55:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.162+0000 7fbd93d40800 20 remove_watcher() i=4 2024-09-14T10:55:29.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.162+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93925961242576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dec70 con 0x7fbd8004b450 2024-09-14T10:55:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.163+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 93925961242576] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.163+0000 7fbd93d40800 20 remove_watcher() i=5 2024-09-14T10:55:29.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.163+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93925961228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78dc7d0 con 0x7fbd8004b450 2024-09-14T10:55:29.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.164+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 93925961228976] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.164+0000 7fbd93d40800 20 remove_watcher() i=6 2024-09-14T10:55:29.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.164+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93925961246592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556cd78e2fd0 con 0x7fbd8004b450 2024-09-14T10:55:29.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 93925961246592] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd7807f040 con 0x7fbd8004b450 2024-09-14T10:55:29.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 20 remove_watcher() i=7 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbd8004b450 msgr2=0x7fbd8004b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbd8004b450 0x7fbd8004b870 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd78d1fb0 msgr2=0x556cd78d4470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd78d1fb0 0x556cd78d4470 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbd88014070 msgr2=0x7fbd8802d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbd88014070 0x7fbd8802d450 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78d69c0 msgr2=0x556cd78d8db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78d69c0 0x556cd78d8db0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc5803ce60 msgr2=0x7fbc5803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.165+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc5803ce60 0x7fbc5803f320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd8001a4d0 tx=0x7fbd80051000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 msgr2=0x556cd78c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/1378603147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78bebe0 0x556cd78c6220 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbd88053400 tx=0x7fbd88054510 comp rx=0 tx=0).stop 2024-09-14T10:55:29.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 reap_dead start 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd8f2ec640 1 -- 172.21.15.164:0/1378603147 reap_dead start 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 shutdown_connections 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 >> 172.21.15.164:0/1378603147 conn(0x556cd78bafe0 msgr2=0x556cd78b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 shutdown_connections 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/1378603147 wait complete. 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 msgr2=0x7fbc6803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 0x7fbc6803f2d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556cd78991e0 tx=0x7fbd8001b440 comp rx=0 tx=0).stop 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 msgr2=0x556cd78b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x556cd7898130 tx=0x7fbd88018830 comp rx=0 tx=0).stop 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 shutdown_connections 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc6803ce10 0x7fbc6803f2d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2683192887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd78b2140 0x556cd78b2560 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 >> 172.21.15.164:0/2683192887 conn(0x556cd78a64f0 msgr2=0x556cd78a68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 shutdown_connections 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2683192887 wait complete. 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 msgr2=0x556cd789e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 0x556cd789e780 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 msgr2=0x556cd78a2fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.166+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 0x556cd78a2fa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 msgr2=0x7fbc7803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 0x7fbc7803f2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd78057000 tx=0x7fbd78052000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 msgr2=0x556cd7897130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbd800012f0 tx=0x7fbd80000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 shutdown_connections 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x556cd78a0b20 0x556cd78a2fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x556cd77a3bd0 0x556cd789e780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbc7803ce10 0x7fbc7803f2d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 --2- 172.21.15.164:0/2673803307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556cd7713030 0x556cd7897130 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 >> 172.21.15.164:0/2673803307 conn(0x556cd7799fa0 msgr2=0x556cd7890ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 shutdown_connections 2024-09-14T10:55:29.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.167+0000 7fbd93d40800 1 -- 172.21.15.164:0/2673803307 wait complete. 2024-09-14T10:55:29.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:29.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-14T10:55:29.173 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-14T10:55:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.220+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.220+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.220+0000 7fe11cd42800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5569eb2b9bb0 0x5569eb2bc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.220+0000 7fe11cd42800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5569eb2bc720 con 0x5569eb2297b0 2024-09-14T10:55:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.220+0000 7fe11cd42800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5569eb1407d0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe1102ec640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5569eb2b9bb0 0x5569eb2bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe118aed640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5569eb2297b0 0x5569eb2b8460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:57718/0 (socket says 172.21.15.164:57718) 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe118aed640 1 -- 172.21.15.164:0/3421347708 learned_addr learned my addr 172.21.15.164:0/3421347708 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe1102ec640 1 -- 172.21.15.164:0/3421347708 >> v1:172.21.15.116:6789/0 conn(0x5569eb2297b0 legacy=0x5569eb2b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe113fff640 1 -- 172.21.15.164:0/3421347708 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352374561 0 0) 0x5569eb2bc720 con 0x5569eb2297b0 2024-09-14T10:55:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.221+0000 7fe1102ec640 1 -- 172.21.15.164:0/3421347708 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb2bd950 con 0x5569eb2b9bb0 2024-09-14T10:55:29.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe1102ec640 1 --2- 172.21.15.164:0/3421347708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2b9bb0 0x5569eb2bc070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe10000a470 tx=0x7fe100045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec72627ae178eba server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe113fff640 1 -- 172.21.15.164:0/3421347708 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe100053570 con 0x5569eb2b9bb0 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe113fff640 1 -- 172.21.15.164:0/3421347708 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe100058070 con 0x5569eb2b9bb0 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe113fff640 1 -- 172.21.15.164:0/3421347708 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe100053880 con 0x5569eb2b9bb0 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 -- 172.21.15.164:0/3421347708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2b9bb0 msgr2=0x5569eb2bc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 --2- 172.21.15.164:0/3421347708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2b9bb0 0x5569eb2bc070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe10000a470 tx=0x7fe100045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 -- 172.21.15.164:0/3421347708 shutdown_connections 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 --2- 172.21.15.164:0/3421347708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2b9bb0 0x5569eb2bc070 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 -- 172.21.15.164:0/3421347708 >> 172.21.15.164:0/3421347708 conn(0x5569eb2affb0 msgr2=0x5569eb2b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 -- 172.21.15.164:0/3421347708 shutdown_connections 2024-09-14T10:55:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.223+0000 7fe11cd42800 1 -- 172.21.15.164:0/3421347708 wait complete. 2024-09-14T10:55:29.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.237+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.237+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.237+0000 7fe11cd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.237+0000 7fe11cd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eb14ddd0 con 0x5569eb2297b0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe118aed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe118aed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35156/0 (socket says 172.21.15.164:35156) 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe118aed640 1 -- 172.21.15.164:0/4150913928 learned_addr learned my addr 172.21.15.164:0/4150913928 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe118aed640 1 -- 172.21.15.164:0/4150913928 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb3a5b90 con 0x5569eb2297b0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe118aed640 1 --2- 172.21.15.164:0/4150913928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe108001ea0 tx=0x7fe10800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91487c7016de627 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe006e0d640 1 -- 172.21.15.164:0/4150913928 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe108008070 con 0x5569eb2297b0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe006e0d640 1 -- 172.21.15.164:0/4150913928 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10800d500 con 0x5569eb2297b0 2024-09-14T10:55:29.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.238+0000 7fe006e0d640 1 -- 172.21.15.164:0/4150913928 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe10800d880 con 0x5569eb2297b0 2024-09-14T10:55:29.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- 172.21.15.164:0/4150913928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 msgr2=0x5569eb3a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 --2- 172.21.15.164:0/4150913928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe108001ea0 tx=0x7fe10800b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- 172.21.15.164:0/4150913928 shutdown_connections 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 --2- 172.21.15.164:0/4150913928 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb3a55a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- 172.21.15.164:0/4150913928 >> 172.21.15.164:0/4150913928 conn(0x5569eb2affb0 msgr2=0x5569eb3a0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- 172.21.15.164:0/4150913928 shutdown_connections 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- 172.21.15.164:0/4150913928 wait complete. 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.239+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe11cd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe11cd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eb2bcbf0 con 0x5569eb2297b0 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe118aed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe118aed640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35164/0 (socket says 172.21.15.164:35164) 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe118aed640 1 -- 172.21.15.164:0/1891086570 learned_addr learned my addr 172.21.15.164:0/1891086570 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe118aed640 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb2b60d0 con 0x5569eb2297b0 2024-09-14T10:55:29.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe118aed640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe108000f60 tx=0x7fe108000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe00560a640 1 -- 172.21.15.164:0/1891086570 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe10800f8d0 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe00560a640 1 -- 172.21.15.164:0/1891086570 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10800fa70 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.240+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569eb2b4480 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.241+0000 7fe00560a640 1 -- 172.21.15.164:0/1891086570 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe10800fd50 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.241+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569eb2b4a40 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.241+0000 7fe00560a640 1 -- 172.21.15.164:0/1891086570 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe108017040 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe00560a640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 0x7fe00003f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe00560a640 1 -- 172.21.15.164:0/1891086570 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe108015020 con 0x5569eb2297b0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe1102ec640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 0x7fe00003f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 0x5569eb3b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3b6b30 con 0x5569eb2b9bb0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe1192ee640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 0x5569eb3b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe1102ec640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 0x7fe00003f370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe100057000 tx=0x7fe100052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe1192ee640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 0x5569eb3b65f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.242+0000 7fe1192ee640 1 -- 172.21.15.164:0/1891086570 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe11400a4d0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb2b4f40 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe1192ee640 1 -- 172.21.15.164:0/1891086570 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe11400a4d0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 0x5569eb3bb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3bb940 con 0x5569eb3b8e80 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe118aed640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 0x5569eb3bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.243+0000 7fe118aed640 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 0x5569eb3bb270 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe118aed640 1 -- 172.21.15.164:0/1891086570 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe10802d070 con 0x5569eb3b8e80 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3b7cf0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe1192ee640 1 -- 172.21.15.164:0/1891086570 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe11400a4d0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3b8190 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe1192ee640 1 -- 172.21.15.164:0/1891086570 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe11400a4d0 con 0x5569eb2b9bb0 2024-09-14T10:55:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.244+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe11cd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe11cd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eb1ac4a0 con 0x5569eb3ca330 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35166/0 (socket says 172.21.15.164:35166) 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe1192ee640 1 -- 172.21.15.164:0/1480626463 learned_addr learned my addr 172.21.15.164:0/1480626463 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe1192ee640 1 -- 172.21.15.164:0/1480626463 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb3cad90 con 0x5569eb3ca330 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe1192ee640 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5569eb3b6f30 tx=0x7fe114018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fdffe7fc640 1 -- 172.21.15.164:0/1480626463 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe114014450 con 0x5569eb3ca330 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fdffe7fc640 1 -- 172.21.15.164:0/1480626463 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1140145f0 con 0x5569eb3ca330 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569eb3cb5c0 con 0x5569eb3ca330 2024-09-14T10:55:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.245+0000 7fdffe7fc640 1 -- 172.21.15.164:0/1480626463 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe114014910 con 0x5569eb3ca330 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.246+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569eb3cbb60 con 0x5569eb3ca330 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.246+0000 7fdffe7fc640 1 -- 172.21.15.164:0/1480626463 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe114011040 con 0x5569eb3ca330 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.246+0000 7fdffe7fc640 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 0x7fdff003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fdffe7fc640 1 -- 172.21.15.164:0/1480626463 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe11401e070 con 0x5569eb3ca330 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe118aed640 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 0x7fdff003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe118aed640 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 0x7fdff003f320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe10800b6e0 tx=0x7fe10800fef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe11cd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe11cd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eb3a5fc0 con 0x5569eb3d6d00 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35170/0 (socket says 172.21.15.164:35170) 2024-09-14T10:55:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe1192ee640 1 -- 172.21.15.164:0/2917982482 learned_addr learned my addr 172.21.15.164:0/2917982482 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.247+0000 7fe1192ee640 1 -- 172.21.15.164:0/2917982482 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb3d76f0 con 0x5569eb3d6d00 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe1192ee640 1 --2- 172.21.15.164:0/2917982482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe114054530 tx=0x7fe114016c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6851bb76fa8fc8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fdfeffff640 1 -- 172.21.15.164:0/2917982482 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe114028070 con 0x5569eb3d6d00 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fdfeffff640 1 -- 172.21.15.164:0/2917982482 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe114016440 con 0x5569eb3d6d00 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fdfeffff640 1 -- 172.21.15.164:0/2917982482 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1140167c0 con 0x5569eb3d6d00 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 -- 172.21.15.164:0/2917982482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 msgr2=0x5569eb3d7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2917982482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe114054530 tx=0x7fe114016c80 comp rx=0 tx=0).stop 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 -- 172.21.15.164:0/2917982482 shutdown_connections 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2917982482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3d7100 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 -- 172.21.15.164:0/2917982482 >> 172.21.15.164:0/2917982482 conn(0x5569eb3d3100 msgr2=0x5569eb3d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 -- 172.21.15.164:0/2917982482 shutdown_connections 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.248+0000 7fe11cd42800 1 -- 172.21.15.164:0/2917982482 wait complete. 2024-09-14T10:55:29.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe11cd42800 1 Processor -- start 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe11cd42800 1 -- start start 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe11cd42800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe11cd42800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5569eb3d7d10 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe1192ee640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35172/0 (socket says 172.21.15.164:35172) 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 learned_addr learned my addr 172.21.15.164:0/2013138826 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569eb3de900 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe1192ee640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe114016cc0 tx=0x7fe114054490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fdfee7fc640 1 -- 172.21.15.164:0/2013138826 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe114044070 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fdfee7fc640 1 -- 172.21.15.164:0/2013138826 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe114032070 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569eb3deb90 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.249+0000 7fdfee7fc640 1 -- 172.21.15.164:0/2013138826 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe114054a00 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.250+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569eb3df510 con 0x5569eb3d6d00 2024-09-14T10:55:29.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.250+0000 7fdfee7fc640 1 -- 172.21.15.164:0/2013138826 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe114054ba0 con 0x5569eb3d6d00 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.250+0000 7fdfee7fc640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdfe403ce60 0x7fdfe403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.250+0000 7fdfee7fc640 1 -- 172.21.15.164:0/2013138826 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fe11400e040 con 0x5569eb3d6d00 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe118aed640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdfe403ce60 0x7fdfe403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe118aed640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdfe403ce60 0x7fdfe403f320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe108000fb0 tx=0x7fe108041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb3ea020 0x5569eb3ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3ecc30 con 0x5569eb3ea020 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe1102ec640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb3ea020 0x5569eb3ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.251+0000 7fe1102ec640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb3ea020 0x5569eb3ec4e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 realm 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3ed060 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3ed930 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3edcd0 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3eea30 0x5569eb3f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f1360 con 0x5569eb3eea30 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.252+0000 7fe1192ee640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3eea30 0x5569eb3f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe1192ee640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3eea30 0x5569eb3f0e20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe11cd42800 20 searching for the correct realm 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe1192ee640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe114014070 0x7fe11402ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.253+0000 7fe118aed640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe114014070 0x7fe11402ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe118aed640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe114014070 0x7fe11402ca00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe118aed640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe10803c040 0x7fe10804b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe1102ec640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe10803c040 0x7fe10804b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.254+0000 7fe1102ec640 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe10803c040 0x7fe10804b420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.255+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.256+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.257+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.258+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.259+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x5569eb3ea020 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.260+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe100051070 con 0x7fe10803c040 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3eea30 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe10803c040 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.261+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x5569eb3ea020 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2cb0 con 0x7fe114014070 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f1da0 con 0x5569eb3ea020 2024-09-14T10:55:29.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f2640 con 0x5569eb3ea020 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.262+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f19e0 con 0x5569eb3ea020 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 zone default found 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 4 Realm: () 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:29.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 zonegroup default 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f3160 con 0x7fe10803c040 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f4ce0 con 0x5569eb3eea30 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f5220 con 0x5569eb3eea30 2024-09-14T10:55:29.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 started sync module instance, tier type = 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.263+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f3ff0 con 0x7fe114014070 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.265+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.265+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93913406718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f5b30 con 0x7fe114014070 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.265+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f6380 con 0x5569eb3ea020 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.266+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93913406718944] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.266+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.266+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93913406723712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f6400 con 0x5569eb3ea020 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.266+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f6f20 con 0x5569eb3eea30 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.267+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.267+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93913406728688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f6f20 con 0x5569eb3eea30 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.267+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f7f10 con 0x7fe114014070 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.267+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93913406723712] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.268+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93913406728688] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.268+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.268+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93913406731024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f5ed0 con 0x7fe114014070 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.268+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f8920 con 0x5569eb3ea020 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.269+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93913406731024] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.269+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.269+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93913406735472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f8d40 con 0x5569eb3ea020 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.269+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f9590 con 0x7fe10803c040 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.270+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.270+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93913406738240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f99c0 con 0x7fe10803c040 2024-09-14T10:55:29.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.270+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3fa4a0 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.270+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93913406735472] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.271+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.271+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93913406736528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3fa460 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.271+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3faf50 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.271+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93913406738240] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93913406736528] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93913406745120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f9fb0 con 0x7fe10803c040 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=0 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=1 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=2 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=3 2024-09-14T10:55:29.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=4 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=5 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.272+0000 7fe11cd42800 20 add_watcher() i=6 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93913406745120] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe11cd42800 20 add_watcher() i=7 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe11cd42800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f9fb0 con 0x5569eb3ea020 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.273+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93913406739360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb3f9fb0 con 0x5569eb3ea020 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93913406739360] v35'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fdfcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe11cd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe11cd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe11cd42800 5 note: GC not initialized 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fdfce7e4640 20 reqs_thread_entry: start 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe11cd42800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:29.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fe11cd42800 20 Filter name: none 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.275+0000 7fdfc7fff640 20 reqs_thread_entry: start 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb4310f0 con 0x7fe114014070 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb431cf0 con 0x7fe114014070 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb431d30 con 0x7fe114014070 2024-09-14T10:55:29.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.276+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb433530 con 0x7fe114014070 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(65 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 4.f 4:f0239f39:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb4350f0 con 0x5569eb3ea020 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 4.38 4:1f04a4af:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb437c90 con 0x5569eb3ea020 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 4.39 4:9fbb9af9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb43a650 con 0x5569eb3eea30 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 4.1a 4:58ff1328:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb43cec0 con 0x7fe114014070 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 4.2c 4:346bfbf7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb43fa50 con 0x5569eb3ea020 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 4.14 4:28e9a4ac:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb4423b0 con 0x5569eb3eea30 2024-09-14T10:55:29.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:72 4.16 4:687c2ba7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb444880 con 0x5569eb3eea30 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(66 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(69 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(67 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.277+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(70 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(71 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(72 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 4.17 4:eb4c7ac0:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb43f5b0 con 0x7fe10803c040 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 4.26 4:66262f28:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb434cd0 con 0x7fe10803c040 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 4.27 4:e7fb0465:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb438180 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 4.35 4:aee5ca16:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5569eb43f5b0 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(75 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(76 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(74 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.278+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.279+0000 7fdfcf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.279+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93913406739360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x5569eb3ea020 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.280+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93913406739360] v35'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.280+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93913406718944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x7fe114014070 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.281+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93913406718944] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.281+0000 7fe11cd42800 20 remove_watcher() i=0 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.281+0000 7fe11cd42800 2 removed watcher, disabling cache 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.281+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93913406723712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x5569eb3ea020 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.282+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93913406723712] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.282+0000 7fe11cd42800 20 remove_watcher() i=1 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.282+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93913406728688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x5569eb3eea30 2024-09-14T10:55:29.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.283+0000 7fe1192ee640 1 -- 172.21.15.164:0/2013138826 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93913406728688] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe114058040 con 0x5569eb3eea30 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.283+0000 7fe11cd42800 20 remove_watcher() i=2 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.283+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93913406731024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x7fe114014070 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.284+0000 7fe118aed640 1 -- 172.21.15.164:0/2013138826 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93913406731024] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe108039070 con 0x7fe114014070 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.284+0000 7fe11cd42800 20 remove_watcher() i=3 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.284+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93913406735472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x5569eb3ea020 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.285+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93913406735472] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x5569eb3ea020 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.285+0000 7fe11cd42800 20 remove_watcher() i=4 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.285+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93913406738240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x7fe10803c040 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.286+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93913406738240] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.286+0000 7fe11cd42800 20 remove_watcher() i=5 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.286+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93913406736528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x7fe10803c040 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.287+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93913406736528] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.287+0000 7fe11cd42800 20 remove_watcher() i=6 2024-09-14T10:55:29.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.287+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93913406745120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5569eb42e9e0 con 0x7fe10803c040 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93913406745120] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10007f040 con 0x7fe10803c040 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 20 remove_watcher() i=7 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe10803c040 msgr2=0x7fe10804b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe10803c040 0x7fe10804b420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb3ea020 msgr2=0x5569eb3ec4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb3ea020 0x5569eb3ec4e0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe114014070 msgr2=0x7fe11402ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe114014070 0x7fe11402ca00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3eea30 msgr2=0x5569eb3f0e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3eea30 0x5569eb3f0e20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdfe403ce60 msgr2=0x7fdfe403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdfe403ce60 0x7fdfe403f320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe108000fb0 tx=0x7fe108041000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 msgr2=0x5569eb3de3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe1102ec640 1 -- 172.21.15.164:0/2013138826 reap_dead start 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe114016cc0 tx=0x7fe114054490 comp rx=0 tx=0).stop 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 shutdown_connections 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 --2- 172.21.15.164:0/2013138826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3d6d00 0x5569eb3de3a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.288+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 >> 172.21.15.164:0/2013138826 conn(0x5569eb3d3100 msgr2=0x5569eb3d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 shutdown_connections 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/2013138826 wait complete. 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 msgr2=0x7fdff003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 0x7fdff003f320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe10800b6e0 tx=0x7fe10800fef0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 msgr2=0x5569eb3ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5569eb3b6f30 tx=0x7fe114018830 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 shutdown_connections 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdff003ce60 0x7fdff003f320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1480626463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb3ca330 0x5569eb3ca750 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 >> 172.21.15.164:0/1480626463 conn(0x5569eb3be6e0 msgr2=0x5569eb3beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 shutdown_connections 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1480626463 wait complete. 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 msgr2=0x5569eb3b65f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 0x5569eb3b65f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 msgr2=0x5569eb3bb270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 0x5569eb3bb270 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 msgr2=0x7fe00003f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 0x7fe00003f370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe100057000 tx=0x7fe100052000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 msgr2=0x5569eb2b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe108000f60 tx=0x7fe108000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 shutdown_connections 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.289+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5569eb3b8e80 0x5569eb3bb270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5569eb2b9bb0 0x5569eb3b65f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe00003ceb0 0x7fe00003f370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 --2- 172.21.15.164:0/1891086570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5569eb2297b0 0x5569eb2b5b70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 >> 172.21.15.164:0/1891086570 conn(0x5569eb2affb0 msgr2=0x5569eb3a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 shutdown_connections 2024-09-14T10:55:29.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.290+0000 7fe11cd42800 1 -- 172.21.15.164:0/1891086570 wait complete. 2024-09-14T10:55:29.301 INFO:teuthology.orchestra.run.smithi164.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"c136da01-f20d-479c-ad02-fc389f5894e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","marker":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-14T10:55:28.800127Z","creation_time":"2024-09-14T10:55:26.137796Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-14T10:55:29.301 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:55:28.800127Z', 'creation_time': '2024-09-14T10:55:26.137796Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-14T10:55:29.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-14T10:55:29.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-14T10:55:29.302 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-14T10:55:29.344 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.344 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.346+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a5c11800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56521b105c00 0x56521b108050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a5c11800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56521b1086d0 con 0x56521b074ee0 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a5c11800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x56521af8c7d0 con 0x56521b105c00 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a1392640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x56521b074ee0 0x56521b1044e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:57728/0 (socket says 172.21.15.164:57728) 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a1392640 1 -- 172.21.15.164:0/2465020800 learned_addr learned my addr 172.21.15.164:0/2465020800 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:29.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2465020800 >> v2:172.21.15.116:3300/0 conn(0x56521b105c00 0x56521b108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f639bfff640 1 -- 172.21.15.164:0/2465020800 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187079999 0 0) 0x56521b1086d0 con 0x56521b074ee0 2024-09-14T10:55:29.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f639bfff640 1 -- 172.21.15.164:0/2465020800 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6390001e10 con 0x56521b074ee0 2024-09-14T10:55:29.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a0b91640 1 -- 172.21.15.164:0/2465020800 >> v1:172.21.15.116:6789/0 conn(0x56521b074ee0 legacy=0x56521b1044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.347+0000 7f63a0b91640 1 -- 172.21.15.164:0/2465020800 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b109900 con 0x56521b105c00 2024-09-14T10:55:29.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.349+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2465020800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b105c00 0x56521b108050 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f638c00a470 tx=0x7f638c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b773e59f5603c7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.349+0000 7f639bfff640 1 -- 172.21.15.164:0/2465020800 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c059070 con 0x56521b105c00 2024-09-14T10:55:29.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.349+0000 7f639bfff640 1 -- 172.21.15.164:0/2465020800 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c054570 con 0x56521b105c00 2024-09-14T10:55:29.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.349+0000 7f639bfff640 1 -- 172.21.15.164:0/2465020800 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638c054870 con 0x56521b105c00 2024-09-14T10:55:29.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 -- 172.21.15.164:0/2465020800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b105c00 msgr2=0x56521b108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2465020800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b105c00 0x56521b108050 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f638c00a470 tx=0x7f638c045920 comp rx=0 tx=0).stop 2024-09-14T10:55:29.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 -- 172.21.15.164:0/2465020800 shutdown_connections 2024-09-14T10:55:29.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2465020800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b105c00 0x56521b108050 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 -- 172.21.15.164:0/2465020800 >> 172.21.15.164:0/2465020800 conn(0x56521b0fbf70 msgr2=0x56521b0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 -- 172.21.15.164:0/2465020800 shutdown_connections 2024-09-14T10:55:29.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.350+0000 7f63a5c11800 1 -- 172.21.15.164:0/2465020800 wait complete. 2024-09-14T10:55:29.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a5c11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a5c11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56521af99dd0 con 0x56521b074ee0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a1392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a1392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35190/0 (socket says 172.21.15.164:35190) 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a1392640 1 -- 172.21.15.164:0/3295619881 learned_addr learned my addr 172.21.15.164:0/3295619881 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.364+0000 7f63a1392640 1 -- 172.21.15.164:0/3295619881 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b102230 con 0x56521b074ee0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f63a1392640 1 --2- 172.21.15.164:0/3295619881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6394001e30 tx=0x7f639400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d23926763af6d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f628f606640 1 -- 172.21.15.164:0/3295619881 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6394012020 con 0x56521b074ee0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f628f606640 1 -- 172.21.15.164:0/3295619881 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639400e470 con 0x56521b074ee0 2024-09-14T10:55:29.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f628f606640 1 -- 172.21.15.164:0/3295619881 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639400e790 con 0x56521b074ee0 2024-09-14T10:55:29.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f63a5c11800 1 -- 172.21.15.164:0/3295619881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 msgr2=0x56521b101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.365+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3295619881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6394001e30 tx=0x7f639400b780 comp rx=0 tx=0).stop 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- 172.21.15.164:0/3295619881 shutdown_connections 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3295619881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b101c40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- 172.21.15.164:0/3295619881 >> 172.21.15.164:0/3295619881 conn(0x56521b0fbf70 msgr2=0x56521b1ecfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- 172.21.15.164:0/3295619881 shutdown_connections 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- 172.21.15.164:0/3295619881 wait complete. 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a5c11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56521b108ba0 con 0x56521b074ee0 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a1392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a1392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35192/0 (socket says 172.21.15.164:35192) 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a1392640 1 -- 172.21.15.164:0/3070736114 learned_addr learned my addr 172.21.15.164:0/3070736114 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.366+0000 7f63a1392640 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b1fb860 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f63a1392640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x56521b101770 tx=0x7f63940040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f628de03640 1 -- 172.21.15.164:0/3070736114 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6394012030 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f628de03640 1 -- 172.21.15.164:0/3070736114 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639401a7a0 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f628de03640 1 -- 172.21.15.164:0/3070736114 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639401aaa0 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521b1fbaf0 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.367+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521b1fc700 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f628de03640 1 -- 172.21.15.164:0/3070736114 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f6394015020 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f628de03640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 0x7f628803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f628de03640 1 -- 172.21.15.164:0/3070736114 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f6394020070 con 0x56521b074ee0 2024-09-14T10:55:29.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f63a0b91640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 0x7f628803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 0x56521b202950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b202e90 con 0x56521b105c00 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f63a1b93640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 0x56521b202950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.368+0000 7f63a0b91640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 0x7f628803f2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x56521b0743e0 tx=0x7f638c050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a1b93640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 0x56521b202950 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a1b93640 1 -- 172.21.15.164:0/3070736114 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f639c00a4d0 con 0x56521b105c00 2024-09-14T10:55:29.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b203230 con 0x56521b105c00 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a1b93640 1 -- 172.21.15.164:0/3070736114 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f639c00a4d0 con 0x56521b105c00 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 0x56521b2071f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b207980 con 0x56521b204d70 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a1392640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 0x56521b2071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.369+0000 7f63a1392640 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 0x56521b2071f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.370+0000 7f63a1392640 1 -- 172.21.15.164:0/3070736114 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6394018950 con 0x56521b204d70 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.370+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b203a80 con 0x56521b105c00 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.370+0000 7f63a1b93640 1 -- 172.21.15.164:0/3070736114 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f639c00a4d0 con 0x56521b105c00 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.370+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b203ee0 con 0x56521b105c00 2024-09-14T10:55:29.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.370+0000 7f63a1b93640 1 -- 172.21.15.164:0/3070736114 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f639c00a4d0 con 0x56521b105c00 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a5c11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a5c11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56521aff84a0 con 0x56521b216390 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35202/0 (socket says 172.21.15.164:35202) 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a1b93640 1 -- 172.21.15.164:0/3765149012 learned_addr learned my addr 172.21.15.164:0/3765149012 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a1b93640 1 -- 172.21.15.164:0/3765149012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b216df0 con 0x56521b216390 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.371+0000 7f63a1b93640 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x56521b1fc920 tx=0x7f639c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f6286ffd640 1 -- 172.21.15.164:0/3765149012 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c014450 con 0x56521b216390 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f6286ffd640 1 -- 172.21.15.164:0/3765149012 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c014610 con 0x56521b216390 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521b217620 con 0x56521b216390 2024-09-14T10:55:29.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f6286ffd640 1 -- 172.21.15.164:0/3765149012 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c014930 con 0x56521b216390 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521b217bc0 con 0x56521b216390 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.372+0000 7f6286ffd640 1 -- 172.21.15.164:0/3765149012 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f639c011040 con 0x56521b216390 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f6286ffd640 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 0x7f627c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f6286ffd640 1 -- 172.21.15.164:0/3765149012 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f639c01e070 con 0x56521b216390 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a1392640 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 0x7f627c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a1392640 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 0x7f627c03f320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56521b1fd430 tx=0x7f6394052950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a5c11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a5c11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56521b100680 con 0x56521b222df0 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35210/0 (socket says 172.21.15.164:35210) 2024-09-14T10:55:29.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.373+0000 7f63a1b93640 1 -- 172.21.15.164:0/3749713717 learned_addr learned my addr 172.21.15.164:0/3749713717 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a1b93640 1 -- 172.21.15.164:0/3749713717 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b2237e0 con 0x56521b222df0 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a1b93640 1 --2- 172.21.15.164:0/3749713717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f639c016fd0 tx=0x7f639c02b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcf622dbd335f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f6284ff9640 1 -- 172.21.15.164:0/3749713717 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c04b070 con 0x56521b222df0 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f6284ff9640 1 -- 172.21.15.164:0/3749713717 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c051070 con 0x56521b222df0 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f6284ff9640 1 -- 172.21.15.164:0/3749713717 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c022de0 con 0x56521b222df0 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 -- 172.21.15.164:0/3749713717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 msgr2=0x56521b2231f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3749713717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f639c016fd0 tx=0x7f639c02b4c0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 -- 172.21.15.164:0/3749713717 shutdown_connections 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3749713717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b2231f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 -- 172.21.15.164:0/3749713717 >> 172.21.15.164:0/3749713717 conn(0x56521b21f1f0 msgr2=0x56521b21d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 -- 172.21.15.164:0/3749713717 shutdown_connections 2024-09-14T10:55:29.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.374+0000 7f63a5c11800 1 -- 172.21.15.164:0/3749713717 wait complete. 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a5c11800 1 Processor -- start 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a5c11800 1 -- start start 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a5c11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b22a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a5c11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56521b223e00 con 0x56521b222df0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b22a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a1b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b22a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35214/0 (socket says 172.21.15.164:35214) 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.375+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 learned_addr learned my addr 172.21.15.164:0/2160593351 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521b22a980 con 0x56521b222df0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f63a1b93640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b22a420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f639c0456b0 tx=0x7f639c0544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f6272ffd640 1 -- 172.21.15.164:0/2160593351 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c04b040 con 0x56521b222df0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f6272ffd640 1 -- 172.21.15.164:0/2160593351 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c031030 con 0x56521b222df0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521b22ac10 con 0x56521b222df0 2024-09-14T10:55:29.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f6272ffd640 1 -- 172.21.15.164:0/2160593351 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f639c0168f0 con 0x56521b222df0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.376+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521b22b590 con 0x56521b222df0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f6272ffd640 1 -- 172.21.15.164:0/2160593351 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f639c011330 con 0x56521b222df0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f6272ffd640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f626c03ce60 0x7f626c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f6272ffd640 1 -- 172.21.15.164:0/2160593351 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f639c00e040 con 0x56521b222df0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a1392640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f626c03ce60 0x7f626c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b236130 0x56521b2385f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b238d40 con 0x56521b236130 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b236130 0x56521b2385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.377+0000 7f63a1392640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f626c03ce60 0x7f626c03f320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f639400efd0 tx=0x7f6394046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b236130 0x56521b2385f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 realm 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b239110 con 0x56521b236130 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b2399e0 con 0x56521b236130 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.378+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b239d80 con 0x56521b236130 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b23a830 0x56521b23cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b23d380 con 0x56521b23a830 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a1b93640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b23a830 0x56521b23cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a1b93640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b23a830 0x56521b23cc20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 20 searching for the correct realm 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23ed40 con 0x56521b23a830 2024-09-14T10:55:29.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.379+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1b93640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f639c014070 0x7f639c023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23ed40 con 0x7f639c014070 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1392640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f639c014070 0x7f639c023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1392640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f639c014070 0x7f639c023420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1392640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f6394017050 0x7f6394042130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23ed40 con 0x7f6394017050 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.380+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f6394017050 0x7f6394042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.381+0000 7f63a0b91640 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f6394017050 0x7f6394042130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.381+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.381+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23ed40 con 0x56521b236130 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.381+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.381+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23ed40 con 0x56521b236130 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f639c014070 2024-09-14T10:55:29.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.382+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.383+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f639c014070 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.384+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.385+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f639c014070 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x56521b236130 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.386+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c061430 con 0x7f6394017050 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f639c014070 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.387+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b23a830 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f6394017050 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x56521b236130 2024-09-14T10:55:29.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f638c078040 con 0x7f639c014070 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.388+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b23de60 con 0x56521b236130 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b23e700 con 0x56521b236130 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b23daa0 con 0x56521b236130 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 zone default found 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 4 Realm: () 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:29.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 zonegroup default 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b23f1f0 con 0x7f6394017050 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.389+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b240d70 con 0x56521b23a830 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 20 started sync module instance, tier type = 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.390+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b240080 con 0x7f639c014070 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.391+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.391+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910642652272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b240890 con 0x7f639c014070 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.391+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242130 con 0x56521b236130 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.392+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910642652272] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.392+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.392+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910642658432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242550 con 0x56521b236130 2024-09-14T10:55:29.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.392+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242f50 con 0x56521b23a830 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.394+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.394+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910642661984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242f00 con 0x56521b23a830 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.394+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b243f20 con 0x7f639c014070 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.394+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910642661984] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.395+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910642658432] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.395+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.395+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910642659488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b243340 con 0x7f639c014070 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.395+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b244800 con 0x56521b236130 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.396+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.396+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910642668304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b2450a0 con 0x56521b236130 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.396+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b245b80 con 0x7f6394017050 2024-09-14T10:55:29.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.396+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910642659488] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.397+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.397+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910642673296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b245b80 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.397+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b246590 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.397+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910642668304] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.398+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.398+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910642670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b246590 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.398+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b246fa0 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.398+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910642673296] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910642670576] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910642675936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b246500 con 0x7f6394017050 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=0 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=1 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=2 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=3 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=4 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=5 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.399+0000 7f63a5c11800 20 add_watcher() i=6 2024-09-14T10:55:29.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910642675936] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a5c11800 20 add_watcher() i=7 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a5c11800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56521b249fd0 con 0x56521b236130 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.400+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910642678512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b2473c0 con 0x56521b236130 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.401+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910642678512] v35'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.401+0000 7f62577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.401+0000 7f63a5c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.401+0000 7f63a5c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.401+0000 7f63a5c11800 5 note: GC not initialized 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f62567e4640 20 reqs_thread_entry: start 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f63a5c11800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:29.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f63a5c11800 20 Filter name: none 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f61c7fff640 20 reqs_thread_entry: start 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b27c5e0 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.402+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(62 [pgnls start_epoch 35 out=254b] v35'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23e700 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(63 [pgnls start_epoch 35 out=131b] v35'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b23e700 con 0x56521b23a830 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(65 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.403+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(66 [pgnls start_epoch 35 out=335b] v35'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(67 [pgnls start_epoch 35 out=213b] v35'11 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 [pgnls start_epoch 35 out=254b] v35'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.404+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(69 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(70 [pgnls start_epoch 35 out=213b] v35'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(71 [pgnls start_epoch 35 out=172b] v35'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(72 [pgnls start_epoch 35 out=336b] v35'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.405+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 [pgnls start_epoch 35 out=131b] v35'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(74 [pgnls start_epoch 35 out=254b] v35'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(75 [pgnls start_epoch 35 out=90b] v35'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.406+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(76 [pgnls start_epoch 35 out=213b] v35'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(77 [pgnls start_epoch 35 out=254b] v35'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(78 [pgnls start_epoch 35 out=254b] v35'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(79 [pgnls start_epoch 35 out=213b] v35'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.407+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(80 [pgnls start_epoch 35 out=172b] v35'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(81 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(82 [pgnls start_epoch 35 out=276b] v35'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.408+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(83 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(84 [pgnls start_epoch 35 out=295b] v35'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f6394017050 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(85 [pgnls start_epoch 35 out=172b] v35'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(86 [pgnls start_epoch 35 out=213b] v35'44 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.409+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f6394017050 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(87 [pgnls start_epoch 35 out=172b] v35'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(88 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(89 [pgnls start_epoch 35 out=90b] v35'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.410+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b23a830 2024-09-14T10:55:29.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(90 [pgnls start_epoch 35 out=90b] v35'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x56521b236130 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(91 [pgnls start_epoch 35 out=131b] v35'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f639c014070 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(92 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.411+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56521b241200 con 0x7f6394017050 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.412+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(93 [pgnls start_epoch 35 out=213b] v35'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.424 INFO:teuthology.orchestra.run.smithi164.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-14T10:55:29.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.414+0000 7f62577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.414+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910642678512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b23e700 con 0x56521b236130 2024-09-14T10:55:29.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.415+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94910642678512] v35'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.415+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910642652272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b23e700 con 0x7f639c014070 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.416+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94910642652272] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.416+0000 7f63a5c11800 20 remove_watcher() i=0 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.416+0000 7f63a5c11800 2 removed watcher, disabling cache 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.416+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910642658432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b27a990 con 0x56521b236130 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.417+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94910642658432] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.417+0000 7f63a5c11800 20 remove_watcher() i=1 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.417+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910642661984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b27a990 con 0x56521b23a830 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.418+0000 7f63a1b93640 1 -- 172.21.15.164:0/2160593351 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94910642661984] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f639c03e070 con 0x56521b23a830 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.418+0000 7f63a5c11800 20 remove_watcher() i=2 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.418+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910642659488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b241c80 con 0x7f639c014070 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.419+0000 7f63a1392640 1 -- 172.21.15.164:0/2160593351 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94910642659488] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6394018950 con 0x7f639c014070 2024-09-14T10:55:29.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.419+0000 7f63a5c11800 20 remove_watcher() i=3 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.419+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910642668304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242a60 con 0x56521b236130 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.420+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94910642668304] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x56521b236130 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.420+0000 7f63a5c11800 20 remove_watcher() i=4 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.420+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910642673296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b242a60 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.421+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94910642673296] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.421+0000 7f63a5c11800 20 remove_watcher() i=5 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.421+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910642670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b245690 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.422+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94910642670576] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.422+0000 7f63a5c11800 20 remove_watcher() i=6 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.422+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910642675936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56521b245690 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94910642675936] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638c081040 con 0x7f6394017050 2024-09-14T10:55:29.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 20 remove_watcher() i=7 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f6394017050 msgr2=0x7f6394042130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f6394017050 0x7f6394042130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b236130 msgr2=0x56521b2385f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b236130 0x56521b2385f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f639c014070 msgr2=0x7f639c023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f639c014070 0x7f639c023420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b23a830 msgr2=0x56521b23cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b23a830 0x56521b23cc20 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f626c03ce60 msgr2=0x7f626c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f626c03ce60 0x7f626c03f320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f639400efd0 tx=0x7f6394046000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 msgr2=0x56521b22a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 --2- 172.21.15.164:0/2160593351 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b222df0 0x56521b22a420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f639c0456b0 tx=0x7f639c0544e0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 reap_dead start 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a0b91640 1 -- 172.21.15.164:0/2160593351 reap_dead start 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 shutdown_connections 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 >> 172.21.15.164:0/2160593351 conn(0x56521b21f1f0 msgr2=0x56521b21d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.423+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 shutdown_connections 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/2160593351 wait complete. 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 msgr2=0x7f627c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 0x7f627c03f320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x56521b1fd430 tx=0x7f6394052950 comp rx=0 tx=0).stop 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 msgr2=0x56521b2167b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x56521b1fc920 tx=0x7f639c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 shutdown_connections 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f627c03ce60 0x7f627c03f320 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3765149012 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b216390 0x56521b2167b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 >> 172.21.15.164:0/3765149012 conn(0x56521b20a740 msgr2=0x56521b20ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 shutdown_connections 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3765149012 wait complete. 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 msgr2=0x56521b202950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 0x56521b202950 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 msgr2=0x56521b2071f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 0x56521b2071f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 msgr2=0x7f628803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 0x7f628803f2d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x56521b0743e0 tx=0x7f638c050000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 msgr2=0x56521b1fb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x56521b101770 tx=0x7f63940040e0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 shutdown_connections 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56521b204d70 0x56521b2071f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56521b105c00 0x56521b202950 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f628803ce10 0x7f628803f2d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 --2- 172.21.15.164:0/3070736114 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56521b074ee0 0x56521b1fb300 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 >> 172.21.15.164:0/3070736114 conn(0x56521b0fbf70 msgr2=0x56521b1ecb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 shutdown_connections 2024-09-14T10:55:29.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.424+0000 7f63a5c11800 1 -- 172.21.15.164:0/3070736114 wait complete. 2024-09-14T10:55:29.436 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-14T10:55:29.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-14T10:55:29.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-14T10:55:29.437 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-14T10:55:29.521 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.521 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa41b732800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555c32fc3c10 0x555c32fc6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa41b732800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c32fc66e0 con 0x555c32f32ef0 2024-09-14T10:55:29.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa41b732800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555c32e4a7d0 con 0x555c32fc3c10 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa416bbb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555c32fc3c10 0x555c32fc6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa4173bc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x555c32f32ef0 0x555c32fc24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:57738/0 (socket says 172.21.15.164:57738) 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.524+0000 7fa4173bc640 1 -- 172.21.15.164:0/2144392700 learned_addr learned my addr 172.21.15.164:0/2144392700 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.525+0000 7fa416bbb640 1 -- 172.21.15.164:0/2144392700 >> v1:172.21.15.116:6789/0 conn(0x555c32f32ef0 legacy=0x555c32fc24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.525+0000 7fa4163ba640 1 -- 172.21.15.164:0/2144392700 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228438128 0 0) 0x555c32fc66e0 con 0x555c32f32ef0 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.525+0000 7fa416bbb640 1 -- 172.21.15.164:0/2144392700 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c32fc7910 con 0x555c32fc3c10 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa416bbb640 1 --2- 172.21.15.164:0/2144392700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32fc3c10 0x555c32fc6060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa40000a470 tx=0x7fa400045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6294a472928523 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa4163ba640 1 -- 172.21.15.164:0/2144392700 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa400053570 con 0x555c32fc3c10 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa4163ba640 1 -- 172.21.15.164:0/2144392700 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa400058070 con 0x555c32fc3c10 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa4163ba640 1 -- 172.21.15.164:0/2144392700 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa400053880 con 0x555c32fc3c10 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa41b732800 1 -- 172.21.15.164:0/2144392700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32fc3c10 msgr2=0x555c32fc6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.527+0000 7fa41b732800 1 --2- 172.21.15.164:0/2144392700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32fc3c10 0x555c32fc6060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa40000a470 tx=0x7fa400045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.528+0000 7fa41b732800 1 -- 172.21.15.164:0/2144392700 shutdown_connections 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.528+0000 7fa41b732800 1 --2- 172.21.15.164:0/2144392700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32fc3c10 0x555c32fc6060 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.528+0000 7fa41b732800 1 -- 172.21.15.164:0/2144392700 >> 172.21.15.164:0/2144392700 conn(0x555c32fb9f80 msgr2=0x555c32fbc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.528+0000 7fa41b732800 1 -- 172.21.15.164:0/2144392700 shutdown_connections 2024-09-14T10:55:29.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.528+0000 7fa41b732800 1 -- 172.21.15.164:0/2144392700 wait complete. 2024-09-14T10:55:29.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa41b732800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa41b732800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c32e57dd0 con 0x555c32f32ef0 2024-09-14T10:55:29.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa4173bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.541+0000 7fa4173bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35230/0 (socket says 172.21.15.164:35230) 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa4173bc640 1 -- 172.21.15.164:0/3044493414 learned_addr learned my addr 172.21.15.164:0/3044493414 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa4173bc640 1 -- 172.21.15.164:0/3044493414 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c330b1e50 con 0x555c32f32ef0 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3044493414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa408006fa0 tx=0x7fa408001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d165311f51a8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa30560a640 1 -- 172.21.15.164:0/3044493414 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa408003450 con 0x555c32f32ef0 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa30560a640 1 -- 172.21.15.164:0/3044493414 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408003610 con 0x555c32f32ef0 2024-09-14T10:55:29.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.542+0000 7fa30560a640 1 -- 172.21.15.164:0/3044493414 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa408003970 con 0x555c32f32ef0 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- 172.21.15.164:0/3044493414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 msgr2=0x555c330b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 --2- 172.21.15.164:0/3044493414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa408006fa0 tx=0x7fa408001b00 comp rx=0 tx=0).stop 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- 172.21.15.164:0/3044493414 shutdown_connections 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 --2- 172.21.15.164:0/3044493414 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b1860 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- 172.21.15.164:0/3044493414 >> 172.21.15.164:0/3044493414 conn(0x555c32fb9f80 msgr2=0x555c32fbfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- 172.21.15.164:0/3044493414 shutdown_connections 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- 172.21.15.164:0/3044493414 wait complete. 2024-09-14T10:55:29.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.543+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa41b732800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa41b732800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c32fc6bb0 con 0x555c32f32ef0 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa4173bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa4173bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35234/0 (socket says 172.21.15.164:35234) 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa4173bc640 1 -- 172.21.15.164:0/3513034108 learned_addr learned my addr 172.21.15.164:0/3513034108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa4173bc640 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c330b98f0 con 0x555c32f32ef0 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa408001330 tx=0x7fa408001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa303e07640 1 -- 172.21.15.164:0/3513034108 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa408014a10 con 0x555c32f32ef0 2024-09-14T10:55:29.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa303e07640 1 -- 172.21.15.164:0/3513034108 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408014bb0 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c330b9b80 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa303e07640 1 -- 172.21.15.164:0/3513034108 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa40801e3f0 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.544+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c330ba580 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.545+0000 7fa303e07640 1 -- 172.21.15.164:0/3513034108 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa408010070 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.545+0000 7fa303e07640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 0x7fa2fc03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.545+0000 7fa303e07640 1 -- 172.21.15.164:0/3513034108 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa408018070 con 0x555c32f32ef0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 0x7fa2fc03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 0x555c330c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330c0f20 con 0x555c32fc3c10 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 0x555c330c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 0x7fa2fc03f320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa400057000 tx=0x7fa400052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 0x555c330c09e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa417bbd640 1 -- 172.21.15.164:0/3513034108 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c32fc3c10 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.546+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330c12c0 con 0x555c32fc3c10 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa417bbd640 1 -- 172.21.15.164:0/3513034108 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4100083e0 con 0x555c32fc3c10 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 0x555c330c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330c59d0 con 0x555c330c2d80 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 0x555c330c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 0x555c330c5240 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa4173bc640 1 -- 172.21.15.164:0/3513034108 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa40801b070 con 0x555c330c2d80 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.547+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330c1b10 con 0x555c32fc3c10 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.548+0000 7fa417bbd640 1 -- 172.21.15.164:0/3513034108 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4100083e0 con 0x555c32fc3c10 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.548+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330c1ef0 con 0x555c32fc3c10 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.548+0000 7fa417bbd640 1 -- 172.21.15.164:0/3513034108 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4100083e0 con 0x555c32fc3c10 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.548+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.548+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa41b732800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa41b732800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c32eb64a0 con 0x555c330d4410 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35238/0 (socket says 172.21.15.164:35238) 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa417bbd640 1 -- 172.21.15.164:0/2222774143 learned_addr learned my addr 172.21.15.164:0/2222774143 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa417bbd640 1 -- 172.21.15.164:0/2222774143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c330d4e70 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa417bbd640 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x555c330bb2c0 tx=0x7fa41000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa301602640 1 -- 172.21.15.164:0/2222774143 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410007d00 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa301602640 1 -- 172.21.15.164:0/2222774143 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41001e020 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c330d56a0 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa301602640 1 -- 172.21.15.164:0/2222774143 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410019420 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.549+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c330d5c40 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.550+0000 7fa301602640 1 -- 172.21.15.164:0/2222774143 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa410016040 con 0x555c330d4410 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.550+0000 7fa301602640 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 0x7fa2f003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.550+0000 7fa301602640 1 -- 172.21.15.164:0/2222774143 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa41001f030 con 0x555c330d4410 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa4173bc640 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 0x7fa2f003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa4173bc640 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 0x7fa2f003f320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x555c330bb460 tx=0x7fa408014fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa41b732800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa41b732800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c330b2280 con 0x555c330e0eb0 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35250/0 (socket says 172.21.15.164:35250) 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.551+0000 7fa417bbd640 1 -- 172.21.15.164:0/2050142367 learned_addr learned my addr 172.21.15.164:0/2050142367 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa417bbd640 1 -- 172.21.15.164:0/2050142367 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c330e18a0 con 0x555c330e0eb0 2024-09-14T10:55:29.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa417bbd640 1 --2- 172.21.15.164:0/2050142367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa4100543b0 tx=0x7fa410015e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abcccc2575c1b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa2faffd640 1 -- 172.21.15.164:0/2050142367 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410044070 con 0x555c330e0eb0 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa2faffd640 1 -- 172.21.15.164:0/2050142367 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410017cd0 con 0x555c330e0eb0 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa2faffd640 1 -- 172.21.15.164:0/2050142367 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa41001d030 con 0x555c330e0eb0 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 -- 172.21.15.164:0/2050142367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 msgr2=0x555c330e12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 --2- 172.21.15.164:0/2050142367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa4100543b0 tx=0x7fa410015e90 comp rx=0 tx=0).stop 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 -- 172.21.15.164:0/2050142367 shutdown_connections 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 --2- 172.21.15.164:0/2050142367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e12b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 -- 172.21.15.164:0/2050142367 >> 172.21.15.164:0/2050142367 conn(0x555c330dd2d0 msgr2=0x555c330db510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 -- 172.21.15.164:0/2050142367 shutdown_connections 2024-09-14T10:55:29.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.552+0000 7fa41b732800 1 -- 172.21.15.164:0/2050142367 wait complete. 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa41b732800 1 Processor -- start 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa41b732800 1 -- start start 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa41b732800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa41b732800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555c330e1ec0 con 0x555c330e0eb0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa417bbd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35254/0 (socket says 172.21.15.164:35254) 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 learned_addr learned my addr 172.21.15.164:0/3067987974 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.553+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c330e8a30 con 0x555c330e0eb0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e84d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa410015ed0 tx=0x7fa410054340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa2f97fa640 1 -- 172.21.15.164:0/3067987974 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa410016540 con 0x555c330e0eb0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa2f97fa640 1 -- 172.21.15.164:0/3067987974 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410031020 con 0x555c330e0eb0 2024-09-14T10:55:29.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c330e8cc0 con 0x555c330e0eb0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa2f97fa640 1 -- 172.21.15.164:0/3067987974 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4100169f0 con 0x555c330e0eb0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.554+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c330e9640 con 0x555c330e0eb0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa2f97fa640 1 -- 172.21.15.164:0/3067987974 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa410016b90 con 0x555c330e0eb0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa2f97fa640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2e003ce60 0x7fa2e003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa2f97fa640 1 -- 172.21.15.164:0/3067987974 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7fa410032030 con 0x555c330e0eb0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2e003ce60 0x7fa2e003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2e003ce60 0x7fa2e003f320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa40801d6b0 tx=0x7fa408034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.555+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c330f40e0 0x555c330f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330f6cf0 con 0x555c330f40e0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c330f40e0 0x555c330f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c330f40e0 0x555c330f65a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 20 realm 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330f7120 con 0x555c330f40e0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:29.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.556+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330f79f0 con 0x555c330f40e0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330f7d90 con 0x555c330f40e0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330f8af0 0x555c330faee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330fb4f0 con 0x555c330f8af0 2024-09-14T10:55:29.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330f8af0 0x555c330faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.557+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330f8af0 0x555c330faee0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa41b732800 20 searching for the correct realm 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa417bbd640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa410019040 0x7fa4100353c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa410019040 0x7fa4100353c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.558+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa410019040 0x7fa4100353c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.559+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.559+0000 7fa4173bc640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa408041070 0x7fa40801d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.559+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.559+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa408041070 0x7fa40801d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.559+0000 7fa416bbb640 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa408041070 0x7fa40801d770 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.560+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.561+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.562+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.563+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.564+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.565+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f8af0 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa408041070 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.566+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x555c330f40e0 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555c330fcde0 con 0x7fa410019040 2024-09-14T10:55:29.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330fbeb0 con 0x555c330f40e0 2024-09-14T10:55:29.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330fc700 con 0x555c330f40e0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.567+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330fd260 con 0x555c330f40e0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:29.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 zone default found 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 4 Realm: () 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 zonegroup default 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330fd600 con 0x7fa408041070 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330ff410 con 0x555c330f8af0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c330ff910 con 0x555c330f8af0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.568+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.569+0000 7fa41b732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.569+0000 7fa41b732800 20 started sync module instance, tier type = 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.569+0000 7fa41b732800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.569+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c330fe8b0 con 0x7fa410019040 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.570+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.570+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854482031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c330ffd70 con 0x7fa410019040 2024-09-14T10:55:29.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.570+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c331005c0 con 0x555c330f40e0 2024-09-14T10:55:29.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.571+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.571+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854482031616] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.571+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854482039328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33100c50 con 0x555c330f40e0 2024-09-14T10:55:29.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.571+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c330fed10 con 0x555c330f8af0 2024-09-14T10:55:29.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.572+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854482039328] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.572+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.572+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854482040480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33100c10 con 0x555c330f8af0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.572+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33101ce0 con 0x7fa410019040 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.573+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854482040480] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.573+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.573+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854482044976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c331020d0 con 0x7fa410019040 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.573+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33102ad0 con 0x555c330f40e0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.574+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.574+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854482048480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33102aa0 con 0x555c330f40e0 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.574+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33103ac0 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.574+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854482044976] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.575+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854482048480] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.575+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.575+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854482052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33102c80 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.575+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33104360 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.576+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854482052496] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.577+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(56 notify.6 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.577+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854482043408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c331041b0 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.577+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33104a00 con 0x7fa408041070 2024-09-14T10:55:29.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854482043408] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(58 notify.7 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854482054880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33104850 con 0x7fa408041070 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=0 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=1 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=2 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=3 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=4 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=5 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.578+0000 7fa41b732800 20 add_watcher() i=6 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854482054880] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa41b732800 20 add_watcher() i=7 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa41b732800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c33107d10 con 0x555c330f40e0 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.579+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854482055936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c331050f0 con 0x555c330f40e0 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.580+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854482055936] v35'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.580+0000 7fa2ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.580+0000 7fa41b732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.580+0000 7fa41b732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.580+0000 7fa41b732800 5 note: GC not initialized 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa2cd7e2640 20 reqs_thread_entry: start 2024-09-14T10:55:29.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 20 Filter name: none 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa2c67fc640 20 reqs_thread_entry: start 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313aff0 con 0x555c330f40e0 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:29.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.581+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313d920 con 0x7fa410019040 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 20 disabling bucket name=myfoo 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313b900 con 0x7fa410019040 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:29.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313e240 con 0x7fa410019040 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.582+0000 7fa41b732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.583+0000 7fa41b732800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.583+0000 7fa41b732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.583+0000 7fa41b732800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.583+0000 7fa41b732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:29.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.583+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33145c80 con 0x7fa410019040 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'10 uv10 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa41b732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa41b732800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa41b732800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa41b732800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 93854482295040 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313ca50 con 0x7fa408041070 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== watch-notify(notify (1) cookie 93854482054880 notify 150323855377 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7fa400081040 con 0x7fa408041070 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa2faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 93854482054880 notifier 4605 bl.length()=760 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(67 notify.7 [notify cookie 93854482295040 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa2faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa2faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa2faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.584+0000 7fa2faffd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa2dc003ea0 con 0x7fa408041070 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify_complete (2) cookie 93854482295040 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c32fc7910 con 0x7fa408041070 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa41b732800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa41b732800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa41b732800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa41b732800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.585+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33145480 con 0x555c330f40e0 2024-09-14T10:55:29.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa41b732800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa41b732800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa41b732800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93854482285984 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555c3313ce70 con 0x555c330f40e0 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 93854482048480 notify 150323855374 ret 0) ==== 609+0+0 (crc 0 0 0) 0x555c32fc7910 con 0x555c330f40e0 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa2faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 93854482048480 notifier 4605 bl.length()=567 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa2faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa2faffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa2faffd640 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa2dc003ea0 con 0x555c330f40e0 2024-09-14T10:55:29.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.586+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(70 notify.4 [notify cookie 93854482285984 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.587+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.587+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 93854482285984 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa40007a550 con 0x555c330f40e0 2024-09-14T10:55:29.611 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:29.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.588+0000 7fa2ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.588+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854482055936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x555c330f40e0 2024-09-14T10:55:29.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.589+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93854482055936] v35'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.589+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854482031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x7fa410019040 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.590+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93854482031616] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.590+0000 7fa41b732800 20 remove_watcher() i=0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.590+0000 7fa41b732800 2 removed watcher, disabling cache 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.590+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854482039328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x555c330f40e0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.591+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93854482039328] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.591+0000 7fa41b732800 20 remove_watcher() i=1 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.591+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854482040480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x555c330f8af0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.592+0000 7fa417bbd640 1 -- 172.21.15.164:0/3067987974 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93854482040480] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4100083e0 con 0x555c330f8af0 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.592+0000 7fa41b732800 20 remove_watcher() i=2 2024-09-14T10:55:29.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.592+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854482044976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x7fa410019040 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.593+0000 7fa4173bc640 1 -- 172.21.15.164:0/3067987974 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93854482044976] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa40803d070 con 0x7fa410019040 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.593+0000 7fa41b732800 20 remove_watcher() i=3 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.593+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854482048480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x555c330f40e0 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.594+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93854482048480] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x555c330f40e0 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.594+0000 7fa41b732800 20 remove_watcher() i=4 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.594+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854482052496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x7fa408041070 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.595+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93854482052496] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.595+0000 7fa41b732800 20 remove_watcher() i=5 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.595+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854482043408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x7fa408041070 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.596+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93854482043408] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.596+0000 7fa41b732800 20 remove_watcher() i=6 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.596+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854482054880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555c33138dc0 con 0x7fa408041070 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93854482054880] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa400051070 con 0x7fa408041070 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 20 remove_watcher() i=7 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa408041070 msgr2=0x7fa40801d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa408041070 0x7fa40801d770 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c330f40e0 msgr2=0x555c330f65a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c330f40e0 0x555c330f65a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa410019040 msgr2=0x7fa4100353c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa410019040 0x7fa4100353c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330f8af0 msgr2=0x555c330faee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330f8af0 0x555c330faee0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2e003ce60 msgr2=0x7fa2e003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2e003ce60 0x7fa2e003f320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa40801d6b0 tx=0x7fa408034000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 msgr2=0x555c330e84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 --2- 172.21.15.164:0/3067987974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330e0eb0 0x555c330e84d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa410015ed0 tx=0x7fa410054340 comp rx=0 tx=0).stop 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 reap_dead start 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa416bbb640 1 -- 172.21.15.164:0/3067987974 reap_dead start 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 shutdown_connections 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 >> 172.21.15.164:0/3067987974 conn(0x555c330dd2d0 msgr2=0x555c330db4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 shutdown_connections 2024-09-14T10:55:29.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.597+0000 7fa41b732800 1 -- 172.21.15.164:0/3067987974 wait complete. 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 msgr2=0x7fa2f003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 0x7fa2f003f320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x555c330bb460 tx=0x7fa408014fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 msgr2=0x555c330d4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x555c330bb2c0 tx=0x7fa41000aec0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 shutdown_connections 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2f003ce60 0x7fa2f003f320 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/2222774143 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c330d4410 0x555c330d4830 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 >> 172.21.15.164:0/2222774143 conn(0x555c330c87c0 msgr2=0x555c330c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 shutdown_connections 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/2222774143 wait complete. 2024-09-14T10:55:29.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 msgr2=0x555c330c09e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 0x555c330c09e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 msgr2=0x555c330c5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 0x555c330c5240 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 msgr2=0x7fa2fc03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 0x7fa2fc03f320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa400057000 tx=0x7fa400052000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 msgr2=0x555c330b9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa408001330 tx=0x7fa408001250 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 shutdown_connections 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555c330c2d80 0x555c330c5240 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555c32fc3c10 0x555c330c09e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa2fc03ce60 0x7fa2fc03f320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 --2- 172.21.15.164:0/3513034108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555c32f32ef0 0x555c330b9390 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 >> 172.21.15.164:0/3513034108 conn(0x555c32fb9f80 msgr2=0x555c330b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.598+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 shutdown_connections 2024-09-14T10:55:29.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.599+0000 7fa41b732800 1 -- 172.21.15.164:0/3513034108 wait complete. 2024-09-14T10:55:29.624 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:29.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-14T10:55:29.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-14T10:55:29.627 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-14T10:55:29.671 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:29.671 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.674+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.674+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.674+0000 7f0ebdfaf800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56432aaf16f0 0x56432ab828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.674+0000 7f0ebdfaf800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56432ab868f0 con 0x56432ab82de0 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.674+0000 7f0ebdfaf800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x56432aa087d0 con 0x56432aaf16f0 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0ebba99640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56432aaf16f0 0x56432ab828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0eb3298640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x56432ab82de0 0x56432ab851d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:57752/0 (socket says 172.21.15.164:57752) 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0ebba99640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56432aaf16f0 0x56432ab828a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35256/0 (socket says 172.21.15.164:35256) 2024-09-14T10:55:29.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0eb3298640 1 -- 172.21.15.164:0/3375453526 learned_addr learned my addr 172.21.15.164:0/3375453526 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:29.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0ebba99640 1 -- 172.21.15.164:0/3375453526 >> v1:172.21.15.116:6789/0 conn(0x56432ab82de0 legacy=0x56432ab851d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0ebb298640 1 -- 172.21.15.164:0/3375453526 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565852985 0 0) 0x56432ab868f0 con 0x56432ab82de0 2024-09-14T10:55:29.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.675+0000 7f0ebba99640 1 -- 172.21.15.164:0/3375453526 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ab87b20 con 0x56432aaf16f0 2024-09-14T10:55:29.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3375453526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ab828a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93514b3faf03a182 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebb298640 1 -- 172.21.15.164:0/3375453526 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac053570 con 0x56432aaf16f0 2024-09-14T10:55:29.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebb298640 1 -- 172.21.15.164:0/3375453526 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac058070 con 0x56432aaf16f0 2024-09-14T10:55:29.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebb298640 1 -- 172.21.15.164:0/3375453526 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac053880 con 0x56432aaf16f0 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3375453526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 msgr2=0x56432ab828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3375453526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ab828a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3375453526 shutdown_connections 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3375453526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ab828a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3375453526 >> 172.21.15.164:0/3375453526 conn(0x56432ab77fb0 msgr2=0x56432ab7a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3375453526 shutdown_connections 2024-09-14T10:55:29.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.677+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3375453526 wait complete. 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.691+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.691+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.691+0000 7f0ebdfaf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.691+0000 7f0ebdfaf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56432aa15dd0 con 0x56432aaf16f0 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0ebba99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0ebba99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35258/0 (socket says 172.21.15.164:35258) 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0ebba99640 1 -- 172.21.15.164:0/428951488 learned_addr learned my addr 172.21.15.164:0/428951488 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0ebba99640 1 -- 172.21.15.164:0/428951488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ac6fd90 con 0x56432aaf16f0 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0ebba99640 1 --2- 172.21.15.164:0/428951488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96d8664c571a5a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0da9e0b640 1 -- 172.21.15.164:0/428951488 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac053570 con 0x56432aaf16f0 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0da9e0b640 1 -- 172.21.15.164:0/428951488 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac063030 con 0x56432aaf16f0 2024-09-14T10:55:29.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.692+0000 7f0da9e0b640 1 -- 172.21.15.164:0/428951488 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac053840 con 0x56432aaf16f0 2024-09-14T10:55:29.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/428951488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 msgr2=0x56432ac6f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/428951488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac051000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/428951488 shutdown_connections 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/428951488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac6f7a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/428951488 >> 172.21.15.164:0/428951488 conn(0x56432ab77fb0 msgr2=0x56432ac6b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/428951488 shutdown_connections 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/428951488 wait complete. 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.693+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebdfaf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebdfaf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56432ab86dc0 con 0x56432aaf16f0 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebba99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebba99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35268/0 (socket says 172.21.15.164:35268) 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebba99640 1 -- 172.21.15.164:0/3785255602 learned_addr learned my addr 172.21.15.164:0/3785255602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebba99640 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ac77790 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0da3fff640 1 -- 172.21.15.164:0/3785255602 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac078070 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0da3fff640 1 -- 172.21.15.164:0/3785255602 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac068420 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0da3fff640 1 -- 172.21.15.164:0/3785255602 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eac068700 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ac77a20 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.694+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ac78630 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.695+0000 7f0da3fff640 1 -- 172.21.15.164:0/3785255602 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0eac07b070 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.695+0000 7f0da3fff640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 0x7f0da403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.695+0000 7f0da3fff640 1 -- 172.21.15.164:0/3785255602 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0eac098310 con 0x56432aaf16f0 2024-09-14T10:55:29.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.695+0000 7f0eb3298640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 0x7f0da403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 0x56432ac7e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ac7edc0 con 0x56432ab82de0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 0x56432ac7e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0eb3298640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 0x7f0da403f320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000c00 tx=0x7f0ea40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 0x56432ac7e880 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3785255602 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0eb400a4d0 con 0x56432ab82de0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ac7f160 con 0x56432ab82de0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3785255602 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0eb400a4d0 con 0x56432ab82de0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 0x56432ac83080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.696+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ac83810 con 0x56432ac80be0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 0x56432ac83080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 0x56432ac83080 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebba99640 1 -- 172.21.15.164:0/3785255602 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0eac07a030 con 0x56432ac80be0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ac7f9b0 con 0x56432ab82de0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3785255602 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0eb400a4d0 con 0x56432ab82de0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.697+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432ac7fd50 con 0x56432ab82de0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3785255602 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0eb400a4d0 con 0x56432ab82de0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebdfaf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebdfaf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56432aa744a0 con 0x56432ac92180 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35270/0 (socket says 172.21.15.164:35270) 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.698+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3163132817 learned_addr learned my addr 172.21.15.164:0/3163132817 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0ebc29a640 1 -- 172.21.15.164:0/3163132817 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ac92be0 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x56432ac78230 tx=0x7f0eb4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0da17fa640 1 -- 172.21.15.164:0/3163132817 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4014450 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0da17fa640 1 -- 172.21.15.164:0/3163132817 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb4014610 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ac93410 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0da17fa640 1 -- 172.21.15.164:0/3163132817 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4014930 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.699+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ac939b0 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0da17fa640 1 -- 172.21.15.164:0/3163132817 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0eb4011040 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0da17fa640 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 0x7f0d9403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0da17fa640 1 -- 172.21.15.164:0/3163132817 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0eb401e070 con 0x56432ac92180 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 0x7f0d9403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.700+0000 7f0ebba99640 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 0x7f0d9403f320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56432ac792c0 tx=0x7f0eac067e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebdfaf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebdfaf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56432ac70160 con 0x56432ac9ebe0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35272/0 (socket says 172.21.15.164:35272) 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebc29a640 1 -- 172.21.15.164:0/1907492 learned_addr learned my addr 172.21.15.164:0/1907492 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebc29a640 1 -- 172.21.15.164:0/1907492 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ac9f5d0 con 0x56432ac9ebe0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/1907492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4018430 tx=0x7f0eb4014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6999d81640b044 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0d9affd640 1 -- 172.21.15.164:0/1907492 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb404b070 con 0x56432ac9ebe0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0d9affd640 1 -- 172.21.15.164:0/1907492 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb4051070 con 0x56432ac9ebe0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.701+0000 7f0d9affd640 1 -- 172.21.15.164:0/1907492 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb4011da0 con 0x56432ac9ebe0 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/1907492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 msgr2=0x56432ac9efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/1907492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4018430 tx=0x7f0eb4014ea0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/1907492 shutdown_connections 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/1907492 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432ac9efe0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/1907492 >> 172.21.15.164:0/1907492 conn(0x56432ac9afe0 msgr2=0x56432ac99220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/1907492 shutdown_connections 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/1907492 wait complete. 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 Processor -- start 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- start start 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432aca61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebdfaf800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56432ac9fbf0 con 0x56432ac9ebe0 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432aca61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebc29a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432aca61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:35278/0 (socket says 172.21.15.164:35278) 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.702+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 learned_addr learned my addr 172.21.15.164:0/824598636 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432aca6750 con 0x56432ac9ebe0 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432aca61f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4049040 tx=0x7f0eb40544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0d997fa640 1 -- 172.21.15.164:0/824598636 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb404b040 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0d997fa640 1 -- 172.21.15.164:0/824598636 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb4031030 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0d997fa640 1 -- 172.21.15.164:0/824598636 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb40168f0 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432aca69e0 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.703+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432aca7360 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.704+0000 7f0d997fa640 1 -- 172.21.15.164:0/824598636 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0eb4011330 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.704+0000 7f0d997fa640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d8403ce60 0x7f0d8403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.704+0000 7f0d997fa640 1 -- 172.21.15.164:0/824598636 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6110+0+0 (secure 0 0 0) 0x7f0eb400e040 con 0x56432ac9ebe0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.704+0000 7f0ebba99640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d8403ce60 0x7f0d8403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebba99640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d8403ce60 0x7f0d8403f320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0eac053780 tx=0x7f0eac08f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432acb1fb0 0x56432acb4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb4bc0 con 0x56432acb1fb0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0eb3298640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432acb1fb0 0x56432acb4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0eb3298640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432acb1fb0 0x56432acb4470 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea400f5f0 con 0x56432acb1fb0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 20 realm 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.705+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb1300 con 0x56432acb1fb0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea400f5f0 con 0x56432acb1fb0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb56b0 con 0x56432acb1fb0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea400f5f0 con 0x56432acb1fb0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb5f80 con 0x56432acb1fb0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ea400f5f0 con 0x56432acb1fb0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432acb69a0 0x56432acb8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb9500 con 0x56432acb69a0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.706+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432acb69a0 0x56432acb8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432acb69a0 0x56432acb8d90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebdfaf800 20 searching for the correct realm 2024-09-14T10:55:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebc29a640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0eb4014070 0x7f0eb4001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.707+0000 7f0ebba99640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0eb4014070 0x7f0eb4001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0ebba99640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0eb4014070 0x7f0eb4001770 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0ebba99640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0eac0a5040 0x7f0eac07c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0eb3298640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0eac0a5040 0x7f0eac07c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.708+0000 7f0eb3298640 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0eac0a5040 0x7f0eac07c3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea400f5f0 con 0x7f0eac0a5040 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea400f5f0 con 0x56432acb1fb0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.709+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.710+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.711+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.712+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(26 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea402b040 con 0x56432acb1fb0 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.713+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.714+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb69a0 2024-09-14T10:55:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eac0a5040 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x56432acb1fb0 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56432acbadf0 con 0x7f0eb4014070 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.715+0000 7f0ebdfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acb9ef0 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acba790 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acbb270 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 zone default found 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 4 Realm: () 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 zonegroup default 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.716+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acbb270 con 0x7f0eac0a5040 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acbd110 con 0x56432acb69a0 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acbd4e0 con 0x56432acb69a0 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 started sync module instance, tier type = 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:29.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.717+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbc5a0 con 0x7f0eb4014070 2024-09-14T10:55:29.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.718+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(44 notify.0 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.718+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846480796048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbddf0 con 0x7f0eb4014070 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.719+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbe640 con 0x56432acb1fb0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.719+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846480796048] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.720+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.720+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846480800064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbe640 con 0x56432acb1fb0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.720+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbf110 con 0x56432acb69a0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.721+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846480800064] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.721+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.721+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846480804864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbf0d0 con 0x56432acb69a0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.721+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbfbd0 con 0x7f0eb4014070 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.722+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846480804864] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.722+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(50 notify.3 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.722+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846480807616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acbffc0 con 0x7f0eb4014070 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.722+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc0a10 con 0x56432acb1fb0 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.723+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846480807616] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.723+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.723+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846480811264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc0e00 con 0x56432acb1fb0 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.723+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc1840 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.724+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846480811264] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.724+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(54 notify.5 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.724+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846480814864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc1800 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.724+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc2250 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.725+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.725+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846480817568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc2670 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.725+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc3170 con 0x7f0eac0a5040 2024-09-14T10:55:29.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.725+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846480814864] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846480821344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc3130 con 0x7f0eac0a5040 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=0 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=1 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=2 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=3 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=4 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=5 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846480817568] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.727+0000 7f0ebdfaf800 20 add_watcher() i=6 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846480821344] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0ebdfaf800 20 add_watcher() i=7 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0ebdfaf800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acc21c0 con 0x56432acb1fb0 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.728+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846480802192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acc21c0 con 0x56432acb1fb0 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846480802192] v35'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0ebdfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0ebdfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0ebdfaf800 5 note: GC not initialized 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.729+0000 7f0d70fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 20 Filter name: none 2024-09-14T10:55:29.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0cea7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acf9530 con 0x56432acb1fb0 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.730+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acf8f10 con 0x7f0eb4014070 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 20 enabling bucket name=myfoo 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:29.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acf9e40 con 0x7f0eb4014070 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 : miss 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 20 rados->read ofs=0 len=0 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acfb720 con 0x7f0eb4014070 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv10 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.731+0000 7f0ebdfaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.732+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 8.2 8:43eb9972:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432ad03fa0 con 0x7f0eb4014070 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'11 uv11 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1, ofs0, ns] 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94846481053248 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acff600 con 0x7f0eac0a5040 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== watch-notify(notify (1) cookie 94846480821344 notify 150323855378 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f0ea4018040 con 0x7f0eac0a5040 2024-09-14T10:55:29.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94846480821344 notifier 4612 bl.length()=760 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(67 notify.7 [notify cookie 94846481053248 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 info.flags=0x17 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0d9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.1 to cache LRU end 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0d9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0d9affd640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0d80003ea0 con 0x7f0eac0a5040 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify_complete (2) cookie 94846481053248 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ea402f800 con 0x7f0eac0a5040 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_sources= new_sources= 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential sources added=[] removed=[] 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): orig_dests= new_dests= 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 20 handle_bi_update(): bucket=:myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.1]): potential dests added=[] removed=[] 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.733+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acfb540 con 0x56432acb1fb0 2024-09-14T10:55:29.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0ebdfaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0ebdfaf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0ebdfaf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94846481038256 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56432acfb540 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94846480811264 notify 150323855375 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0ea402f800 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0d9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 94846480811264 notifier 4612 bl.length()=567 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(70 notify.4 [notify cookie 94846481038256 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0d9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0d9affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0d9affd640 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0d80003ea0 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.735+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94846481038256 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0ea4041450 con 0x56432acb1fb0 2024-09-14T10:55:29.750 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.736+0000 7f0d71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.736+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846480802192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x56432acb1fb0 2024-09-14T10:55:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.737+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94846480802192] v35'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.737+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846480796048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x7f0eb4014070 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.738+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94846480796048] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.738+0000 7f0ebdfaf800 20 remove_watcher() i=0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.738+0000 7f0ebdfaf800 2 removed watcher, disabling cache 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.738+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846480800064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x56432acb1fb0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.739+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94846480800064] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.739+0000 7f0ebdfaf800 20 remove_watcher() i=1 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.739+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846480804864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x56432acb69a0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.740+0000 7f0ebc29a640 1 -- 172.21.15.164:0/824598636 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94846480804864] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eb4057040 con 0x56432acb69a0 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.740+0000 7f0ebdfaf800 20 remove_watcher() i=2 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.740+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846480807616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x7f0eb4014070 2024-09-14T10:55:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.741+0000 7f0ebba99640 1 -- 172.21.15.164:0/824598636 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94846480807616] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0eac07a030 con 0x7f0eb4014070 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.741+0000 7f0ebdfaf800 20 remove_watcher() i=3 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.741+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846480811264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x56432acb1fb0 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.742+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94846480811264] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x56432acb1fb0 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.742+0000 7f0ebdfaf800 20 remove_watcher() i=4 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.742+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846480814864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.743+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94846480814864] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.743+0000 7f0ebdfaf800 20 remove_watcher() i=5 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.743+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846480817568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.744+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94846480817568] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.744+0000 7f0ebdfaf800 20 remove_watcher() i=6 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.744+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846480821344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56432acf7320 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94846480821344] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea403b040 con 0x7f0eac0a5040 2024-09-14T10:55:29.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 20 remove_watcher() i=7 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0eac0a5040 msgr2=0x7f0eac07c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0eac0a5040 0x7f0eac07c3b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432acb1fb0 msgr2=0x56432acb4470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432acb1fb0 0x56432acb4470 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0eb4014070 msgr2=0x7f0eb4001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0eb4014070 0x7f0eb4001770 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432acb69a0 msgr2=0x56432acb8d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.745+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432acb69a0 0x56432acb8d90 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d8403ce60 msgr2=0x7f0d8403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d8403ce60 0x7f0d8403f320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0eac053780 tx=0x7f0eac08f000 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 msgr2=0x56432aca61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/824598636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac9ebe0 0x56432aca61f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4049040 tx=0x7f0eb40544e0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 reap_dead start 2024-09-14T10:55:29.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0eb3298640 1 -- 172.21.15.164:0/824598636 reap_dead start 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 shutdown_connections 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 >> 172.21.15.164:0/824598636 conn(0x56432ac9afe0 msgr2=0x56432ac991f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 shutdown_connections 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/824598636 wait complete. 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 msgr2=0x7f0d9403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 0x7f0d9403f320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x56432ac792c0 tx=0x7f0eac067e60 comp rx=0 tx=0).stop 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 msgr2=0x56432ac925a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x56432ac78230 tx=0x7f0eb4018830 comp rx=0 tx=0).stop 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 shutdown_connections 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0d9403ce60 0x7f0d9403f320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3163132817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432ac92180 0x56432ac925a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 >> 172.21.15.164:0/3163132817 conn(0x56432ac86530 msgr2=0x56432ac86910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 shutdown_connections 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3163132817 wait complete. 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 msgr2=0x56432ac7e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 0x56432ac7e880 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 msgr2=0x56432ac83080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 0x56432ac83080 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 msgr2=0x7f0da403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.746+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 0x7f0da403f320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000c00 tx=0x7f0ea40013b0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 msgr2=0x56432ac77230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00a470 tx=0x7f0eac002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 shutdown_connections 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56432ac80be0 0x56432ac83080 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56432ab82de0 0x56432ac7e880 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0da403ce60 0x7f0da403f320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 --2- 172.21.15.164:0/3785255602 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56432aaf16f0 0x56432ac77230 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 >> 172.21.15.164:0/3785255602 conn(0x56432ab77fb0 msgr2=0x56432ac69910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 shutdown_connections 2024-09-14T10:55:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:29.747+0000 7f0ebdfaf800 1 -- 172.21.15.164:0/3785255602 wait complete. 2024-09-14T10:55:29.761 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:29.768 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:55:30.034 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-14T10:55:30.042 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:45.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-14T10:55:45.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-14T10:55:45.044 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-14T10:55:45.095 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:45.096 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:45.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.098+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.098+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.098+0000 7f0f5c52a800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5653d4cf3f70 0x5653d4d83470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.098+0000 7f0f5c52a800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653d4d876d0 con 0x5653d4d839b0 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.098+0000 7f0f5c52a800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5653d4c0b7d0 con 0x5653d4cf3f70 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.099+0000 7f0f58217640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5653d4cf3f70 0x5653d4d83470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.099+0000 7f0f57a16640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5653d4d839b0 0x5653d4d85e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41538/0 (socket says 172.21.15.164:41538) 2024-09-14T10:55:45.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.099+0000 7f0f57a16640 1 -- 172.21.15.164:0/1349901505 learned_addr learned my addr 172.21.15.164:0/1349901505 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:45.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.099+0000 7f0f58217640 1 -- 172.21.15.164:0/1349901505 >> v1:172.21.15.116:6789/0 conn(0x5653d4d839b0 legacy=0x5653d4d85e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.099+0000 7f0f58217640 1 -- 172.21.15.164:0/1349901505 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4d88900 con 0x5653d4cf3f70 2024-09-14T10:55:45.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.101+0000 7f0f58217640 1 --2- 172.21.15.164:0/1349901505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d83470 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005fd0 tx=0x7f0f48045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39891bc5cb00957 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.101+0000 7f0f57215640 1 -- 172.21.15.164:0/1349901505 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48058530 con 0x5653d4cf3f70 2024-09-14T10:55:45.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.101+0000 7f0f57215640 1 -- 172.21.15.164:0/1349901505 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f480586d0 con 0x5653d4cf3f70 2024-09-14T10:55:45.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.101+0000 7f0f57215640 1 -- 172.21.15.164:0/1349901505 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f480589d0 con 0x5653d4cf3f70 2024-09-14T10:55:45.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1349901505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 msgr2=0x5653d4d83470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1349901505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d83470 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005fd0 tx=0x7f0f48045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:45.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1349901505 shutdown_connections 2024-09-14T10:55:45.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1349901505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d83470 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1349901505 >> 172.21.15.164:0/1349901505 conn(0x5653d4d7af80 msgr2=0x5653d4d7d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1349901505 shutdown_connections 2024-09-14T10:55:45.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.102+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1349901505 wait complete. 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f5c52a800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f5c52a800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5653d4c18dd0 con 0x5653d4cf3f70 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f58217640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f58217640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51848/0 (socket says 172.21.15.164:51848) 2024-09-14T10:55:45.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f58217640 1 -- 172.21.15.164:0/607749529 learned_addr learned my addr 172.21.15.164:0/607749529 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.118+0000 7f0f58217640 1 -- 172.21.15.164:0/607749529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4d811c0 con 0x5653d4cf3f70 2024-09-14T10:55:45.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.119+0000 7f0f58217640 1 --2- 172.21.15.164:0/607749529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0f48025a60 tx=0x7f0f48051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4f9a263ee505d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.119+0000 7f0e4660c640 1 -- 172.21.15.164:0/607749529 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f480589b0 con 0x5653d4cf3f70 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.119+0000 7f0e4660c640 1 -- 172.21.15.164:0/607749529 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f48068070 con 0x5653d4cf3f70 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.119+0000 7f0e4660c640 1 -- 172.21.15.164:0/607749529 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48058c80 con 0x5653d4cf3f70 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- 172.21.15.164:0/607749529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 msgr2=0x5653d4d80bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/607749529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0f48025a60 tx=0x7f0f48051000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- 172.21.15.164:0/607749529 shutdown_connections 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/607749529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4d80bd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- 172.21.15.164:0/607749529 >> 172.21.15.164:0/607749529 conn(0x5653d4d7af80 msgr2=0x5653d4e6c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- 172.21.15.164:0/607749529 shutdown_connections 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- 172.21.15.164:0/607749529 wait complete. 2024-09-14T10:55:45.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.120+0000 7f0f5c52a800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5653d4d87ba0 con 0x5653d4cf3f70 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f58217640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f58217640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51856/0 (socket says 172.21.15.164:51856) 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f58217640 1 -- 172.21.15.164:0/1875777126 learned_addr learned my addr 172.21.15.164:0/1875777126 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f58217640 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4e7a8e0 con 0x5653d4cf3f70 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f58217640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0f48025a60 tx=0x7f0f48003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0e44e09640 1 -- 172.21.15.164:0/1875777126 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f480635f0 con 0x5653d4cf3f70 2024-09-14T10:55:45.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0e44e09640 1 -- 172.21.15.164:0/1875777126 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f48063790 con 0x5653d4cf3f70 2024-09-14T10:55:45.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0e44e09640 1 -- 172.21.15.164:0/1875777126 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f48063a90 con 0x5653d4cf3f70 2024-09-14T10:55:45.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653d4e7ab70 con 0x5653d4cf3f70 2024-09-14T10:55:45.122 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.121+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d4e7b570 con 0x5653d4cf3f70 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.122+0000 7f0e44e09640 1 -- 172.21.15.164:0/1875777126 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0f48075020 con 0x5653d4cf3f70 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0e44e09640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 0x7f0e4003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0e44e09640 1 -- 172.21.15.164:0/1875777126 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0f48098900 con 0x5653d4cf3f70 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 0x7f0e4003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 0x5653d4e819d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4e81f10 con 0x5653d4d839b0 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 0x5653d4e819d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 0x7f0e4003f2d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f40001d70 tx=0x7f0f400012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.123+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 0x5653d4e819d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f58a18640 1 -- 172.21.15.164:0/1875777126 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4d839b0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4e822b0 con 0x5653d4d839b0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f58a18640 1 -- 172.21.15.164:0/1875777126 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4d839b0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 0x5653d4e86210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4e869a0 con 0x5653d4e83d70 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f58217640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 0x5653d4e86210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.124+0000 7f0f58217640 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 0x5653d4e86210 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.125+0000 7f0f58217640 1 -- 172.21.15.164:0/1875777126 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f4806dd00 con 0x5653d4e83d70 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.125+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4e82b00 con 0x5653d4d839b0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.125+0000 7f0f58a18640 1 -- 172.21.15.164:0/1875777126 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4d839b0 2024-09-14T10:55:45.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.125+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4e82ee0 con 0x5653d4d839b0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.125+0000 7f0f58a18640 1 -- 172.21.15.164:0/1875777126 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4d839b0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f5c52a800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f5c52a800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5653d4c774a0 con 0x5653d4e953e0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51868/0 (socket says 172.21.15.164:51868) 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f58a18640 1 -- 172.21.15.164:0/2986049118 learned_addr learned my addr 172.21.15.164:0/2986049118 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.126+0000 7f0f58a18640 1 -- 172.21.15.164:0/2986049118 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4e95e40 con 0x5653d4e953e0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0f58a18640 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5653d4e7c2b0 tx=0x7f0f5000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0e3dffb640 1 -- 172.21.15.164:0/2986049118 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f50007d60 con 0x5653d4e953e0 2024-09-14T10:55:45.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0e3dffb640 1 -- 172.21.15.164:0/2986049118 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5001e020 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0e3dffb640 1 -- 172.21.15.164:0/2986049118 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f50019590 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653d4e96670 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.127+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d4e96c10 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0e3dffb640 1 -- 172.21.15.164:0/2986049118 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0f50016040 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0e3dffb640 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 0x7f0e3003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0e3dffb640 1 -- 172.21.15.164:0/2986049118 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0f5001f030 con 0x5653d4e953e0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0f58217640 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 0x7f0e3003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.128+0000 7f0f58217640 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 0x7f0e3003f2d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5653d4e7c450 tx=0x7f0f48096f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f5c52a800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f5c52a800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5653d4d7f5b0 con 0x5653d4ea1e20 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51872/0 (socket says 172.21.15.164:51872) 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f58a18640 1 -- 172.21.15.164:0/3403603211 learned_addr learned my addr 172.21.15.164:0/3403603211 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f58a18640 1 -- 172.21.15.164:0/3403603211 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4ea2810 con 0x5653d4ea1e20 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0f58a18640 1 --2- 172.21.15.164:0/3403603211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054440 tx=0x7f0f50045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a65d9b23fd9af04 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.129+0000 7f0e2f7fe640 1 -- 172.21.15.164:0/3403603211 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f5001d040 con 0x5653d4ea1e20 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0e2f7fe640 1 -- 172.21.15.164:0/3403603211 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50051070 con 0x5653d4ea1e20 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0e2f7fe640 1 -- 172.21.15.164:0/3403603211 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f50014340 con 0x5653d4ea1e20 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- 172.21.15.164:0/3403603211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 msgr2=0x5653d4ea2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/3403603211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054440 tx=0x7f0f50045490 comp rx=0 tx=0).stop 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- 172.21.15.164:0/3403603211 shutdown_connections 2024-09-14T10:55:45.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/3403603211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea2220 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- 172.21.15.164:0/3403603211 >> 172.21.15.164:0/3403603211 conn(0x5653d4e9e220 msgr2=0x5653d4e9c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- 172.21.15.164:0/3403603211 shutdown_connections 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- 172.21.15.164:0/3403603211 wait complete. 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 Processor -- start 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.130+0000 7f0f5c52a800 1 -- start start 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f5c52a800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f5c52a800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5653d4ea2e30 con 0x5653d4ea1e20 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f58a18640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51888/0 (socket says 172.21.15.164:51888) 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 learned_addr learned my addr 172.21.15.164:0/1727523460 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d4ea9940 con 0x5653d4ea1e20 2024-09-14T10:55:45.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea93e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054440 tx=0x7f0f500543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0e2dffb640 1 -- 172.21.15.164:0/1727523460 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f5001d030 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0e2dffb640 1 -- 172.21.15.164:0/1727523460 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50016330 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653d4ea9bd0 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0e2dffb640 1 -- 172.21.15.164:0/1727523460 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f50016610 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.131+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d4eaa550 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.132+0000 7f0e2dffb640 1 -- 172.21.15.164:0/1727523460 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0f500169f0 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0e2dffb640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e2003ce10 0x7f0e2003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0e2dffb640 1 -- 172.21.15.164:0/1727523460 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0f50033030 con 0x5653d4ea1e20 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f58217640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e2003ce10 0x7f0e2003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4eb4fc0 0x5653d4eb7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4eb7ba0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4eb4fc0 0x5653d4eb7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f58217640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e2003ce10 0x7f0e2003f2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f48096ea0 tx=0x7f0f48088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.133+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4eb4fc0 0x5653d4eb7450 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f40009050 con 0x5653d4eb4fc0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 realm 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4eb4370 con 0x5653d4eb4fc0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f40009050 con 0x5653d4eb4fc0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4eb8680 con 0x5653d4eb4fc0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f40009050 con 0x5653d4eb4fc0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4eb8f50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f40009050 con 0x5653d4eb4fc0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4eb9890 0x5653d4ebbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.134+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebc3c0 con 0x5653d4eb9890 2024-09-14T10:55:45.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4eb9890 0x5653d4ebbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4eb9890 0x5653d4ebbc80 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f5c52a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f5c52a800 20 searching for the correct realm 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0f5005c040 0x7f0f50046a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.135+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f58217640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0f5005c040 0x7f0f50046a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f58217640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0f5005c040 0x7f0f50046a00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f58217640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0f48098c20 0x7f0f480980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.136+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0f48098c20 0x7f0f480980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.137+0000 7f0f57a16640 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0f48098c20 0x7f0f480980b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.137+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40009050 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.137+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.137+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40009050 con 0x5653d4eb4fc0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.137+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.138+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.139+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.140+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.141+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.142+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.143+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb9890 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f48098c20 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f40029040 con 0x7f0f48098c20 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.144+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x5653d4eb4fc0 2024-09-14T10:55:45.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebdd50 con 0x7f0f5005c040 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebce40 con 0x5653d4eb4fc0 2024-09-14T10:55:45.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.145+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebca80 con 0x5653d4eb4fc0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f40029040 con 0x5653d4eb4fc0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebd760 con 0x5653d4eb4fc0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 zone default found 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 4 Realm: () 2024-09-14T10:55:45.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 zonegroup default 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebd2c0 con 0x7f0f48098c20 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.146+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec00d0 con 0x5653d4eb9890 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec06b0 con 0x5653d4eb9890 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 20 started sync module instance, tier type = 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.147+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ebf4e0 con 0x7f0f5005c040 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.148+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.148+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94918054506544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec0b10 con 0x7f0f5005c040 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.148+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec1360 con 0x5653d4eb4fc0 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.149+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94918054506544] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.150+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.150+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94918054514352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec1780 con 0x5653d4eb4fc0 2024-09-14T10:55:45.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.150+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec1fd0 con 0x5653d4eb9890 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.151+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94918054514352] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.151+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.151+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94918054515888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec1ec0 con 0x5653d4eb9890 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.151+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec29e0 con 0x7f0f5005c040 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.152+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.152+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94918054519984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec3280 con 0x7f0f5005c040 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.152+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec3d70 con 0x5653d4eb4fc0 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.152+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94918054515888] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.153+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94918054519984] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.153+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.153+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94918054522320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec1910 con 0x5653d4eb4fc0 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.153+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec4780 con 0x7f0f48098c20 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.154+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.155+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94918054527696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec4ba0 con 0x7f0f48098c20 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.155+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec5560 con 0x7f0f48098c20 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.155+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94918054522320] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.155+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94918054527696] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.156+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.156+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94918054524992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec50b0 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.156+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec5a70 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94918054524992] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94918054532544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec5e90 con 0x7f0f48098c20 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=0 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=1 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=2 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=3 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=4 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=5 2024-09-14T10:55:45.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.157+0000 7f0f5c52a800 20 add_watcher() i=6 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94918054532544] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f5c52a800 20 add_watcher() i=7 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f5c52a800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec5e90 con 0x5653d4eb4fc0 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.158+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94918054533600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec5e70 con 0x5653d4eb4fc0 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.159+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94918054533600] v37'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.159+0000 7f0e0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.160+0000 7f0f5c52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.160+0000 7f0f5c52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.160+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed1780 con 0x5653d4eb4fc0 2024-09-14T10:55:45.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.161+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.161+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed1c30 con 0x7f0f48098c20 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.163+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.163+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed1e00 con 0x5653d4eb9890 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.164+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.164+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed1fd0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.165+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'153 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.165+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2540 con 0x7f0f5005c040 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.166+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.166+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2ab0 con 0x5653d4eb9890 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.167+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.167+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2ab0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.168+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.168+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed20c0 con 0x7f0f48098c20 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.170+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.170+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2ab0 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.171+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.171+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.172+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.172+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.173+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'46 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.173+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x7f0f48098c20 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.174+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.174+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.175+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.175+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x7f0f48098c20 2024-09-14T10:55:45.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.177+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.177+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x5653d4eb4fc0 2024-09-14T10:55:45.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.178+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.178+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x5653d4eb9890 2024-09-14T10:55:45.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.179+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.179+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x7f0f5005c040 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.180+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.180+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e80 con 0x5653d4eb9890 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.181+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.181+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e80 con 0x5653d4eb4fc0 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.182+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.182+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2e20 con 0x5653d4eb4fc0 2024-09-14T10:55:45.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.183+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'155 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.183+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.184+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'39 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.184+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f5005c040 2024-09-14T10:55:45.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.186+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.186+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.186+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.187+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.187+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.187+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.188+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.188+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.189+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.189+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f48098c20 2024-09-14T10:55:45.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.191+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.191+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.192+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.192+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f48098c20 2024-09-14T10:55:45.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.193+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.193+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x5653d4eb9890 2024-09-14T10:55:45.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.194+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.194+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f48098c20 2024-09-14T10:55:45.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.195+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.195+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed2d90 con 0x7f0f5005c040 2024-09-14T10:55:45.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0e0d7e2640 20 reqs_thread_entry: start 2024-09-14T10:55:45.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0f5c52a800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:45.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0f5c52a800 20 Filter name: none 2024-09-14T10:55:45.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0d7effd640 20 reqs_thread_entry: start 2024-09-14T10:55:45.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.197+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed00f0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed00b0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.198+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.199+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.200+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.201+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.202+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.203+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.204+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.204+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.204+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.204+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.205+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.205+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.205+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.205+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.206+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.207+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.208+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.208+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.208+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.208+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.208+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.209+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.209+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.209+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.209+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.209+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.210+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.211+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.212+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.213+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.214+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb4fc0 2024-09-14T10:55:45.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.215+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.216+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.217+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.218+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.219+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.220+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.220+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.220+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.220+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.221+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.222+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.223+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.224+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.225+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.225+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.225+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.225+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ed0090 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.225+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(189 gc.31 [call out=1701b] v0'0 uv24 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.226+0000 7f0e0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.226+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94918054533600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ecf790 con 0x5653d4eb4fc0 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.227+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94918054533600] v37'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.227+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94918054506544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec59e0 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.228+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94918054506544] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.228+0000 7f0f5c52a800 20 remove_watcher() i=0 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.228+0000 7f0f5c52a800 2 removed watcher, disabling cache 2024-09-14T10:55:45.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.228+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94918054514352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec59e0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.230+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94918054514352] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.230+0000 7f0f5c52a800 20 remove_watcher() i=1 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.230+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94918054515888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec59e0 con 0x5653d4eb9890 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.231+0000 7f0f58a18640 1 -- 172.21.15.164:0/1727523460 <== osd.3 v2:172.21.15.164:6816/3361197980 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94918054515888] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f500083e0 con 0x5653d4eb9890 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.231+0000 7f0f5c52a800 20 remove_watcher() i=2 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.231+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94918054519984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec14b0 con 0x7f0f5005c040 2024-09-14T10:55:45.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.232+0000 7f0f58217640 1 -- 172.21.15.164:0/1727523460 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94918054519984] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4806dd00 con 0x7f0f5005c040 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.232+0000 7f0f5c52a800 20 remove_watcher() i=3 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.232+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94918054522320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec59e0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.233+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94918054522320] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x5653d4eb4fc0 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.233+0000 7f0f5c52a800 20 remove_watcher() i=4 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.233+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94918054527696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec24b0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.234+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94918054527696] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.234+0000 7f0f5c52a800 20 remove_watcher() i=5 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.234+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94918054524992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec2dd0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.235+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94918054524992] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.235+0000 7f0f5c52a800 20 remove_watcher() i=6 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.235+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94918054532544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5653d4ec59e0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94918054532544] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4003a1c0 con 0x7f0f48098c20 2024-09-14T10:55:45.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 20 remove_watcher() i=7 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0f48098c20 msgr2=0x7f0f480980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f0f48098c20 0x7f0f480980b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4eb4fc0 msgr2=0x5653d4eb7450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4eb4fc0 0x5653d4eb7450 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0f5005c040 msgr2=0x7f0f50046a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0f5005c040 0x7f0f50046a00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4eb9890 msgr2=0x5653d4ebbc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4eb9890 0x5653d4ebbc80 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e2003ce10 msgr2=0x7f0e2003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e2003ce10 0x7f0e2003f2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f48096ea0 tx=0x7f0f48088000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 msgr2=0x5653d4ea93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1727523460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4ea1e20 0x5653d4ea93e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054440 tx=0x7f0f500543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 reap_dead start 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f57a16640 1 -- 172.21.15.164:0/1727523460 reap_dead start 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 shutdown_connections 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 >> 172.21.15.164:0/1727523460 conn(0x5653d4e9e220 msgr2=0x5653d4e9c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 shutdown_connections 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.236+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1727523460 wait complete. 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 msgr2=0x7f0e3003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 0x7f0e3003f2d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5653d4e7c450 tx=0x7f0f48096f90 comp rx=0 tx=0).stop 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 msgr2=0x5653d4e95800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5653d4e7c2b0 tx=0x7f0f5000af20 comp rx=0 tx=0).stop 2024-09-14T10:55:45.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 shutdown_connections 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e3003ce10 0x7f0e3003f2d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/2986049118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4e953e0 0x5653d4e95800 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 >> 172.21.15.164:0/2986049118 conn(0x5653d4e89790 msgr2=0x5653d4e89b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 shutdown_connections 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/2986049118 wait complete. 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 msgr2=0x5653d4e819d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 0x5653d4e819d0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 msgr2=0x5653d4e86210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 0x5653d4e86210 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 msgr2=0x7f0e4003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 0x7f0e4003f2d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f40001d70 tx=0x7f0f400012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 msgr2=0x5653d4e7a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0f48025a60 tx=0x7f0f48003330 comp rx=0 tx=0).stop 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 shutdown_connections 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5653d4e83d70 0x5653d4e86210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5653d4d839b0 0x5653d4e819d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0e4003ce10 0x7f0e4003f2d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 --2- 172.21.15.164:0/1875777126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5653d4cf3f70 0x5653d4e7a380 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 >> 172.21.15.164:0/1875777126 conn(0x5653d4d7af80 msgr2=0x5653d4e6bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 shutdown_connections 2024-09-14T10:55:45.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.237+0000 7f0f5c52a800 1 -- 172.21.15.164:0/1875777126 wait complete. 2024-09-14T10:55:45.244 INFO:teuthology.orchestra.run.smithi164.stdout:[{"tag":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1794010370091166807\u0000","time":"2024-09-14T10:55:45.042580+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_7","key":"","instance":""}]}] 2024-09-14T10:55:45.244 DEBUG:tasks.util.rgw: json result: [{'tag': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1794010370091166807\x00', 'time': '2024-09-14T10:55:45.042580+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_7', 'key': '', 'instance': ''}]}] 2024-09-14T10:55:45.244 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-14T10:55:45.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-14T10:55:45.244 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-14T10:55:45.287 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:45.287 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.290+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.290+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.290+0000 7fbc33c0e800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560f7661e980 0x560f7661ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.290+0000 7fbc33c0e800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f76620520 con 0x560f7661f960 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.290+0000 7fbc33c0e800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x560f764a97d0 con 0x560f7661e980 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.291+0000 7fbc2f259640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x560f7661e980 0x560f7661ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.291+0000 7fbc2ea58640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x560f7661f960 0x560f7661fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41546/0 (socket says 172.21.15.164:41546) 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.291+0000 7fbc2ea58640 1 -- 172.21.15.164:0/792839603 learned_addr learned my addr 172.21.15.164:0/792839603 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.291+0000 7fbc2f259640 1 -- 172.21.15.164:0/792839603 >> v1:172.21.15.116:6789/0 conn(0x560f7661f960 legacy=0x560f7661fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.291+0000 7fbc2f259640 1 -- 172.21.15.164:0/792839603 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f766206f0 con 0x560f7661e980 2024-09-14T10:55:45.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc2f259640 1 --2- 172.21.15.164:0/792839603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7661ed80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc20045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e144c0f0cc9e9039 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc2e257640 1 -- 172.21.15.164:0/792839603 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20058530 con 0x560f7661e980 2024-09-14T10:55:45.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc2e257640 1 -- 172.21.15.164:0/792839603 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200586d0 con 0x560f7661e980 2024-09-14T10:55:45.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc2e257640 1 -- 172.21.15.164:0/792839603 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc200589d0 con 0x560f7661e980 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc33c0e800 1 -- 172.21.15.164:0/792839603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 msgr2=0x560f7661ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.293+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/792839603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7661ed80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbc20005fd0 tx=0x7fbc20045c30 comp rx=0 tx=0).stop 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.294+0000 7fbc33c0e800 1 -- 172.21.15.164:0/792839603 shutdown_connections 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.294+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/792839603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7661ed80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.294+0000 7fbc33c0e800 1 -- 172.21.15.164:0/792839603 >> 172.21.15.164:0/792839603 conn(0x560f7661a170 msgr2=0x560f7661c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.294+0000 7fbc33c0e800 1 -- 172.21.15.164:0/792839603 shutdown_connections 2024-09-14T10:55:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.294+0000 7fbc33c0e800 1 -- 172.21.15.164:0/792839603 wait complete. 2024-09-14T10:55:45.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.307+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.307+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.307+0000 7fbc33c0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.307+0000 7fbc33c0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560f764b6dd0 con 0x560f7661e980 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbc2f259640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbc2f259640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51914/0 (socket says 172.21.15.164:51914) 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbc2f259640 1 -- 172.21.15.164:0/2925170569 learned_addr learned my addr 172.21.15.164:0/2925170569 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbc2f259640 1 -- 172.21.15.164:0/2925170569 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f7670ed30 con 0x560f7661e980 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbc2f259640 1 --2- 172.21.15.164:0/2925170569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbc20025a60 tx=0x7fbc20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291f56a6ec672ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbb1d60a640 1 -- 172.21.15.164:0/2925170569 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20058a30 con 0x560f7661e980 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbb1d60a640 1 -- 172.21.15.164:0/2925170569 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc20068070 con 0x560f7661e980 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.308+0000 7fbb1d60a640 1 -- 172.21.15.164:0/2925170569 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20058d00 con 0x560f7661e980 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2925170569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 msgr2=0x560f7670e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2925170569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbc20025a60 tx=0x7fbc20051000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2925170569 shutdown_connections 2024-09-14T10:55:45.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2925170569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f7670e740 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2925170569 >> 172.21.15.164:0/2925170569 conn(0x560f7661a170 msgr2=0x560f7670a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2925170569 shutdown_connections 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2925170569 wait complete. 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.309+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc33c0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc33c0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560f76625e50 con 0x560f7661e980 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc2f259640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc2f259640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51918/0 (socket says 172.21.15.164:51918) 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc2f259640 1 -- 172.21.15.164:0/2459026663 learned_addr learned my addr 172.21.15.164:0/2459026663 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc2f259640 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f76718830 con 0x560f7661e980 2024-09-14T10:55:45.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbc2f259640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbc20025a60 tx=0x7fbc20003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.310+0000 7fbb1be07640 1 -- 172.21.15.164:0/2459026663 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20063650 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.311+0000 7fbb1be07640 1 -- 172.21.15.164:0/2459026663 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200637f0 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.311+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f76718ac0 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.311+0000 7fbb1be07640 1 -- 172.21.15.164:0/2459026663 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc20063b10 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.311+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f767194c0 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.311+0000 7fbb1be07640 1 -- 172.21.15.164:0/2459026663 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbc20075020 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbb1be07640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 0x7fbb1403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbb1be07640 1 -- 172.21.15.164:0/2459026663 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbc20098840 con 0x560f7661e980 2024-09-14T10:55:45.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 0x7fbb1403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 0x560f7671f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7671a0b0 con 0x560f7661f960 2024-09-14T10:55:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 0x560f7671f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 0x7fbb1403f2d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001d70 tx=0x7fbc180012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.312+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 0x560f7671f920 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/2459026663 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f7661f960 2024-09-14T10:55:45.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767203a0 con 0x560f7661f960 2024-09-14T10:55:45.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/2459026663 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc280083e0 con 0x560f7661f960 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 0x560f76724150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767248e0 con 0x560f76721cb0 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc2f259640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 0x560f76724150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.313+0000 7fbc2f259640 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 0x560f76724150 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.314+0000 7fbc2f259640 1 -- 172.21.15.164:0/2459026663 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbc20077c10 con 0x560f76721cb0 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.314+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f76720bf0 con 0x560f7661f960 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.314+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/2459026663 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc280083e0 con 0x560f7661f960 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.314+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f76720fd0 con 0x560f7661f960 2024-09-14T10:55:45.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.314+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/2459026663 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbc280083e0 con 0x560f7661f960 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc33c0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc33c0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560f765154a0 con 0x560f76733320 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51930/0 (socket says 172.21.15.164:51930) 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1392025872 learned_addr learned my addr 172.21.15.164:0/1392025872 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1392025872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f76733d80 con 0x560f76733320 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.315+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x560f767198c0 tx=0x7fbc2800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbb19602640 1 -- 172.21.15.164:0/1392025872 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc28007d60 con 0x560f76733320 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbb19602640 1 -- 172.21.15.164:0/1392025872 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2801e020 con 0x560f76733320 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbb19602640 1 -- 172.21.15.164:0/1392025872 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc28019590 con 0x560f76733320 2024-09-14T10:55:45.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f767345b0 con 0x560f76733320 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f76734b50 con 0x560f76733320 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.316+0000 7fbb19602640 1 -- 172.21.15.164:0/1392025872 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbc28016040 con 0x560f76733320 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbb19602640 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 0x7fbb0803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbb19602640 1 -- 172.21.15.164:0/1392025872 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbc2801f030 con 0x560f76733320 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 0x7fbb0803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 0x7fbb0803f2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x560f76719aa0 tx=0x7fbc20063e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc33c0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.317+0000 7fbc33c0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560f7670f0a0 con 0x560f7673fd60 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51942/0 (socket says 172.21.15.164:51942) 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/11105591 learned_addr learned my addr 172.21.15.164:0/11105591 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/11105591 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f76740750 con 0x560f7673fd60 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/11105591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc28054440 tx=0x7fbc28045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f0238ce19bca04 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbb12ffd640 1 -- 172.21.15.164:0/11105591 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2801d040 con 0x560f7673fd60 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbb12ffd640 1 -- 172.21.15.164:0/11105591 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc28051070 con 0x560f7673fd60 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbb12ffd640 1 -- 172.21.15.164:0/11105591 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc280184e0 con 0x560f7673fd60 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc33c0e800 1 -- 172.21.15.164:0/11105591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 msgr2=0x560f76740160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.318+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/11105591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc28054440 tx=0x7fbc28045490 comp rx=0 tx=0).stop 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- 172.21.15.164:0/11105591 shutdown_connections 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/11105591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f76740160 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- 172.21.15.164:0/11105591 >> 172.21.15.164:0/11105591 conn(0x560f7673c160 msgr2=0x560f7673a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- 172.21.15.164:0/11105591 shutdown_connections 2024-09-14T10:55:45.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- 172.21.15.164:0/11105591 wait complete. 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 Processor -- start 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- start start 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc33c0e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x560f76740d70 con 0x560f7673fd60 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc2fa5a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51956/0 (socket says 172.21.15.164:51956) 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.319+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 learned_addr learned my addr 172.21.15.164:0/1810011057 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f76747910 con 0x560f7673fd60 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbc28008fd0 tx=0x7fbc280543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbb117fa640 1 -- 172.21.15.164:0/1810011057 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc2801d030 con 0x560f7673fd60 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbb117fa640 1 -- 172.21.15.164:0/1810011057 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc28014dd0 con 0x560f7673fd60 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f76747ba0 con 0x560f7673fd60 2024-09-14T10:55:45.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbb117fa640 1 -- 172.21.15.164:0/1810011057 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc28016460 con 0x560f7673fd60 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.320+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f76748520 con 0x560f7673fd60 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbb117fa640 1 -- 172.21.15.164:0/1810011057 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbc28016600 con 0x560f7673fd60 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbb117fa640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaf803ce10 0x7fbaf803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbb117fa640 1 -- 172.21.15.164:0/1810011057 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbc28033030 con 0x560f7673fd60 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaf803ce10 0x7fbaf803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f76752ec0 0x560f76755380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.321+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f76755ad0 con 0x560f76752ec0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaf803ce10 0x7fbaf803f2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc200883f0 tx=0x7fbc20091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f76752ec0 0x560f76755380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f76752ec0 0x560f76755380 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc18009050 con 0x560f76752ec0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 20 realm 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f76752210 con 0x560f76752ec0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc18009050 con 0x560f76752ec0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.322+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767565c0 con 0x560f76752ec0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc18009050 con 0x560f76752ec0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f76756e90 con 0x560f76752ec0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbc18009050 con 0x560f76752ec0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f767578b0 0x560f76759ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f767578b0 0x560f76759ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.323+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f767578b0 0x560f76759ca0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc33c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc33c0e800 20 searching for the correct realm 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675bcd0 con 0x560f767578b0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2fa5a640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbc28019040 0x7fbc28023a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbc28019040 0x7fbc28023a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.324+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbc28019040 0x7fbc28023a30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2f259640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbc200a6040 0x7fbc200980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbc200a6040 0x7fbc200980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2ea58640 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbc200a6040 0x7fbc200980b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18009050 con 0x7fbc200a6040 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.325+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18009050 con 0x560f76752ec0 2024-09-14T10:55:45.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.326+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.327+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.328+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.329+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.329+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.329+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.329+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.329+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.330+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x560f76752ec0 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.331+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f767578b0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.332+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc200a6040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc18029040 con 0x7fbc200a6040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x560f76752ec0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x560f7675a3e0 con 0x7fbc28019040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675aca0 con 0x560f76752ec0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.333+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675b040 con 0x560f76752ec0 2024-09-14T10:55:45.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675b460 con 0x560f76752ec0 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 zone default found 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 4 Realm: () 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 zonegroup default 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675c150 con 0x7fbc200a6040 2024-09-14T10:55:45.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675dff0 con 0x560f767578b0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.334+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7675e390 con 0x560f767578b0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 20 started sync module instance, tier type = 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.335+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675d430 con 0x7fbc28019040 2024-09-14T10:55:45.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.336+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.336+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624411930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675e7f0 con 0x7fbc28019040 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.336+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675f040 con 0x560f76752ec0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.337+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624411930496] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.337+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.337+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624411937680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675f460 con 0x560f76752ec0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.337+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675fcf0 con 0x560f767578b0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.338+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624411937680] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.339+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.339+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624411938736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675f880 con 0x560f767578b0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.339+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76760770 con 0x7fbc28019040 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.340+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624411938736] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.340+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.340+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624411939792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675f7f0 con 0x7fbc28019040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.340+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76761630 con 0x560f76752ec0 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.341+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624411939792] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.341+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.341+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624411947392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76761a50 con 0x560f76752ec0 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.341+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76762410 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.342+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.342+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624411950944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76762380 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.342+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767633b0 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.342+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624411947392] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.343+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624411950944] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.343+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.344+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624411954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76763370 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.344+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76763c50 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624411957152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767633b0 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=0 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=1 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=2 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=3 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=4 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=5 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624411954816] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=6 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624411957152] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 20 add_watcher() i=7 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.345+0000 7fbc33c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.346+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767615a0 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.346+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.346+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624411958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767615a0 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.347+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624411958208] v37'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.347+0000 7fbae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.347+0000 7fbc33c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.347+0000 7fbc33c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.347+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7676f610 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.349+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.349+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7676f5d0 con 0x7fbc200a6040 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.350+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.350+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770190 con 0x560f767578b0 2024-09-14T10:55:45.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.351+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.351+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770190 con 0x560f76752ec0 2024-09-14T10:55:45.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.352+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'158 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.352+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770720 con 0x7fbc28019040 2024-09-14T10:55:45.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.353+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.353+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770800 con 0x560f767578b0 2024-09-14T10:55:45.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.354+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.354+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770dd0 con 0x560f76752ec0 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.355+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.355+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770d90 con 0x7fbc200a6040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.356+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.357+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770d90 con 0x7fbc28019040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.357+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.358+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770d90 con 0x560f767578b0 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.358+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.358+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770d90 con 0x7fbc28019040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.359+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'49 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.359+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770e20 con 0x7fbc200a6040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.360+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.360+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770e20 con 0x7fbc28019040 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.361+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.361+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770e20 con 0x7fbc200a6040 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.363+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.363+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770e20 con 0x560f76752ec0 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.363+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.364+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770e20 con 0x560f767578b0 2024-09-14T10:55:45.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.365+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.365+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770eb0 con 0x7fbc28019040 2024-09-14T10:55:45.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.366+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'50 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.366+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770eb0 con 0x560f767578b0 2024-09-14T10:55:45.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.367+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.367+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770ed0 con 0x560f76752ec0 2024-09-14T10:55:45.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.368+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.368+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770ed0 con 0x560f76752ec0 2024-09-14T10:55:45.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.369+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'160 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.369+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770f10 con 0x560f767578b0 2024-09-14T10:55:45.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.370+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'42 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.370+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770f10 con 0x7fbc28019040 2024-09-14T10:55:45.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.371+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.371+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770f70 con 0x560f767578b0 2024-09-14T10:55:45.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.372+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.372+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770f70 con 0x560f767578b0 2024-09-14T10:55:45.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.373+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.373+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770fb0 con 0x560f767578b0 2024-09-14T10:55:45.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.374+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.374+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770fa0 con 0x560f767578b0 2024-09-14T10:55:45.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.375+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.375+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76770fe0 con 0x7fbc200a6040 2024-09-14T10:55:45.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.376+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.376+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76771000 con 0x560f767578b0 2024-09-14T10:55:45.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.377+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.377+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76771000 con 0x7fbc200a6040 2024-09-14T10:55:45.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.378+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.378+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76771040 con 0x560f767578b0 2024-09-14T10:55:45.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.380+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.380+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76771050 con 0x7fbc200a6040 2024-09-14T10:55:45.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.381+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.381+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767710b0 con 0x7fbc28019040 2024-09-14T10:55:45.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.382+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.382+0000 7fbae4fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:45.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.382+0000 7fbc33c0e800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:45.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.382+0000 7fbc33c0e800 20 Filter name: none 2024-09-14T10:55:45.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.382+0000 7fba5e7fc640 20 reqs_thread_entry: start 2024-09-14T10:55:45.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.383+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-14T10:55:45.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.383+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:94 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(94 gc.25 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:95 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(95 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:96 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(96 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(97 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.384+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.385+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(98 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.385+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.385+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.385+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(99 gc.25 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.386+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-14T10:55:45.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.386+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.387+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(100 gc.26 [call] v37'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.387+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.387+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.387+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(103 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.388+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.389+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(104 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.389+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.389+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:105 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.390+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(105 gc.26 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.390+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-14T10:55:45.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.390+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:106 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.391+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(106 gc.27 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.391+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:107 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.391+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(107 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.391+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.391+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:108 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(108 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:109 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(109 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:110 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(110 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.392+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:111 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.393+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(111 gc.27 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.393+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.393+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:112 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.394+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(112 gc.28 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.394+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:113 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.394+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(113 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:114 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x7fbc200a6040 2024-09-14T10:55:45.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(114 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:115 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(115 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.395+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:116 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.396+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(116 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.396+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.396+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:117 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.397+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(117 gc.28 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.397+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-14T10:55:45.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.397+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:118 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.398+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(118 gc.29 [call] v37'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.398+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:119 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.398+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(119 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.398+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.398+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:120 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x560f767578b0 2024-09-14T10:55:45.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(120 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:121 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(121 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:122 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(122 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.399+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:123 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x560f767578b0 2024-09-14T10:55:45.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.400+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(123 gc.29 [call] v37'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.400+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-14T10:55:45.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.400+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:124 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(124 gc.30 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:125 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(125 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:126 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(126 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:127 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(127 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.402+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:128 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.403+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(128 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.403+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.403+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:129 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc200a6040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.404+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(129 gc.30 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.404+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.404+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:130 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(130 gc.31 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:131 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(131 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:132 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679c140 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(132 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:133 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc28019040 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(133 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.405+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:134 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d150 con 0x7fbc28019040 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(134 gc.31 [call out=1701b] v0'0 uv27 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 20 garbage collection: RGWGC::process iterating over entry tag='4d2cef0f-8511-4251-8070-7385f93096af.4241.1794010370091166807', time=2024-09-14T10:55:45.042580+0000, chain.objs.size()=7 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_1 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:135 3.23s0 3:c66b0470:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679d890 con 0x7fbc200a6040 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_2 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:136 3.19s0 3:9b7afe72:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0480 con 0x560f76752ec0 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_3 2024-09-14T10:55:45.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:137 3.cs0 3:3356eec3:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a2db0 con 0x560f767578b0 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_4 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:138 3.37s0 3:ef0d8c55:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a5620 con 0x560f76752ec0 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_5 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:139 3.8s0 3:13b92764:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a7e90 con 0x560f767578b0 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_6 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:140 3.0s0 3:02aa2ca8:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a7e90 con 0x7fbc200a6040 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_7 2024-09-14T10:55:45.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.406+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:141 3.35s0 3:ac26305b:::4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767acbd0 con 0x560f76752ec0 2024-09-14T10:55:45.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.408+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(140 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_6 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.409+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== osd_op_reply(135 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_1 [call] v37'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.410+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(137 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_3 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.410+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(139 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_5 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.410+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(138 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_4 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.410+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(141 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_7 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.410+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(136 4d2cef0f-8511-4251-8070-7385f93096af.4241.1__shadow_.lpCBE-DCDEQVSdxVSPg-NBsOzMXQDWw_2 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.411+0000 7fbc33c0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T10:55:45.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.411+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:142 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a08e0 con 0x7fbc28019040 2024-09-14T10:55:45.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.412+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(142 gc.31 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.412+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:143 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a08e0 con 0x7fbc28019040 2024-09-14T10:55:45.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.413+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(143 gc.31 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.413+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-14T10:55:45.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.413+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:144 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a08c0 con 0x560f76752ec0 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.414+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(144 gc.0 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.414+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:145 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a5980 con 0x560f76752ec0 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.414+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(145 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.414+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.414+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:146 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a1d60 con 0x560f76752ec0 2024-09-14T10:55:45.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(146 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:147 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0880 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(147 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:148 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(148 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.415+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:149 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x560f76752ec0 2024-09-14T10:55:45.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.416+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(149 gc.0 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.416+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-14T10:55:45.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.416+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:150 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x7fbc200a6040 2024-09-14T10:55:45.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.417+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(150 gc.1 [call] v37'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.417+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:151 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x7fbc200a6040 2024-09-14T10:55:45.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== osd_op_reply(151 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:152 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a6e40 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== osd_op_reply(152 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:153 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(153 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:154 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 47 ==== osd_op_reply(154 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.418+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:155 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x7fbc200a6040 2024-09-14T10:55:45.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.419+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 48 ==== osd_op_reply(155 gc.1 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.419+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.419+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:156 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f767a0820 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.420+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(156 gc.2 [call] v37'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.420+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:157 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(157 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:158 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f767a6e40 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(158 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:159 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 50 ==== osd_op_reply(159 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:160 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 51 ==== osd_op_reply(160 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.421+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:161 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.422+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 52 ==== osd_op_reply(161 gc.2 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.422+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.422+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:162 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.423+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(162 gc.3 [call] v37'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.423+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:163 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(163 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:164 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(164 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:165 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(165 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:166 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(166 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.424+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:167 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.425+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(167 gc.3 [call] v37'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.425+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.425+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:168 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.426+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(168 gc.4 [call] v37'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.426+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(169 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:170 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(170 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:171 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(171 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:172 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(172 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.427+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:173 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.428+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(173 gc.4 [call] v37'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.428+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-14T10:55:45.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.428+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:174 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.429+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 53 ==== osd_op_reply(174 gc.5 [call] v37'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.429+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:175 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 54 ==== osd_op_reply(175 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:176 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 55 ==== osd_op_reply(176 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:177 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 56 ==== osd_op_reply(177 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.430+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:178 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 57 ==== osd_op_reply(178 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:179 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 58 ==== osd_op_reply(179 gc.5 [call] v37'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-14T10:55:45.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.431+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:180 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(180 gc.6 [call] v37'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:181 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(181 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:182 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(182 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.433+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:183 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(183 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:184 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(184 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.434+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.435+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(185 gc.6 [call] v37'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.435+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.435+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:186 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.436+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 49 ==== osd_op_reply(186 gc.7 [call] v37'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.436+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:187 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.436+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 50 ==== osd_op_reply(187 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.436+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.436+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:188 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 51 ==== osd_op_reply(188 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:189 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 52 ==== osd_op_reply(189 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:190 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 53 ==== osd_op_reply(190 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.437+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.438+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 54 ==== osd_op_reply(191 gc.7 [call] v37'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.438+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.438+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:192 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(192 gc.8 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:193 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(193 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:194 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(194 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.439+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:195 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(195 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:196 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(196 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.440+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.441+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(197 gc.8 [call] v37'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.441+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.441+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:198 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 59 ==== osd_op_reply(198 gc.9 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:199 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 60 ==== osd_op_reply(199 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:200 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 61 ==== osd_op_reply(200 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.442+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:201 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 62 ==== osd_op_reply(201 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:202 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 63 ==== osd_op_reply(202 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.443+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.444+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 64 ==== osd_op_reply(203 gc.9 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.444+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.444+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:204 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(204 gc.10 [call] v37'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:205 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(205 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:206 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(206 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:207 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(207 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.445+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:208 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 42 ==== osd_op_reply(208 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 43 ==== osd_op_reply(209 gc.10 [call] v37'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-14T10:55:45.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.446+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:210 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 55 ==== osd_op_reply(210 gc.11 [call] v37'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:211 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 56 ==== osd_op_reply(211 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:212 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 57 ==== osd_op_reply(212 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.448+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:213 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 58 ==== osd_op_reply(213 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:214 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 59 ==== osd_op_reply(214 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.449+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.450+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 60 ==== osd_op_reply(215 gc.11 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.450+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.450+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:216 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.451+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 44 ==== osd_op_reply(216 gc.12 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.451+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:217 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.451+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 45 ==== osd_op_reply(217 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.451+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.451+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:218 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 46 ==== osd_op_reply(218 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:219 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 47 ==== osd_op_reply(219 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:220 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 48 ==== osd_op_reply(220 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.452+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:221 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.453+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 49 ==== osd_op_reply(221 gc.12 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.453+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-14T10:55:45.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.453+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:222 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.454+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 61 ==== osd_op_reply(222 gc.13 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.454+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:223 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.454+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 62 ==== osd_op_reply(223 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.454+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.454+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:224 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 63 ==== osd_op_reply(224 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:225 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 64 ==== osd_op_reply(225 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:226 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 65 ==== osd_op_reply(226 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.455+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:227 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc200a6040 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.456+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 66 ==== osd_op_reply(227 gc.13 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.456+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.456+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:228 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.457+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 49 ==== osd_op_reply(228 gc.14 [call] v37'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.457+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:229 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.457+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 50 ==== osd_op_reply(229 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.457+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.457+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:230 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 51 ==== osd_op_reply(230 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:231 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 52 ==== osd_op_reply(231 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:232 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 53 ==== osd_op_reply(232 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.458+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:233 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.459+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 54 ==== osd_op_reply(233 gc.14 [call] v37'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.459+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.459+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:234 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.460+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 65 ==== osd_op_reply(234 gc.15 [call] v37'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.460+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:235 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 66 ==== osd_op_reply(235 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:236 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 67 ==== osd_op_reply(236 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:237 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 68 ==== osd_op_reply(237 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:238 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 69 ==== osd_op_reply(238 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.461+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:239 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.463+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 70 ==== osd_op_reply(239 gc.15 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.463+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-14T10:55:45.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.463+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:240 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.463+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 50 ==== osd_op_reply(240 gc.16 [call] v37'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.463+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:241 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 51 ==== osd_op_reply(241 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:242 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 52 ==== osd_op_reply(242 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:243 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 53 ==== osd_op_reply(243 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:244 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 54 ==== osd_op_reply(244 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.464+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:245 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.465+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 55 ==== osd_op_reply(245 gc.16 [call] v37'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.465+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.465+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:246 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.466+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 71 ==== osd_op_reply(246 gc.17 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.466+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:247 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 72 ==== osd_op_reply(247 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:248 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 73 ==== osd_op_reply(248 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:249 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 74 ==== osd_op_reply(249 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:250 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 75 ==== osd_op_reply(250 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.467+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:251 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.468+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 76 ==== osd_op_reply(251 gc.17 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.468+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-14T10:55:45.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.468+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:252 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 55 ==== osd_op_reply(252 gc.18 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:253 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 56 ==== osd_op_reply(253 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:254 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 57 ==== osd_op_reply(254 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:255 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 58 ==== osd_op_reply(255 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.470+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:256 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.471+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 59 ==== osd_op_reply(256 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.471+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.471+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:257 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.472+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 60 ==== osd_op_reply(257 gc.18 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.472+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-14T10:55:45.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.472+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:258 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 61 ==== osd_op_reply(258 gc.19 [call] v37'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:259 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 62 ==== osd_op_reply(259 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:260 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 63 ==== osd_op_reply(260 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.473+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:261 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 64 ==== osd_op_reply(261 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:262 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 65 ==== osd_op_reply(262 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.474+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:263 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.475+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 66 ==== osd_op_reply(263 gc.19 [call] v37'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.475+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.475+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:264 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.476+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 77 ==== osd_op_reply(264 gc.20 [call] v37'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.476+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:265 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.476+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 78 ==== osd_op_reply(265 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.476+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.476+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:266 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 79 ==== osd_op_reply(266 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:267 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 80 ==== osd_op_reply(267 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:268 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 81 ==== osd_op_reply(268 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.477+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:269 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.478+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 82 ==== osd_op_reply(269 gc.20 [call] v37'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.478+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.478+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:270 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.479+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 56 ==== osd_op_reply(270 gc.21 [call] v37'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.479+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:271 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 57 ==== osd_op_reply(271 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:272 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 58 ==== osd_op_reply(272 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:273 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 59 ==== osd_op_reply(273 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:274 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 60 ==== osd_op_reply(274 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.480+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:275 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.481+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 61 ==== osd_op_reply(275 gc.21 [call] v37'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.481+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.481+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:276 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.482+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 83 ==== osd_op_reply(276 gc.22 [call] v37'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.482+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:277 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 84 ==== osd_op_reply(277 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:278 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 85 ==== osd_op_reply(278 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:279 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 86 ==== osd_op_reply(279 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:280 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 87 ==== osd_op_reply(280 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.483+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:281 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.484+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 88 ==== osd_op_reply(281 gc.22 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.484+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-14T10:55:45.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.484+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:282 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.485+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 89 ==== osd_op_reply(282 gc.23 [call] v37'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.485+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:283 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 90 ==== osd_op_reply(283 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:284 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 91 ==== osd_op_reply(284 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:285 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 92 ==== osd_op_reply(285 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:286 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 93 ==== osd_op_reply(286 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.486+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:287 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.487+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 94 ==== osd_op_reply(287 gc.23 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.487+0000 7fbc33c0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.487+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:288 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.488+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 95 ==== osd_op_reply(288 gc.24 [call] v37'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.488+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:289 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.488+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 96 ==== osd_op_reply(289 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.488+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.488+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:290 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 97 ==== osd_op_reply(290 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:291 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 98 ==== osd_op_reply(291 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:292 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 99 ==== osd_op_reply(292 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc33c0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:55:45.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.489+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:293 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f767578b0 2024-09-14T10:55:45.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.490+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 100 ==== osd_op_reply(293 gc.24 [call] v37'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.491+0000 7fbae5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.491+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624411958208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x560f76752ec0 2024-09-14T10:55:45.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.492+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94624411958208] v37'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.492+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624411930496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7679b2a0 con 0x7fbc28019040 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.493+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94624411930496] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.493+0000 7fbc33c0e800 20 remove_watcher() i=0 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.493+0000 7fbc33c0e800 2 removed watcher, disabling cache 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.493+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624411937680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x560f76752ec0 2024-09-14T10:55:45.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.494+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94624411937680] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.494+0000 7fbc33c0e800 20 remove_watcher() i=1 2024-09-14T10:55:45.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.494+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624411938736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x560f767578b0 2024-09-14T10:55:45.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.495+0000 7fbc2fa5a640 1 -- 172.21.15.164:0/1810011057 <== osd.3 v2:172.21.15.164:6816/3361197980 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94624411938736] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc280083e0 con 0x560f767578b0 2024-09-14T10:55:45.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.495+0000 7fbc33c0e800 20 remove_watcher() i=2 2024-09-14T10:55:45.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.495+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624411939792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x7fbc28019040 2024-09-14T10:55:45.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.496+0000 7fbc2f259640 1 -- 172.21.15.164:0/1810011057 <== osd.2 v2:172.21.15.164:6800/813620551 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94624411939792] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc20077c10 con 0x7fbc28019040 2024-09-14T10:55:45.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.496+0000 7fbc33c0e800 20 remove_watcher() i=3 2024-09-14T10:55:45.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.496+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624411947392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x560f76752ec0 2024-09-14T10:55:45.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.497+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.1 v2:172.21.15.164:6802/3845281611 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94624411947392] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x560f76752ec0 2024-09-14T10:55:45.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.497+0000 7fbc33c0e800 20 remove_watcher() i=4 2024-09-14T10:55:45.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.497+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624411950944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x7fbc200a6040 2024-09-14T10:55:45.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.498+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94624411950944] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.498+0000 7fbc33c0e800 20 remove_watcher() i=5 2024-09-14T10:55:45.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.498+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624411954816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f76761f60 con 0x7fbc200a6040 2024-09-14T10:55:45.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.499+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94624411954816] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.499+0000 7fbc33c0e800 20 remove_watcher() i=6 2024-09-14T10:55:45.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.499+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624411957152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x560f7675cf80 con 0x7fbc200a6040 2024-09-14T10:55:45.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 <== osd.0 v2:172.21.15.116:6800/1614093354 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94624411957152] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbc18039040 con 0x7fbc200a6040 2024-09-14T10:55:45.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 20 remove_watcher() i=7 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbc200a6040 msgr2=0x7fbc200980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbc200a6040 0x7fbc200980b0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f76752ec0 msgr2=0x560f76755380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f76752ec0 0x560f76755380 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbc28019040 msgr2=0x7fbc28023a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbc28019040 0x7fbc28023a30 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f767578b0 msgr2=0x560f76759ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f767578b0 0x560f76759ca0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaf803ce10 msgr2=0x7fbaf803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaf803ce10 0x7fbaf803f2d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc200883f0 tx=0x7fbc20091000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 msgr2=0x560f767473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc2ea58640 1 -- 172.21.15.164:0/1810011057 reap_dead start 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.500+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbc28008fd0 tx=0x7fbc280543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 shutdown_connections 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1810011057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7673fd60 0x560f767473b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 >> 172.21.15.164:0/1810011057 conn(0x560f7673c160 msgr2=0x560f7673a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 shutdown_connections 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1810011057 wait complete. 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 msgr2=0x7fbb0803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 0x7fbb0803f2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x560f76719aa0 tx=0x7fbc20063e90 comp rx=0 tx=0).stop 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 msgr2=0x560f76733740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x560f767198c0 tx=0x7fbc2800af20 comp rx=0 tx=0).stop 2024-09-14T10:55:45.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 shutdown_connections 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb0803ce10 0x7fbb0803f2d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/1392025872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f76733320 0x560f76733740 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 >> 172.21.15.164:0/1392025872 conn(0x560f767276d0 msgr2=0x560f76727ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 shutdown_connections 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/1392025872 wait complete. 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 msgr2=0x560f7671f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 0x560f7671f920 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 msgr2=0x560f76724150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 0x560f76724150 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.501+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 msgr2=0x7fbb1403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 0x7fbb1403f2d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbc18001d70 tx=0x7fbc180012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 msgr2=0x560f767182d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbc20025a60 tx=0x7fbc20003330 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 shutdown_connections 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x560f76721cb0 0x560f76724150 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x560f7661f960 0x560f7671f920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbb1403ce10 0x7fbb1403f2d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 --2- 172.21.15.164:0/2459026663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x560f7661e980 0x560f767182d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 >> 172.21.15.164:0/2459026663 conn(0x560f7661a170 msgr2=0x560f7670fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 shutdown_connections 2024-09-14T10:55:45.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.502+0000 7fbc33c0e800 1 -- 172.21.15.164:0/2459026663 wait complete. 2024-09-14T10:55:45.508 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-14T10:55:45.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-14T10:55:45.509 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-14T10:55:45.592 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:45.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.595+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.595+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.595+0000 7fafdbabb800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5596c22099d0 0x5596c220be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.595+0000 7fafdbabb800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5596c220c4c0 con 0x5596c217b010 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.595+0000 7fafdbabb800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5596c20927d0 con 0x5596c22099d0 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.596+0000 7fafd8da4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5596c22099d0 0x5596c220be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.596+0000 7fafd8da4640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5596c22099d0 0x5596c220be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51962/0 (socket says 172.21.15.164:51962) 2024-09-14T10:55:45.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.596+0000 7fafd8da4640 1 -- 172.21.15.164:0/1878305306 learned_addr learned my addr 172.21.15.164:0/1878305306 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.596+0000 7fafd8da4640 1 -- 172.21.15.164:0/1878305306 >> v1:172.21.15.116:6789/0 conn(0x5596c217b010 legacy=0x5596c22081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.596+0000 7fafd8da4640 1 -- 172.21.15.164:0/1878305306 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c2215ff0 con 0x5596c22099d0 2024-09-14T10:55:45.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.598+0000 7fafd8da4640 1 --2- 172.21.15.164:0/1878305306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c220be90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fafc400a520 tx=0x7fafc4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a32bbd1a8c72da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.598+0000 7fafd3fff640 1 -- 172.21.15.164:0/1878305306 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc4055070 con 0x5596c22099d0 2024-09-14T10:55:45.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.598+0000 7fafd3fff640 1 -- 172.21.15.164:0/1878305306 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc40515b0 con 0x5596c22099d0 2024-09-14T10:55:45.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.598+0000 7fafd3fff640 1 -- 172.21.15.164:0/1878305306 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc40518d0 con 0x5596c22099d0 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 -- 172.21.15.164:0/1878305306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 msgr2=0x5596c220be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 --2- 172.21.15.164:0/1878305306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c220be90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fafc400a520 tx=0x7fafc4045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 -- 172.21.15.164:0/1878305306 shutdown_connections 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 --2- 172.21.15.164:0/1878305306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c220be90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 -- 172.21.15.164:0/1878305306 >> 172.21.15.164:0/1878305306 conn(0x5596c2201f80 msgr2=0x5596c22043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 -- 172.21.15.164:0/1878305306 shutdown_connections 2024-09-14T10:55:45.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.599+0000 7fafdbabb800 1 -- 172.21.15.164:0/1878305306 wait complete. 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.612+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.612+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.612+0000 7fafdbabb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.612+0000 7fafdbabb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5596c209fdd0 con 0x5596c217b010 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7fafd95a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7fafd95a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51964/0 (socket says 172.21.15.164:51964) 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7fafd95a5640 1 -- 172.21.15.164:0/879523051 learned_addr learned my addr 172.21.15.164:0/879523051 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7fafd95a5640 1 -- 172.21.15.164:0/879523051 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c22fe3d0 con 0x5596c217b010 2024-09-14T10:55:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7fafd95a5640 1 --2- 172.21.15.164:0/879523051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fafcc001670 tx=0x7fafcc001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb62887a1671a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7faec7606640 1 -- 172.21.15.164:0/879523051 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc016070 con 0x5596c217b010 2024-09-14T10:55:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7faec7606640 1 -- 172.21.15.164:0/879523051 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc00f660 con 0x5596c217b010 2024-09-14T10:55:45.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.613+0000 7faec7606640 1 -- 172.21.15.164:0/879523051 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc00f980 con 0x5596c217b010 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- 172.21.15.164:0/879523051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 msgr2=0x5596c22fdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 --2- 172.21.15.164:0/879523051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fafcc001670 tx=0x7fafcc001b30 comp rx=0 tx=0).stop 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- 172.21.15.164:0/879523051 shutdown_connections 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 --2- 172.21.15.164:0/879523051 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c217b010 0x5596c22fdde0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- 172.21.15.164:0/879523051 >> 172.21.15.164:0/879523051 conn(0x5596c2201f80 msgr2=0x5596c22f9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- 172.21.15.164:0/879523051 shutdown_connections 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- 172.21.15.164:0/879523051 wait complete. 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.614+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafdbabb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafdbabb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5596c22152b0 con 0x5596c22099d0 2024-09-14T10:55:45.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafd95a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafd95a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51976/0 (socket says 172.21.15.164:51976) 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafd95a5640 1 -- 172.21.15.164:0/84989651 learned_addr learned my addr 172.21.15.164:0/84989651 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafd95a5640 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c23060c0 con 0x5596c22099d0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.615+0000 7fafd95a5640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fafcc003000 tx=0x7fafcc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.616+0000 7faec5e03640 1 -- 172.21.15.164:0/84989651 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc016070 con 0x5596c22099d0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.616+0000 7faec5e03640 1 -- 172.21.15.164:0/84989651 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc00fe40 con 0x5596c22099d0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.616+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c2306350 con 0x5596c22099d0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.616+0000 7faec5e03640 1 -- 172.21.15.164:0/84989651 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafcc011780 con 0x5596c22099d0 2024-09-14T10:55:45.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.616+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c2306d50 con 0x5596c22099d0 2024-09-14T10:55:45.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7faec5e03640 1 -- 172.21.15.164:0/84989651 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fafcc024020 con 0x5596c22099d0 2024-09-14T10:55:45.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7faec5e03640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 0x7faec003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7faec5e03640 1 -- 172.21.15.164:0/84989651 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fafcc022020 con 0x5596c22099d0 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7fafd8da4640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 0x7faec003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 0x5596c230d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c230d740 con 0x5596c2307850 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7fafd9da6640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 0x5596c230d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.617+0000 7fafd8da4640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 0x7faec003f320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafc4057000 tx=0x7fafc4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafd9da6640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 0x5596c230d1b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafd9da6640 1 -- 172.21.15.164:0/84989651 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c2307850 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2307200 con 0x5596c2307850 2024-09-14T10:55:45.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafd9da6640 1 -- 172.21.15.164:0/84989651 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c2307850 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 0x5596c2311e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2312550 con 0x5596c230fa90 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafd95a5640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 0x5596c2311e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.618+0000 7fafd95a5640 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 0x5596c2311e80 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.619+0000 7fafd95a5640 1 -- 172.21.15.164:0/84989651 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fafcc00f070 con 0x5596c230fa90 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.619+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c230e900 con 0x5596c2307850 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.619+0000 7fafd9da6640 1 -- 172.21.15.164:0/84989651 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c2307850 2024-09-14T10:55:45.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.619+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c230ede0 con 0x5596c2307850 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.619+0000 7fafd9da6640 1 -- 172.21.15.164:0/84989651 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c2307850 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafdbabb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafdbabb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5596c20fe4a0 con 0x5596c2320f10 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:51990/0 (socket says 172.21.15.164:51990) 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafd9da6640 1 -- 172.21.15.164:0/2300052080 learned_addr learned my addr 172.21.15.164:0/2300052080 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafd9da6640 1 -- 172.21.15.164:0/2300052080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c2321970 con 0x5596c2320f10 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.620+0000 7fafd9da6640 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fafd4005fd0 tx=0x7fafd400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7faebeffd640 1 -- 172.21.15.164:0/2300052080 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd4007dc0 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7faebeffd640 1 -- 172.21.15.164:0/2300052080 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd401e020 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c23221a0 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7faebeffd640 1 -- 172.21.15.164:0/2300052080 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd4019570 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c2322740 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.621+0000 7faebeffd640 1 -- 172.21.15.164:0/2300052080 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fafd4016040 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7faebeffd640 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 0x7faeb003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7faebeffd640 1 -- 172.21.15.164:0/2300052080 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fafd401f030 con 0x5596c2320f10 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafd95a5640 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 0x7faeb003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafd95a5640 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 0x7faeb003f2d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01dc50 tx=0x7fafcc04d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafdbabb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafdbabb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5596c22fe800 con 0x5596c232da10 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.622+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52006/0 (socket says 172.21.15.164:52006) 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafd9da6640 1 -- 172.21.15.164:0/3521178500 learned_addr learned my addr 172.21.15.164:0/3521178500 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafd9da6640 1 -- 172.21.15.164:0/3521178500 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c232e400 con 0x5596c232da10 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafd9da6640 1 --2- 172.21.15.164:0/3521178500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fafd4054480 tx=0x7fafd4014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ba6d6661e1cc5e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7faebcff9640 1 -- 172.21.15.164:0/3521178500 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd401d070 con 0x5596c232da10 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7faebcff9640 1 -- 172.21.15.164:0/3521178500 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd4045260 con 0x5596c232da10 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7faebcff9640 1 -- 172.21.15.164:0/3521178500 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd404da80 con 0x5596c232da10 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafdbabb800 1 -- 172.21.15.164:0/3521178500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 msgr2=0x5596c232de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3521178500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fafd4054480 tx=0x7fafd4014710 comp rx=0 tx=0).stop 2024-09-14T10:55:45.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafdbabb800 1 -- 172.21.15.164:0/3521178500 shutdown_connections 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3521178500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c232de10 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.623+0000 7fafdbabb800 1 -- 172.21.15.164:0/3521178500 >> 172.21.15.164:0/3521178500 conn(0x5596c2329e30 msgr2=0x5596c2328070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 -- 172.21.15.164:0/3521178500 shutdown_connections 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 -- 172.21.15.164:0/3521178500 wait complete. 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 Processor -- start 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 -- start start 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c2334fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafdbabb800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5596c232ea20 con 0x5596c232da10 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c2334fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafd9da6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c2334fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52010/0 (socket says 172.21.15.164:52010) 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 learned_addr learned my addr 172.21.15.164:0/3574795715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.624+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c2335530 con 0x5596c232da10 2024-09-14T10:55:45.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7fafd9da6640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c2334fd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fafd4014750 tx=0x7fafd40543e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7faeaeffd640 1 -- 172.21.15.164:0/3574795715 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd4044050 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7faeaeffd640 1 -- 172.21.15.164:0/3574795715 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd4045410 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c23357c0 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7faeaeffd640 1 -- 172.21.15.164:0/3574795715 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd4022c60 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c2336140 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.625+0000 7faeaeffd640 1 -- 172.21.15.164:0/3574795715 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fafd4033030 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7faeaeffd640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faea403ce10 0x7faea403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7faeaeffd640 1 -- 172.21.15.164:0/3574795715 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fafd4031070 con 0x5596c232da10 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafd95a5640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faea403ce10 0x7faea403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2340bd0 0x5596c2343090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c23437e0 con 0x5596c2340bd0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafd8da4640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2340bd0 0x5596c2343090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafd95a5640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faea403ce10 0x7faea403f2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01cfd0 tx=0x7fafcc04a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.626+0000 7fafd8da4640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2340bd0 0x5596c2343090 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 realm 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2343c10 con 0x5596c2340bd0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c23444e0 con 0x5596c2340bd0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2344880 con 0x5596c2340bd0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c23455e0 0x5596c23479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.627+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c23455e0 0x5596c23479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c23455e0 0x5596c23479d0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c23455e0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafdbabb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafdbabb800 20 searching for the correct realm 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2349890 con 0x5596c23455e0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c23455e0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fafd4019040 0x7fafd40343c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.628+0000 7fafd95a5640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fafd4019040 0x7fafd40343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd95a5640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fafd4019040 0x7fafd40343c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd95a5640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fafcc053c20 0x7fafcc01c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd8da4640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fafcc053c20 0x7fafcc01c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.629+0000 7fafd8da4640 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fafcc053c20 0x7fafcc01c5b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.630+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c23455e0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.631+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd40083e0 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.632+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.633+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.634+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x5596c2340bd0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.635+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4057030 con 0x7fafcc053c20 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c23455e0 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafcc053c20 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.636+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x5596c2340bd0 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5596c2347f10 con 0x7fafd4019040 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:45.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2348980 con 0x5596c2340bd0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2349220 con 0x5596c2340bd0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.637+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2349640 con 0x5596c2340bd0 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 zone default found 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 4 Realm: () 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 zonegroup default 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2349d40 con 0x7fafcc053c20 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c234b830 con 0x5596c23455e0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c234bd20 con 0x5596c23455e0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.638+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.639+0000 7fafdbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.639+0000 7fafdbabb800 20 started sync module instance, tier type = 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.639+0000 7fafdbabb800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.639+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234abd0 con 0x7fafd4019040 2024-09-14T10:55:45.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.640+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.640+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94105991685920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234c180 con 0x7fafd4019040 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.640+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234c9d0 con 0x5596c2340bd0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.641+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94105991685920] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.641+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.641+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94105991693600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234cdf0 con 0x5596c2340bd0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.641+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234d7b0 con 0x5596c23455e0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.642+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.642+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94105991697152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234dbd0 con 0x5596c23455e0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.642+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234e6c0 con 0x7fafd4019040 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.642+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94105991693600] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.643+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94105991697152] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.643+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.643+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94105991694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234dbd0 con 0x7fafd4019040 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.643+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234efd0 con 0x5596c2340bd0 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.644+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.644+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94105991694656] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.644+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94105991698208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234f3c0 con 0x5596c2340bd0 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.644+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234fe00 con 0x7fafcc053c20 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.645+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.645+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94105991706832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234fdc0 con 0x7fafcc053c20 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.645+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350d60 con 0x7fafcc053c20 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.645+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94105991698208] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.646+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94105991706832] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.647+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.647+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94105991710832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c23501f0 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.647+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2351210 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94105991710832] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94105991703264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2351210 con 0x7fafcc053c20 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=0 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=1 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=2 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=3 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=4 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=5 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.648+0000 7fafdbabb800 20 add_watcher() i=6 2024-09-14T10:55:45.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94105991703264] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafdbabb800 20 add_watcher() i=7 2024-09-14T10:55:45.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafdbabb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:45.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2354560 con 0x5596c2340bd0 2024-09-14T10:55:45.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.649+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94105991712464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c23517a0 con 0x5596c2340bd0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.650+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94105991712464] v37'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.650+0000 7fae8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.650+0000 7fafdbabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.650+0000 7fafdbabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.650+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235cbc0 con 0x5596c2340bd0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.651+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.651+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235d1d0 con 0x7fafcc053c20 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.652+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.652+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235d5b0 con 0x5596c23455e0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.653+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.654+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235d540 con 0x5596c2340bd0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.654+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.655+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235daf0 con 0x7fafd4019040 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.655+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.656+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235df80 con 0x5596c23455e0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.656+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.657+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235df80 con 0x5596c2340bd0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.657+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.657+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235df80 con 0x7fafcc053c20 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.658+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.658+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235df80 con 0x7fafd4019040 2024-09-14T10:55:45.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.659+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.660+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235df80 con 0x5596c23455e0 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.661+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.661+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235e150 con 0x7fafd4019040 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.662+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.662+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235e150 con 0x7fafcc053c20 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.663+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.663+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235e1e0 con 0x7fafd4019040 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.664+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.664+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235e1e0 con 0x7fafcc053c20 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.665+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.665+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235e1e0 con 0x5596c2340bd0 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.666+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.666+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bdc0 con 0x5596c23455e0 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.667+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'50 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.667+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bdc0 con 0x7fafd4019040 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.668+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.668+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bef0 con 0x5596c23455e0 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.669+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.669+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x5596c2340bd0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.670+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.670+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235b600 con 0x5596c2340bd0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.671+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.671+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235b7d0 con 0x5596c23455e0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.672+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'51 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.672+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bef0 con 0x7fafd4019040 2024-09-14T10:55:45.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.673+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.673+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bef0 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.674+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.674+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bef0 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.674+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.675+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235bef0 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.675+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.675+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x5596c23455e0 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.676+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.676+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x7fafcc053c20 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.678+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.678+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x5596c23455e0 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.679+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.679+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x7fafcc053c20 2024-09-14T10:55:45.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.680+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.680+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x5596c23455e0 2024-09-14T10:55:45.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.681+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'52 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.681+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235c0c0 con 0x7fafcc053c20 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.682+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.682+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c235eae0 con 0x7fafd4019040 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.683+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.683+0000 7fae8efe5640 20 reqs_thread_entry: start 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.683+0000 7fafdbabb800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.683+0000 7fafdbabb800 20 Filter name: none 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fae8cfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.684+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.685+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.686+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.687+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.688+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.689+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.690+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.691+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.692+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.693+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.693+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.693+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.693+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.694+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.695+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.696+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.697+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.698+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.699+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.700+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.701+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.702+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.703+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.704+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.705+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.706+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x5596c23455e0 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.707+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x5596c23455e0 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.708+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.709+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.709+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2388b20 con 0x7fafd4019040 2024-09-14T10:55:45.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.709+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.709+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5596c2389b30 con 0x7fafd4019040 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.709+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.710+0000 7fae8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.710+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94105991712464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2352f10 con 0x5596c2340bd0 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.711+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94105991712464] v37'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.711+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94105991685920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350ed0 con 0x7fafd4019040 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.712+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94105991685920] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.712+0000 7fafdbabb800 20 remove_watcher() i=0 2024-09-14T10:55:45.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.712+0000 7fafdbabb800 2 removed watcher, disabling cache 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.712+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94105991693600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350ed0 con 0x5596c2340bd0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.713+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94105991693600] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.713+0000 7fafdbabb800 20 remove_watcher() i=1 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.713+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94105991697152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350ed0 con 0x5596c23455e0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.714+0000 7fafd9da6640 1 -- 172.21.15.164:0/3574795715 <== osd.3 v2:172.21.15.164:6816/3361197980 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94105991697152] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafd4064040 con 0x5596c23455e0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.714+0000 7fafdbabb800 20 remove_watcher() i=2 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.714+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94105991694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234d300 con 0x7fafd4019040 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.715+0000 7fafd95a5640 1 -- 172.21.15.164:0/3574795715 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94105991694656] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafcc00f070 con 0x7fafd4019040 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.715+0000 7fafdbabb800 20 remove_watcher() i=3 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.715+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94105991698208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c234d300 con 0x5596c2340bd0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.716+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94105991698208] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x5596c2340bd0 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.716+0000 7fafdbabb800 20 remove_watcher() i=4 2024-09-14T10:55:45.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.716+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94105991706832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350ed0 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.717+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94105991706832] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.717+0000 7fafdbabb800 20 remove_watcher() i=5 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.717+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94105991710832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350ed0 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.718+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94105991710832] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.718+0000 7fafdbabb800 20 remove_watcher() i=6 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.718+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94105991703264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5596c2350870 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94105991703264] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafc4089040 con 0x7fafcc053c20 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 20 remove_watcher() i=7 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fafcc053c20 msgr2=0x7fafcc01c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fafcc053c20 0x7fafcc01c5b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2340bd0 msgr2=0x5596c2343090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2340bd0 0x5596c2343090 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fafd4019040 msgr2=0x7fafd40343c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fafd4019040 0x7fafd40343c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c23455e0 msgr2=0x5596c23479d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c23455e0 0x5596c23479d0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faea403ce10 msgr2=0x7faea403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faea403ce10 0x7faea403f2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01cfd0 tx=0x7fafcc04a000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 msgr2=0x5596c2334fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 --2- 172.21.15.164:0/3574795715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c232da10 0x5596c2334fd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fafd4014750 tx=0x7fafd40543e0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 reap_dead start 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafd8da4640 1 -- 172.21.15.164:0/3574795715 reap_dead start 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 shutdown_connections 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.719+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 >> 172.21.15.164:0/3574795715 conn(0x5596c2329e30 msgr2=0x5596c2328040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 shutdown_connections 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/3574795715 wait complete. 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 msgr2=0x7faeb003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 0x7faeb003f2d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01dc50 tx=0x7fafcc04d040 comp rx=0 tx=0).stop 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 msgr2=0x5596c2321330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fafd4005fd0 tx=0x7fafd400af40 comp rx=0 tx=0).stop 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 shutdown_connections 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faeb003ce10 0x7faeb003f2d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/2300052080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c2320f10 0x5596c2321330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 >> 172.21.15.164:0/2300052080 conn(0x5596c23152c0 msgr2=0x5596c23156a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 shutdown_connections 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/2300052080 wait complete. 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 msgr2=0x5596c230d1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 0x5596c230d1b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 msgr2=0x5596c2311e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 0x5596c2311e80 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 msgr2=0x7faec003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 0x7faec003f320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fafc4057000 tx=0x7fafc4052000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 msgr2=0x5596c2305b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fafcc003000 tx=0x7fafcc000f40 comp rx=0 tx=0).stop 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 shutdown_connections 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5596c230fa90 0x5596c2311e80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5596c2307850 0x5596c230d1b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7faec003ce60 0x7faec003f320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 --2- 172.21.15.164:0/84989651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5596c22099d0 0x5596c2305b60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.720+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 >> 172.21.15.164:0/84989651 conn(0x5596c2201f80 msgr2=0x5596c22ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.721+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 shutdown_connections 2024-09-14T10:55:45.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.721+0000 7fafdbabb800 1 -- 172.21.15.164:0/84989651 wait complete. 2024-09-14T10:55:45.736 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-09-14T10:55:45.736 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:55:45.736 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:45.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:45.736 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:55:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.783+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5543f19800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5632bbea3cb0 0x5632bbea60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5543f19800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632bbea6700 con 0x5632bbe9dbd0 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5543f19800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5632bbd2a7d0 con 0x5632bbea3cb0 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5541209640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5632bbea3cb0 0x5632bbea60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5541a0a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5632bbe9dbd0 0x5632bbe9dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41568/0 (socket says 172.21.15.164:41568) 2024-09-14T10:55:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5541a0a640 1 -- 172.21.15.164:0/1284472871 learned_addr learned my addr 172.21.15.164:0/1284472871 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:45.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5541209640 1 -- 172.21.15.164:0/1284472871 >> v1:172.21.15.116:6789/0 conn(0x5632bbe9dbd0 legacy=0x5632bbe9dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.784+0000 7f5541209640 1 -- 172.21.15.164:0/1284472871 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbea7910 con 0x5632bbea3cb0 2024-09-14T10:55:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.786+0000 7f5541209640 1 --2- 172.21.15.164:0/1284472871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea3cb0 0x5632bbea60a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f552c00a470 tx=0x7f552c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe40547c69fbdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.786+0000 7f5540a08640 1 -- 172.21.15.164:0/1284472871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c053570 con 0x5632bbea3cb0 2024-09-14T10:55:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.786+0000 7f5540a08640 1 -- 172.21.15.164:0/1284472871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c058070 con 0x5632bbea3cb0 2024-09-14T10:55:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.786+0000 7f5540a08640 1 -- 172.21.15.164:0/1284472871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f552c053880 con 0x5632bbea3cb0 2024-09-14T10:55:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 -- 172.21.15.164:0/1284472871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea3cb0 msgr2=0x5632bbea60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 --2- 172.21.15.164:0/1284472871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea3cb0 0x5632bbea60a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f552c00a470 tx=0x7f552c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:45.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 -- 172.21.15.164:0/1284472871 shutdown_connections 2024-09-14T10:55:45.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 --2- 172.21.15.164:0/1284472871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea3cb0 0x5632bbea60a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 -- 172.21.15.164:0/1284472871 >> 172.21.15.164:0/1284472871 conn(0x5632bbe996e0 msgr2=0x5632bbe9bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 -- 172.21.15.164:0/1284472871 shutdown_connections 2024-09-14T10:55:45.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.787+0000 7f5543f19800 1 -- 172.21.15.164:0/1284472871 wait complete. 2024-09-14T10:55:45.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.800+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5543f19800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5543f19800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632bbd37dd0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5541a0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5541a0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52028/0 (socket says 172.21.15.164:52028) 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5541a0a640 1 -- 172.21.15.164:0/3741531666 learned_addr learned my addr 172.21.15.164:0/3741531666 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5541a0a640 1 -- 172.21.15.164:0/3741531666 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbf8fde0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.801+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3741531666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5534001670 tx=0x7f5534001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37501a61faa8825d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f542fe07640 1 -- 172.21.15.164:0/3741531666 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534004520 con 0x5632bbe9dbd0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f542fe07640 1 -- 172.21.15.164:0/3741531666 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55340046c0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f542fe07640 1 -- 172.21.15.164:0/3741531666 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55340049e0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 -- 172.21.15.164:0/3741531666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 msgr2=0x5632bbf8f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 --2- 172.21.15.164:0/3741531666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5534001670 tx=0x7f5534001b30 comp rx=0 tx=0).stop 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 -- 172.21.15.164:0/3741531666 shutdown_connections 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 --2- 172.21.15.164:0/3741531666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf8f7f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 -- 172.21.15.164:0/3741531666 >> 172.21.15.164:0/3741531666 conn(0x5632bbe996e0 msgr2=0x5632bbf8b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 -- 172.21.15.164:0/3741531666 shutdown_connections 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.802+0000 7f5543f19800 1 -- 172.21.15.164:0/3741531666 wait complete. 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5543f19800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5543f19800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632bbea6bd0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5541a0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5541a0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52036/0 (socket says 172.21.15.164:52036) 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5541a0a640 1 -- 172.21.15.164:0/3702333718 learned_addr learned my addr 172.21.15.164:0/3702333718 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.803+0000 7f5541a0a640 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbf97880 con 0x5632bbe9dbd0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5534000f80 tx=0x7f5534001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f542e604640 1 -- 172.21.15.164:0/3702333718 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534013760 con 0x5632bbe9dbd0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f542e604640 1 -- 172.21.15.164:0/3702333718 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5534013900 con 0x5632bbe9dbd0 2024-09-14T10:55:45.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f542e604640 1 -- 172.21.15.164:0/3702333718 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5534013be0 con 0x5632bbe9dbd0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632bbf97b10 con 0x5632bbe9dbd0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.804+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632bbf98510 con 0x5632bbe9dbd0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f542e604640 1 -- 172.21.15.164:0/3702333718 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5534010070 con 0x5632bbe9dbd0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f542e604640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 0x7f542803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f542e604640 1 -- 172.21.15.164:0/3702333718 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5534018070 con 0x5632bbe9dbd0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f5541209640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 0x7f542803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 0x5632bbf9e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbf9eeb0 con 0x5632bbea3cb0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f554220b640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 0x5632bbf9e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f5541209640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 0x7f542803f2d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f552c057000 tx=0x7f552c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.805+0000 7f554220b640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 0x5632bbf9e970 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f554220b640 1 -- 172.21.15.164:0/3702333718 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbf9f250 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f554220b640 1 -- 172.21.15.164:0/3702333718 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 0x5632bbfa3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfa3920 con 0x5632bbfa0d10 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 0x5632bbfa3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.806+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 0x5632bbfa3190 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.807+0000 7f5541a0a640 1 -- 172.21.15.164:0/3702333718 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f553401b030 con 0x5632bbfa0d10 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.807+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbf9faa0 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.807+0000 7f554220b640 1 -- 172.21.15.164:0/3702333718 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.807+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbf9fe80 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.807+0000 7f554220b640 1 -- 172.21.15.164:0/3702333718 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbea3cb0 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f5543f19800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f5543f19800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632bbd964a0 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52048/0 (socket says 172.21.15.164:52048) 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f554220b640 1 -- 172.21.15.164:0/3331319969 learned_addr learned my addr 172.21.15.164:0/3331319969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.808+0000 7f554220b640 1 -- 172.21.15.164:0/3331319969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbea0910 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f554220b640 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5632bbf99210 tx=0x7f553c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f54277fe640 1 -- 172.21.15.164:0/3331319969 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c007d60 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f54277fe640 1 -- 172.21.15.164:0/3331319969 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c01e020 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f54277fe640 1 -- 172.21.15.164:0/3331319969 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c019590 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632bbe9f1a0 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.809+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632bbe9f6f0 con 0x5632bbea03f0 2024-09-14T10:55:45.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f54277fe640 1 -- 172.21.15.164:0/3331319969 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f553c016040 con 0x5632bbea03f0 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f54277fe640 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 0x7f541c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f54277fe640 1 -- 172.21.15.164:0/3331319969 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f553c01f030 con 0x5632bbea03f0 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 0x7f541c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5541a0a640 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 0x7f541c03f2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5632bbf993d0 tx=0x7f553401e6e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5543f19800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.810+0000 7f5543f19800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632bbf90210 con 0x5632bbfc0fb0 2024-09-14T10:55:45.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52050/0 (socket says 172.21.15.164:52050) 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f554220b640 1 -- 172.21.15.164:0/2147016486 learned_addr learned my addr 172.21.15.164:0/2147016486 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f554220b640 1 -- 172.21.15.164:0/2147016486 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbfc1980 con 0x5632bbfc0fb0 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f554220b640 1 --2- 172.21.15.164:0/2147016486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f553c054440 tx=0x7f553c045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e0ad144384f06c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f54257fa640 1 -- 172.21.15.164:0/2147016486 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c01d040 con 0x5632bbfc0fb0 2024-09-14T10:55:45.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f54257fa640 1 -- 172.21.15.164:0/2147016486 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c051070 con 0x5632bbfc0fb0 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.811+0000 7f54257fa640 1 -- 172.21.15.164:0/2147016486 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c014340 con 0x5632bbfc0fb0 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- 172.21.15.164:0/2147016486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 msgr2=0x5632bbfc1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 --2- 172.21.15.164:0/2147016486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f553c054440 tx=0x7f553c045490 comp rx=0 tx=0).stop 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- 172.21.15.164:0/2147016486 shutdown_connections 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 --2- 172.21.15.164:0/2147016486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc1390 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- 172.21.15.164:0/2147016486 >> 172.21.15.164:0/2147016486 conn(0x5632bbfbd3b0 msgr2=0x5632bbfbb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- 172.21.15.164:0/2147016486 shutdown_connections 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- 172.21.15.164:0/2147016486 wait complete. 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 Processor -- start 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- start start 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f5543f19800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5632bbfc1fc0 con 0x5632bbfc0fb0 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f554220b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52058/0 (socket says 172.21.15.164:52058) 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.812+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 learned_addr learned my addr 172.21.15.164:0/800669514 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632bbfc8ab0 con 0x5632bbfc0fb0 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f554220b640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f553c054440 tx=0x7f553c0543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f54137fe640 1 -- 172.21.15.164:0/800669514 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c01d030 con 0x5632bbfc0fb0 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632bbfc8d40 con 0x5632bbfc0fb0 2024-09-14T10:55:45.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f54137fe640 1 -- 172.21.15.164:0/800669514 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553c016330 con 0x5632bbfc0fb0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f54137fe640 1 -- 172.21.15.164:0/800669514 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f553c016610 con 0x5632bbfc0fb0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.813+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632bbfc96c0 con 0x5632bbfc0fb0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.814+0000 7f54137fe640 1 -- 172.21.15.164:0/800669514 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f553c0169f0 con 0x5632bbfc0fb0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.814+0000 7f54137fe640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f540c03ce10 0x7f540c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.814+0000 7f54137fe640 1 -- 172.21.15.164:0/800669514 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f553c033030 con 0x5632bbfc0fb0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.814+0000 7f5541a0a640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f540c03ce10 0x7f540c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.814+0000 7f5541a0a640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f540c03ce10 0x7f540c03f2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5534028f70 tx=0x7f5534047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbfd4160 0x5632bbfd6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfd6d70 con 0x5632bbfd4160 2024-09-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5541209640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbfd4160 0x5632bbfd6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5541209640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbfd4160 0x5632bbfd6620 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 20 realm 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.815+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfd71a0 con 0x5632bbfd4160 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfd7a70 con 0x5632bbfd4160 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfd7e10 con 0x5632bbfd4160 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfd8b70 0x5632bbfdaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdb570 con 0x5632bbfd8b70 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f554220b640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfd8b70 0x5632bbfdaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.816+0000 7f554220b640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfd8b70 0x5632bbfdaf60 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbfd8b70 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f5543f19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f5543f19800 20 searching for the correct realm 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbfd8b70 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f554220b640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f553c05c040 0x7f553c046a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f5541a0a640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f553c05c040 0x7f553c046a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.817+0000 7f5541a0a640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f553c05c040 0x7f553c046a00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541a0a640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f553401d350 0x7f55340283d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541209640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f553401d350 0x7f55340283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541209640 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f553401d350 0x7f55340283d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.818+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.819+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbfd8b70 2024-09-14T10:55:45.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.820+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c0083e0 con 0x5632bbfd8b70 2024-09-14T10:55:45.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.821+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.822+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x5632bbfd4160 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.823+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c051070 con 0x7f553401d350 2024-09-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.824+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd8b70 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553401d350 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x5632bbfd4160 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdce60 con 0x7f553c05c040 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:45.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.825+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdbf30 con 0x5632bbfd4160 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdc780 con 0x5632bbfd4160 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdd2e0 con 0x5632bbfd4160 2024-09-14T10:55:45.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 zone default found 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 4 Realm: () 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 zonegroup default 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdd680 con 0x7f553401d350 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.826+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdf460 con 0x5632bbfd8b70 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdf900 con 0x5632bbfd8b70 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 20 started sync module instance, tier type = 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.827+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfde900 con 0x7f553c05c040 2024-09-14T10:55:45.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.828+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.828+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775902331984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfdfd60 con 0x7f553c05c040 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.828+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe05b0 con 0x5632bbfd4160 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.829+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775902331984] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.830+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.830+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775902339328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe09d0 con 0x5632bbfd4160 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.830+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe12a0 con 0x5632bbfd8b70 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.831+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775902339328] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.831+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.831+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775902340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe0df0 con 0x5632bbfd8b70 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.831+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe1da0 con 0x7f553c05c040 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.832+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775902340384] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.832+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.832+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775902345392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe0df0 con 0x7f553c05c040 2024-09-14T10:55:45.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.832+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe2840 con 0x5632bbfd4160 2024-09-14T10:55:45.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.833+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775902345392] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.833+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.833+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775902348080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe0df0 con 0x5632bbfd4160 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.833+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe32c0 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.834+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.834+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775902348080] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.834+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775902350800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe3740 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.834+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe3d30 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.835+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775902350800] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.835+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.835+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775902341440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe3d30 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.835+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4740 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775902341440] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775902351856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4740 con 0x7f553401d350 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=0 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=1 2024-09-14T10:55:45.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=2 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=3 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=4 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=5 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.836+0000 7f5543f19800 20 add_watcher() i=6 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.837+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775902351856] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.837+0000 7f5543f19800 20 add_watcher() i=7 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.837+0000 7f5543f19800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.837+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe7a60 con 0x5632bbfd4160 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.838+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.838+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775902356480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4cd0 con 0x5632bbfd4160 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.839+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775902356480] v37'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.839+0000 7f53f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.839+0000 7f5543f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.839+0000 7f5543f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.839+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff03c0 con 0x5632bbfd4160 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.840+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.840+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff0a10 con 0x7f553401d350 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.841+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.841+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff0e70 con 0x5632bbfd8b70 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.842+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.842+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff0da0 con 0x5632bbfd4160 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.843+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.843+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff13b0 con 0x7f553c05c040 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.844+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.844+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff17e0 con 0x5632bbfd8b70 2024-09-14T10:55:45.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.845+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.845+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff17e0 con 0x5632bbfd4160 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.846+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.846+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff17e0 con 0x7f553401d350 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.847+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.847+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff17e0 con 0x7f553c05c040 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.848+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.848+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1870 con 0x5632bbfd8b70 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.849+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.849+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff19a0 con 0x7f553c05c040 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.850+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'61 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.850+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1960 con 0x7f553401d350 2024-09-14T10:55:45.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.851+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.851+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1960 con 0x7f553c05c040 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.852+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.852+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1960 con 0x7f553401d350 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.853+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.853+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1950 con 0x5632bbfd4160 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.854+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.854+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff19b0 con 0x5632bbfd8b70 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.855+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'53 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.855+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1a60 con 0x7f553c05c040 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.856+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'62 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.856+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1a60 con 0x5632bbfd8b70 2024-09-14T10:55:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.857+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.857+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1a00 con 0x5632bbfd4160 2024-09-14T10:55:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.858+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.858+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1a00 con 0x5632bbfd4160 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.859+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.859+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1a00 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.860+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'54 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.860+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1970 con 0x7f553c05c040 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.861+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.861+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1970 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.862+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.862+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1970 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.863+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.863+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff19c0 con 0x5632bbfd8b70 2024-09-14T10:55:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.864+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.864+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff19c0 con 0x5632bbfd8b70 2024-09-14T10:55:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.865+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.865+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1330 con 0x7f553401d350 2024-09-14T10:55:45.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.866+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.866+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff1330 con 0x5632bbfd8b70 2024-09-14T10:55:45.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.867+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.867+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff2030 con 0x7f553401d350 2024-09-14T10:55:45.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.868+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.868+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff2030 con 0x5632bbfd8b70 2024-09-14T10:55:45.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.869+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'55 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.869+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff2030 con 0x7f553401d350 2024-09-14T10:55:45.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.870+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.870+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbff2030 con 0x7f553c05c040 2024-09-14T10:55:45.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.871+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.871+0000 7f53f27fc640 20 reqs_thread_entry: start 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 20 Filter name: none 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5363fff640 20 reqs_thread_entry: start 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 20 rados->read ofs=0 len=0 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bc01cba0 con 0x5632bbfd4160 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:45.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:45.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.872+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5632bc01c680 con 0x7f553c05c040 2024-09-14T10:55:45.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.873+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.872 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:55:45.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.873+0000 7f53f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:45.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.873+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775902356480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe6db0 con 0x5632bbfd4160 2024-09-14T10:55:45.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.874+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94775902356480] v37'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.874+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775902331984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x7f553c05c040 2024-09-14T10:55:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.875+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94775902331984] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.875+0000 7f5543f19800 20 remove_watcher() i=0 2024-09-14T10:55:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.875+0000 7f5543f19800 2 removed watcher, disabling cache 2024-09-14T10:55:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.875+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775902339328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x5632bbfd4160 2024-09-14T10:55:45.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.876+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94775902339328] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.876+0000 7f5543f19800 20 remove_watcher() i=1 2024-09-14T10:55:45.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.877+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775902340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x5632bbfd8b70 2024-09-14T10:55:45.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.877+0000 7f554220b640 1 -- 172.21.15.164:0/800669514 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94775902340384] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553c069040 con 0x5632bbfd8b70 2024-09-14T10:55:45.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.877+0000 7f5543f19800 20 remove_watcher() i=2 2024-09-14T10:55:45.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.877+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775902345392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x7f553c05c040 2024-09-14T10:55:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.878+0000 7f5541a0a640 1 -- 172.21.15.164:0/800669514 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94775902345392] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f553401b030 con 0x7f553c05c040 2024-09-14T10:55:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.878+0000 7f5543f19800 20 remove_watcher() i=3 2024-09-14T10:55:45.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.878+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775902348080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x5632bbfd4160 2024-09-14T10:55:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.879+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94775902348080] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x5632bbfd4160 2024-09-14T10:55:45.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.879+0000 7f5543f19800 20 remove_watcher() i=4 2024-09-14T10:55:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.879+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775902350800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x7f553401d350 2024-09-14T10:55:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.880+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94775902350800] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.880+0000 7f5543f19800 20 remove_watcher() i=5 2024-09-14T10:55:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.880+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775902341440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe2dd0 con 0x7f553401d350 2024-09-14T10:55:45.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.881+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94775902341440] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.881+0000 7f5543f19800 20 remove_watcher() i=6 2024-09-14T10:55:45.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.881+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775902351856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5632bbfe4400 con 0x7f553401d350 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94775902351856] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f552c080040 con 0x7f553401d350 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 20 remove_watcher() i=7 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f553401d350 msgr2=0x7f55340283d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f553401d350 0x7f55340283d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbfd4160 msgr2=0x5632bbfd6620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbfd4160 0x5632bbfd6620 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f553c05c040 msgr2=0x7f553c046a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f553c05c040 0x7f553c046a00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfd8b70 msgr2=0x5632bbfdaf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfd8b70 0x5632bbfdaf60 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f540c03ce10 msgr2=0x7f540c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f540c03ce10 0x7f540c03f2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5534028f70 tx=0x7f5534047000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 msgr2=0x5632bbfc8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f553c054440 tx=0x7f553c0543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.882+0000 7f5541209640 1 -- 172.21.15.164:0/800669514 reap_dead start 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 shutdown_connections 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/800669514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbfc0fb0 0x5632bbfc8550 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 >> 172.21.15.164:0/800669514 conn(0x5632bbfbd3b0 msgr2=0x5632bbfbb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 shutdown_connections 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/800669514 wait complete. 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 msgr2=0x7f541c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 0x7f541c03f2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5632bbf993d0 tx=0x7f553401e6e0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 msgr2=0x5632bbe9ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x5632bbf99210 tx=0x7f553c00af20 comp rx=0 tx=0).stop 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 shutdown_connections 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f541c03ce10 0x7f541c03f2d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3331319969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbea03f0 0x5632bbe9ec60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 >> 172.21.15.164:0/3331319969 conn(0x5632bbfa6710 msgr2=0x5632bbfa6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 shutdown_connections 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3331319969 wait complete. 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 msgr2=0x5632bbf9e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 0x5632bbf9e970 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 msgr2=0x5632bbfa3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 0x5632bbfa3190 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 msgr2=0x7f542803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.883+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 0x7f542803f2d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f552c057000 tx=0x7f552c052000 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 msgr2=0x5632bbf97320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5534000f80 tx=0x7f5534001250 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 shutdown_connections 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5632bbfa0d10 0x5632bbfa3190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5632bbea3cb0 0x5632bbf9e970 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f542803ce10 0x7f542803f2d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 --2- 172.21.15.164:0/3702333718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5632bbe9dbd0 0x5632bbf97320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 >> 172.21.15.164:0/3702333718 conn(0x5632bbe996e0 msgr2=0x5632bbf90ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 shutdown_connections 2024-09-14T10:55:45.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:45.884+0000 7f5543f19800 1 -- 172.21.15.164:0/3702333718 wait complete. 2024-09-14T10:55:45.890 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:55:45.898 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-14T10:55:45.903 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:45.931 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:45.940 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:45.989 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-14T10:55:45.994 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:45.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:55:45.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:55:45.994 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:55:46.039 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.040 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.042+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1b072c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5634e18f6030 0x5634e19853f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1b072c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634e19896f0 con 0x5634e19859f0 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1b072c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5634e180d7d0 con 0x5634e18f6030 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1ac33e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5634e18f6030 0x5634e19853f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1a3b3d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5634e19859f0 0x5634e1987e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41584/0 (socket says 172.21.15.164:41584) 2024-09-14T10:55:46.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/2328601422 learned_addr learned my addr 172.21.15.164:0/2328601422 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:46.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1ac33e640 1 -- 172.21.15.164:0/2328601422 >> v1:172.21.15.116:6789/0 conn(0x5634e19859f0 legacy=0x5634e1987e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.043+0000 7fc1ac33e640 1 -- 172.21.15.164:0/2328601422 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e198a920 con 0x5634e18f6030 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.045+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/2328601422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e19853f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00a470 tx=0x7fc19c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6027c4e825acb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.045+0000 7fc1abb3d640 1 -- 172.21.15.164:0/2328601422 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c053570 con 0x5634e18f6030 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.045+0000 7fc1abb3d640 1 -- 172.21.15.164:0/2328601422 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c058070 con 0x5634e18f6030 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.045+0000 7fc1abb3d640 1 -- 172.21.15.164:0/2328601422 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c053880 con 0x5634e18f6030 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 -- 172.21.15.164:0/2328601422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 msgr2=0x5634e19853f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 --2- 172.21.15.164:0/2328601422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e19853f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00a470 tx=0x7fc19c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 -- 172.21.15.164:0/2328601422 shutdown_connections 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 --2- 172.21.15.164:0/2328601422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e19853f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 -- 172.21.15.164:0/2328601422 >> 172.21.15.164:0/2328601422 conn(0x5634e197cfa0 msgr2=0x5634e197f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 -- 172.21.15.164:0/2328601422 shutdown_connections 2024-09-14T10:55:46.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.046+0000 7fc1b072c800 1 -- 172.21.15.164:0/2328601422 wait complete. 2024-09-14T10:55:46.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.059+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.059+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.059+0000 7fc1b072c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.059+0000 7fc1b072c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5634e181add0 con 0x5634e18f6030 2024-09-14T10:55:46.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc1ac33e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc1ac33e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52076/0 (socket says 172.21.15.164:52076) 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc1ac33e640 1 -- 172.21.15.164:0/3151016866 learned_addr learned my addr 172.21.15.164:0/3151016866 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc1ac33e640 1 -- 172.21.15.164:0/3151016866 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e1983140 con 0x5634e18f6030 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/3151016866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc19c025c20 tx=0x7fc19c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd4cf00717175d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc09a60c640 1 -- 172.21.15.164:0/3151016866 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c053570 con 0x5634e18f6030 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc09a60c640 1 -- 172.21.15.164:0/3151016866 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c063070 con 0x5634e18f6030 2024-09-14T10:55:46.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.060+0000 7fc09a60c640 1 -- 172.21.15.164:0/3151016866 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c053840 con 0x5634e18f6030 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- 172.21.15.164:0/3151016866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 msgr2=0x5634e1982b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3151016866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc19c025c20 tx=0x7fc19c051000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- 172.21.15.164:0/3151016866 shutdown_connections 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3151016866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1982b50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- 172.21.15.164:0/3151016866 >> 172.21.15.164:0/3151016866 conn(0x5634e197cfa0 msgr2=0x5634e1a6e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- 172.21.15.164:0/3151016866 shutdown_connections 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- 172.21.15.164:0/3151016866 wait complete. 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.061+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1b072c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1b072c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5634e1989bc0 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1ac33e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1ac33e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52078/0 (socket says 172.21.15.164:52078) 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1ac33e640 1 -- 172.21.15.164:0/4266355481 learned_addr learned my addr 172.21.15.164:0/4266355481 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1ac33e640 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e1a7caa0 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc19c025c20 tx=0x7fc19c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc098e09640 1 -- 172.21.15.164:0/4266355481 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c074480 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc098e09640 1 -- 172.21.15.164:0/4266355481 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c074620 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e1a7cd30 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc098e09640 1 -- 172.21.15.164:0/4266355481 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c074900 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.062+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e1a7d940 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.063+0000 7fc098e09640 1 -- 172.21.15.164:0/4266355481 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc19c074aa0 con 0x5634e18f6030 2024-09-14T10:55:46.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.063+0000 7fc098e09640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 0x7fc09403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.063+0000 7fc098e09640 1 -- 172.21.15.164:0/4266355481 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc19c098a90 con 0x5634e18f6030 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 0x7fc09403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 0x5634e1a83b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1a7e300 con 0x5634e19859f0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 0x5634e1a83b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 0x7fc09403f320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc194001d70 tx=0x7fc1940012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 0x5634e1a83b90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1acb3f640 1 -- 172.21.15.164:0/4266355481 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5634e19859f0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.064+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1a845f0 con 0x5634e19859f0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1acb3f640 1 -- 172.21.15.164:0/4266355481 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5634e19859f0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 0x5634e1a883a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1a88b30 con 0x5634e1a85f00 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 0x5634e1a883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 0x5634e1a883a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1ac33e640 1 -- 172.21.15.164:0/4266355481 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc19c051070 con 0x5634e1a85f00 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.065+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1a84e40 con 0x5634e19859f0 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1acb3f640 1 -- 172.21.15.164:0/4266355481 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5634e19859f0 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1a851e0 con 0x5634e19859f0 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1acb3f640 1 -- 172.21.15.164:0/4266355481 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5634e19859f0 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1b072c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.066+0000 7fc1b072c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5634e18794a0 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52086/0 (socket says 172.21.15.164:52086) 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1acb3f640 1 -- 172.21.15.164:0/3334473009 learned_addr learned my addr 172.21.15.164:0/3334473009 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1acb3f640 1 -- 172.21.15.164:0/3334473009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e1a97f40 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x5634e1a7d540 tx=0x7fc1a4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc091ffb640 1 -- 172.21.15.164:0/3334473009 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4014450 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc091ffb640 1 -- 172.21.15.164:0/3334473009 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4014610 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e1a98770 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc091ffb640 1 -- 172.21.15.164:0/3334473009 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a4014930 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.067+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e1a98d10 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.068+0000 7fc091ffb640 1 -- 172.21.15.164:0/3334473009 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc1a4011040 con 0x5634e1a974e0 2024-09-14T10:55:46.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.068+0000 7fc091ffb640 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 0x7fc08403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.068+0000 7fc091ffb640 1 -- 172.21.15.164:0/3334473009 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc1a401e070 con 0x5634e1a974e0 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 0x7fc08403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 0x7fc08403f2d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5634e1a7de00 tx=0x7fc19c074f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1b072c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1b072c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5634e1981590 con 0x5634e1aa3f40 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52098/0 (socket says 172.21.15.164:52098) 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.069+0000 7fc1acb3f640 1 -- 172.21.15.164:0/105808598 learned_addr learned my addr 172.21.15.164:0/105808598 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.070+0000 7fc1acb3f640 1 -- 172.21.15.164:0/105808598 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e1aa4930 con 0x5634e1aa3f40 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.070+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/105808598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4018430 tx=0x7fc1a4014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a696c1ad4e574e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.070+0000 7fc08b7fe640 1 -- 172.21.15.164:0/105808598 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a404b070 con 0x5634e1aa3f40 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.070+0000 7fc08b7fe640 1 -- 172.21.15.164:0/105808598 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4051070 con 0x5634e1aa3f40 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.070+0000 7fc08b7fe640 1 -- 172.21.15.164:0/105808598 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a40167c0 con 0x5634e1aa3f40 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- 172.21.15.164:0/105808598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 msgr2=0x5634e1aa4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 --2- 172.21.15.164:0/105808598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4018430 tx=0x7fc1a4014ea0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- 172.21.15.164:0/105808598 shutdown_connections 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 --2- 172.21.15.164:0/105808598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aa4340 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- 172.21.15.164:0/105808598 >> 172.21.15.164:0/105808598 conn(0x5634e1aa0340 msgr2=0x5634e1a9e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- 172.21.15.164:0/105808598 shutdown_connections 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- 172.21.15.164:0/105808598 wait complete. 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 Processor -- start 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- start start 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1b072c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5634e1aa4f50 con 0x5634e1aa3f40 2024-09-14T10:55:46.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1acb3f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52112/0 (socket says 172.21.15.164:52112) 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.071+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 learned_addr learned my addr 172.21.15.164:0/486923733 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634e1aabaf0 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc1a402bfd0 tx=0x7fc1a40544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc089ffb640 1 -- 172.21.15.164:0/486923733 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a404b040 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc089ffb640 1 -- 172.21.15.164:0/486923733 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a4031030 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634e1aabd80 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc089ffb640 1 -- 172.21.15.164:0/486923733 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a40167c0 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.072+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634e1aac700 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.073+0000 7fc089ffb640 1 -- 172.21.15.164:0/486923733 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc1a4045720 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.073+0000 7fc089ffb640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07c03ce60 0x7fc07c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.073+0000 7fc089ffb640 1 -- 172.21.15.164:0/486923733 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc1a400e040 con 0x5634e1aa3f40 2024-09-14T10:55:46.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.073+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07c03ce60 0x7fc07c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07c03ce60 0x7fc07c03f320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0923f0 tx=0x7fc19c08b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e1ab72d0 0x5634e1ab9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ab9ee0 con 0x5634e1ab72d0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e1ab72d0 0x5634e1ab9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e1ab72d0 0x5634e1ab9790 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc194009050 con 0x5634e1ab72d0 2024-09-14T10:55:46.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 20 realm 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.074+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ab6620 con 0x5634e1ab72d0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc194009050 con 0x5634e1ab72d0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1aba9d0 con 0x5634e1ab72d0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc194009050 con 0x5634e1ab72d0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1abb2a0 con 0x5634e1ab72d0 2024-09-14T10:55:46.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc194009050 con 0x5634e1ab72d0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1abbcc0 0x5634e1abe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1abe7f0 con 0x5634e1abbcc0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1abbcc0 0x5634e1abe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.075+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1abbcc0 0x5634e1abe0b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1a403e070 con 0x5634e1abbcc0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1b072c800 20 searching for the correct realm 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc1a403e070 con 0x5634e1abbcc0 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1acb3f640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc1a4014070 0x7fc1a40363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc1a4014070 0x7fc1a40363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.076+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc1a4014070 0x7fc1a40363e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.077+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.077+0000 7fc1ac33e640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc19c0a5040 0x7fc19c05e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.077+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.077+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc19c0a5040 0x7fc19c05e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.077+0000 7fc1a3b3d640 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc19c0a5040 0x7fc19c05e8a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194009050 con 0x7fc19c0a5040 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194009050 con 0x5634e1ab72d0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.078+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a403e070 con 0x5634e1abbcc0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.079+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a403e070 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.080+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.081+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.082+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x5634e1ab72d0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.083+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc19c0a5040 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc194029040 con 0x7fc19c0a5040 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac00e0 con 0x7fc1a4014070 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.084+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1abf1b0 con 0x5634e1ab72d0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1abfa00 con 0x5634e1ab72d0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac0560 con 0x5634e1ab72d0 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 zone default found 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 4 Realm: () 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 zonegroup default 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac0900 con 0x7fc19c0a5040 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.085+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac26e0 con 0x5634e1abbcc0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac2ba0 con 0x5634e1abbcc0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 started sync module instance, tier type = 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.086+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac1b80 con 0x7fc1a4014070 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.087+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.087+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94785124441968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac34b0 con 0x7fc1a4014070 2024-09-14T10:55:46.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.087+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac3d00 con 0x5634e1ab72d0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.088+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94785124441968] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.089+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.089+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94785124446208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac3d40 con 0x5634e1ab72d0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.089+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac4850 con 0x5634e1abbcc0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.090+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94785124446208] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.090+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.090+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94785124451072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac4810 con 0x5634e1abbcc0 2024-09-14T10:55:46.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.090+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac52e0 con 0x7fc1a4014070 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.091+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94785124451072] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.091+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.091+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94785124453904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac5700 con 0x7fc1a4014070 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.091+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac6120 con 0x5634e1ab72d0 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.092+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94785124453904] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.092+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.092+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94785124457488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac60e0 con 0x5634e1ab72d0 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.092+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac6b90 con 0x7fc19c0a5040 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.093+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94785124457488] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.093+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.093+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94785124460192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac6b90 con 0x7fc19c0a5040 2024-09-14T10:55:46.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.094+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac6b90 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.094+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94785124460192] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.096+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.096+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94785124448336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac75d0 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.096+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac7f90 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94785124448336] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94785124462880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac7f90 con 0x7fc19c0a5040 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=0 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=1 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=2 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=3 2024-09-14T10:55:46.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=4 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=5 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.097+0000 7fc1b072c800 20 add_watcher() i=6 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94785124462880] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1b072c800 20 add_watcher() i=7 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1b072c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1acb3f0 con 0x5634e1ab72d0 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.098+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94785124465840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1ac88a0 con 0x5634e1ab72d0 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.099+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94785124465840] v37'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.099+0000 7fc0627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.099+0000 7fc1b072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.099+0000 7fc1b072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.099+0000 7fc1b072c800 5 note: GC not initialized 2024-09-14T10:55:46.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc0617e2640 20 reqs_thread_entry: start 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 20 Filter name: none 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fbfd2ffd640 20 reqs_thread_entry: start 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1afed00 con 0x7fc1a4014070 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 : miss 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.100+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:19a90ec8:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b00810 con 0x5634e1ab72d0 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 info.flags=0x17 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 to cache LRU end 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 20 get_obj_state: octx=0x7fc1a4011560 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5634e1b02f18 s->prefetch_data=0 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 3.31s0 3:8f1014c8:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc19c0a5040 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.101+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(64 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 304+0+888 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.102+0000 7fc1b072c800 10 manifest: total_size = 5 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.102+0000 7fc1b072c800 20 get_obj_state: setting s->obj_tag to _iWTMaQ8Uu9hNufxp6KAlRqcRFnMUTdo 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.102+0000 7fc0627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.102+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94785124465840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x5634e1ab72d0 2024-09-14T10:55:46.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.103+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94785124465840] v37'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.103+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94785124441968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc1a4014070 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.104+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94785124441968] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.104+0000 7fc1b072c800 20 remove_watcher() i=0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.104+0000 7fc1b072c800 2 removed watcher, disabling cache 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.104+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94785124446208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x5634e1ab72d0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.106+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94785124446208] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.106+0000 7fc1b072c800 20 remove_watcher() i=1 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.106+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94785124451072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x5634e1abbcc0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.107+0000 7fc1acb3f640 1 -- 172.21.15.164:0/486923733 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94785124451072] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a4063040 con 0x5634e1abbcc0 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.107+0000 7fc1b072c800 20 remove_watcher() i=2 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.107+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94785124453904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc1a4014070 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.108+0000 7fc1ac33e640 1 -- 172.21.15.164:0/486923733 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94785124453904] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c051070 con 0x7fc1a4014070 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.108+0000 7fc1b072c800 20 remove_watcher() i=3 2024-09-14T10:55:46.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.108+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94785124457488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x5634e1ab72d0 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.109+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94785124457488] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x5634e1ab72d0 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.109+0000 7fc1b072c800 20 remove_watcher() i=4 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.109+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94785124460192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.110+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94785124460192] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.110+0000 7fc1b072c800 20 remove_watcher() i=5 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.110+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94785124448336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.111+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94785124448336] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.111+0000 7fc1b072c800 20 remove_watcher() i=6 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.111+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94785124462880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5634e1b04fe0 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.111+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94785124462880] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc194039040 con 0x7fc19c0a5040 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.111+0000 7fc1b072c800 20 remove_watcher() i=7 2024-09-14T10:55:46.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc19c0a5040 msgr2=0x7fc19c05e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc19c0a5040 0x7fc19c05e8a0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e1ab72d0 msgr2=0x5634e1ab9790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e1ab72d0 0x5634e1ab9790 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc1a4014070 msgr2=0x7fc1a40363e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc1a4014070 0x7fc1a40363e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1abbcc0 msgr2=0x5634e1abe0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1abbcc0 0x5634e1abe0b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07c03ce60 msgr2=0x7fc07c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07c03ce60 0x7fc07c03f320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0923f0 tx=0x7fc19c08b000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 msgr2=0x5634e1aab590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1a3b3d640 1 -- 172.21.15.164:0/486923733 reap_dead start 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc1a402bfd0 tx=0x7fc1a40544e0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 shutdown_connections 2024-09-14T10:55:46.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/486923733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1aa3f40 0x5634e1aab590 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 >> 172.21.15.164:0/486923733 conn(0x5634e1aa0340 msgr2=0x5634e1a9e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 shutdown_connections 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/486923733 wait complete. 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 msgr2=0x7fc08403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 0x7fc08403f2d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5634e1a7de00 tx=0x7fc19c074f90 comp rx=0 tx=0).stop 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 msgr2=0x5634e1a97900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x5634e1a7d540 tx=0x7fc1a4018830 comp rx=0 tx=0).stop 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 shutdown_connections 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08403ce10 0x7fc08403f2d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 --2- 172.21.15.164:0/3334473009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e1a974e0 0x5634e1a97900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 >> 172.21.15.164:0/3334473009 conn(0x5634e1a8b890 msgr2=0x5634e1a8bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 shutdown_connections 2024-09-14T10:55:46.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.112+0000 7fc1b072c800 1 -- 172.21.15.164:0/3334473009 wait complete. 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 msgr2=0x5634e1a83b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 0x5634e1a83b90 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 msgr2=0x5634e1a883a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 0x5634e1a883a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 msgr2=0x7fc09403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 0x7fc09403f320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc194001d70 tx=0x7fc1940012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 msgr2=0x5634e1a7c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc19c025c20 tx=0x7fc19c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 shutdown_connections 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5634e1a85f00 0x5634e1a883a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5634e19859f0 0x5634e1a83b90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc09403ce60 0x7fc09403f320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 --2- 172.21.15.164:0/4266355481 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5634e18f6030 0x5634e1a7c540 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 >> 172.21.15.164:0/4266355481 conn(0x5634e197cfa0 msgr2=0x5634e1a6dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 shutdown_connections 2024-09-14T10:55:46.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.113+0000 7fc1b072c800 1 -- 172.21.15.164:0/4266355481 wait complete. 2024-09-14T10:55:46.120 INFO:teuthology.orchestra.run.smithi164.stdout:fooFoofooFooFULL_CONTROL 2024-09-14T10:55:46.120 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-14T10:55:46.122 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-14T10:55:46.128 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:46.128 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:55:46.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-14T10:55:46.128 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:55:46.174 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.174 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20559af800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5559a8ddb7c0 0x5559a8ddbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20559af800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559a8ddd4a0 con 0x5559a8ddc8e0 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20559af800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5559a8c677d0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20534a0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5559a8ddb7c0 0x5559a8ddbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f2052c9f640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5559a8ddc8e0 0x5559a8ddcd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41586/0 (socket says 172.21.15.164:41586) 2024-09-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20534a0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5559a8ddb7c0 0x5559a8ddbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52120/0 (socket says 172.21.15.164:52120) 2024-09-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f2052c9f640 1 -- 172.21.15.164:0/2563568680 learned_addr learned my addr 172.21.15.164:0/2563568680 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20534a0640 1 -- 172.21.15.164:0/2563568680 >> v1:172.21.15.116:6789/0 conn(0x5559a8ddc8e0 legacy=0x5559a8ddcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.177+0000 7f20534a0640 1 -- 172.21.15.164:0/2563568680 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8ddd670 con 0x5559a8ddb7c0 2024-09-14T10:55:46.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.179+0000 7f20534a0640 1 --2- 172.21.15.164:0/2563568680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ddbbc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f204400a470 tx=0x7f2044045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae27626c7ef9db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.179+0000 7f205249e640 1 -- 172.21.15.164:0/2563568680 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044053570 con 0x5559a8ddb7c0 2024-09-14T10:55:46.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.179+0000 7f205249e640 1 -- 172.21.15.164:0/2563568680 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044058070 con 0x5559a8ddb7c0 2024-09-14T10:55:46.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.179+0000 7f205249e640 1 -- 172.21.15.164:0/2563568680 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044053880 con 0x5559a8ddb7c0 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 -- 172.21.15.164:0/2563568680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 msgr2=0x5559a8ddbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 --2- 172.21.15.164:0/2563568680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ddbbc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f204400a470 tx=0x7f2044045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 -- 172.21.15.164:0/2563568680 shutdown_connections 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 --2- 172.21.15.164:0/2563568680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ddbbc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 -- 172.21.15.164:0/2563568680 >> 172.21.15.164:0/2563568680 conn(0x5559a8dd6fd0 msgr2=0x5559a8dd9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 -- 172.21.15.164:0/2563568680 shutdown_connections 2024-09-14T10:55:46.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.180+0000 7f20559af800 1 -- 172.21.15.164:0/2563568680 wait complete. 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20559af800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20559af800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5559a8c74dd0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20534a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20534a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52126/0 (socket says 172.21.15.164:52126) 2024-09-14T10:55:46.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.194+0000 7f20534a0640 1 -- 172.21.15.164:0/1808227455 learned_addr learned my addr 172.21.15.164:0/1808227455 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.195+0000 7f20534a0640 1 -- 172.21.15.164:0/1808227455 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8ecf380 con 0x5559a8ddb7c0 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.195+0000 7f20534a0640 1 --2- 172.21.15.164:0/1808227455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2044025c20 tx=0x7f2044051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa93e8541edd900 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.195+0000 7f1f4160a640 1 -- 172.21.15.164:0/1808227455 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044053a20 con 0x5559a8ddb7c0 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.195+0000 7f1f4160a640 1 -- 172.21.15.164:0/1808227455 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044063070 con 0x5559a8ddb7c0 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.195+0000 7f1f4160a640 1 -- 172.21.15.164:0/1808227455 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044053cf0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- 172.21.15.164:0/1808227455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 msgr2=0x5559a8d50600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 --2- 172.21.15.164:0/1808227455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2044025c20 tx=0x7f2044051000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- 172.21.15.164:0/1808227455 shutdown_connections 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 --2- 172.21.15.164:0/1808227455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8d50600 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- 172.21.15.164:0/1808227455 >> 172.21.15.164:0/1808227455 conn(0x5559a8dd6fd0 msgr2=0x5559a8ec7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- 172.21.15.164:0/1808227455 shutdown_connections 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- 172.21.15.164:0/1808227455 wait complete. 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20559af800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5559a8de2dd0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20534a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20534a0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52130/0 (socket says 172.21.15.164:52130) 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.196+0000 7f20534a0640 1 -- 172.21.15.164:0/2584599691 learned_addr learned my addr 172.21.15.164:0/2584599691 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f20534a0640 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8ed4830 con 0x5559a8ddb7c0 2024-09-14T10:55:46.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f20534a0640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2044025c20 tx=0x7f2044002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f1f3fe07640 1 -- 172.21.15.164:0/2584599691 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044068660 con 0x5559a8ddb7c0 2024-09-14T10:55:46.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f1f3fe07640 1 -- 172.21.15.164:0/2584599691 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2044068800 con 0x5559a8ddb7c0 2024-09-14T10:55:46.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f1f3fe07640 1 -- 172.21.15.164:0/2584599691 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044068ae0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a8ed4ac0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.197+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a8ed56d0 con 0x5559a8ddb7c0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.198+0000 7f1f3fe07640 1 -- 172.21.15.164:0/2584599691 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2044068c80 con 0x5559a8ddb7c0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.198+0000 7f1f3fe07640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 0x7f1f3803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.198+0000 7f1f3fe07640 1 -- 172.21.15.164:0/2584599691 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2044098c60 con 0x5559a8ddb7c0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.198+0000 7f2052c9f640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 0x7f1f3803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.198+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 0x5559a8edb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8edbe60 con 0x5559a8ddc8e0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f2053ca1640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 0x5559a8edb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f2052c9f640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 0x7f1f3803f320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f203c001d70 tx=0x7f203c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f2053ca1640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 0x5559a8edb920 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f2053ca1640 1 -- 172.21.15.164:0/2584599691 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f204c00a4d0 con 0x5559a8ddc8e0 2024-09-14T10:55:46.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8edc200 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f2053ca1640 1 -- 172.21.15.164:0/2584599691 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f204c00a4d0 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 0x5559a8ee00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.199+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8ee0860 con 0x5559a8eddc30 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f20534a0640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 0x5559a8ee00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f20534a0640 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 0x5559a8ee00d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f20534a0640 1 -- 172.21.15.164:0/2584599691 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2044051070 con 0x5559a8eddc30 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8edca50 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f2053ca1640 1 -- 172.21.15.164:0/2584599691 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f204c00a4d0 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.200+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8edce30 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f2053ca1640 1 -- 172.21.15.164:0/2584599691 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f204c00a4d0 con 0x5559a8ddc8e0 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f20559af800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f20559af800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5559a8cd34a0 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52134/0 (socket says 172.21.15.164:52134) 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.201+0000 7f2053ca1640 1 -- 172.21.15.164:0/1995352672 learned_addr learned my addr 172.21.15.164:0/1995352672 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f2053ca1640 1 -- 172.21.15.164:0/1995352672 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8eefd20 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f2053ca1640 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5559a8ed60d0 tx=0x7f204c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f1f3d602640 1 -- 172.21.15.164:0/1995352672 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c014450 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f1f3d602640 1 -- 172.21.15.164:0/1995352672 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c014610 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a8ef0550 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f1f3d602640 1 -- 172.21.15.164:0/1995352672 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c014930 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.202+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a8ef0af0 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f1f3d602640 1 -- 172.21.15.164:0/1995352672 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f204c011040 con 0x5559a8eef2c0 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f1f3d602640 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 0x7f1f2c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f1f3d602640 1 -- 172.21.15.164:0/1995352672 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f204c01e070 con 0x5559a8eef2c0 2024-09-14T10:55:46.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f20534a0640 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 0x7f1f2c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.203+0000 7f20534a0640 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 0x7f1f2c03f320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5559a8ed6300 tx=0x7f204405f500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f20559af800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f20559af800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5559a8ecf660 con 0x5559a8efbd00 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52138/0 (socket says 172.21.15.164:52138) 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f2053ca1640 1 -- 172.21.15.164:0/2235113755 learned_addr learned my addr 172.21.15.164:0/2235113755 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f2053ca1640 1 -- 172.21.15.164:0/2235113755 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8efc6d0 con 0x5559a8efbd00 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f2053ca1640 1 --2- 172.21.15.164:0/2235113755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f204c013010 tx=0x7f204c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cf642dac378eef server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f1f36ffd640 1 -- 172.21.15.164:0/2235113755 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c028070 con 0x5559a8efbd00 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f1f36ffd640 1 -- 172.21.15.164:0/2235113755 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c02b350 con 0x5559a8efbd00 2024-09-14T10:55:46.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.204+0000 7f1f36ffd640 1 -- 172.21.15.164:0/2235113755 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c0167c0 con 0x5559a8efbd00 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- 172.21.15.164:0/2235113755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 msgr2=0x5559a8efc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 --2- 172.21.15.164:0/2235113755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f204c013010 tx=0x7f204c014ea0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- 172.21.15.164:0/2235113755 shutdown_connections 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 --2- 172.21.15.164:0/2235113755 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8efc0e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- 172.21.15.164:0/2235113755 >> 172.21.15.164:0/2235113755 conn(0x5559a8ef8100 msgr2=0x5559a8ef6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- 172.21.15.164:0/2235113755 shutdown_connections 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- 172.21.15.164:0/2235113755 wait complete. 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 Processor -- start 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- start start 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8ecca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f20559af800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5559a8efcd10 con 0x5559a8efbd00 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8ecca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f2053ca1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8ecca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52144/0 (socket says 172.21.15.164:52144) 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.205+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 learned_addr learned my addr 172.21.15.164:0/930445272 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a8eccff0 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f2053ca1640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8ecca90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f204c02bfd0 tx=0x7f204c0543a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f1f357fa640 1 -- 172.21.15.164:0/930445272 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c044050 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f1f357fa640 1 -- 172.21.15.164:0/930445272 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c054a30 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a8ecb3a0 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f1f357fa640 1 -- 172.21.15.164:0/930445272 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f204c054d10 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.206+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a8ecb8e0 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.207+0000 7f1f357fa640 1 -- 172.21.15.164:0/930445272 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f204c034030 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.207+0000 7f1f357fa640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f1c03ceb0 0x7f1f1c03f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.207+0000 7f1f357fa640 1 -- 172.21.15.164:0/930445272 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f204c032070 con 0x5559a8efbd00 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.207+0000 7f20534a0640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f1c03ceb0 0x7f1f1c03f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20534a0640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f1c03ceb0 0x7f1f1c03f370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f204405dac0 tx=0x7f2044088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8f111f0 0x5559a8f136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f13e00 con 0x5559a8f111f0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f2052c9f640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8f111f0 0x5559a8f136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f2052c9f640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8f111f0 0x5559a8f136b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f203c009050 con 0x5559a8f111f0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 20 realm 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.208+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f10540 con 0x5559a8f111f0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f203c009050 con 0x5559a8f111f0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f148f0 con 0x5559a8f111f0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f203c009050 con 0x5559a8f111f0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f151c0 con 0x5559a8f111f0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f203c009050 con 0x5559a8f111f0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8f15be0 0x5559a8f17fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f18710 con 0x5559a8f15be0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.209+0000 7f2053ca1640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8f15be0 0x5559a8f17fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f2053ca1640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8f15be0 0x5559a8f17fd0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f20559af800 20 searching for the correct realm 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f2053ca1640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f204c014070 0x7f204c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f20534a0640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f204c014070 0x7f204c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.210+0000 7f20534a0640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f204c014070 0x7f204c036410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f20534a0640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f204405f040 0x7f204407d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f2052c9f640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f204405f040 0x7f204407d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f2052c9f640 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f204405f040 0x7f204407d760 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c009050 con 0x7f204405f040 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.211+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c009050 con 0x5559a8f111f0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.212+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.213+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.214+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.215+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x5559a8f111f0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.216+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f15be0 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.217+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204405f040 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f203c029040 con 0x7f204405f040 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x5559a8f111f0 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a000 con 0x7f204c014070 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f190d0 con 0x5559a8f111f0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f19920 con 0x5559a8f111f0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.218+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a480 con 0x5559a8f111f0 2024-09-14T10:55:46.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 zone default found 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 4 Realm: () 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 zonegroup default 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1a820 con 0x7f204405f040 2024-09-14T10:55:46.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1c600 con 0x5559a8f15be0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.219+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1cba0 con 0x5559a8f15be0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.220+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.220+0000 7f20559af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.220+0000 7f20559af800 20 started sync module instance, tier type = 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.220+0000 7f20559af800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.220+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1baa0 con 0x7f204c014070 2024-09-14T10:55:46.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.221+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.221+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843574865552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1b700 con 0x7f204c014070 2024-09-14T10:55:46.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.221+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1d9e0 con 0x5559a8f111f0 2024-09-14T10:55:46.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.222+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843574865552] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.222+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.222+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843574870016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1d9a0 con 0x5559a8f111f0 2024-09-14T10:55:46.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.222+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1e490 con 0x5559a8f15be0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.223+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.223+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843574873920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1e450 con 0x5559a8f15be0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.223+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1f470 con 0x7f204c014070 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.223+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843574870016] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.224+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843574873920] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.224+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.224+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843574876288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1f470 con 0x7f204c014070 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.224+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1fd10 con 0x5559a8f111f0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.226+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843574876288] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.226+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.226+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843574878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f1f470 con 0x5559a8f111f0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.226+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f20460 con 0x7f204405f040 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.227+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843574878080] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.227+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.227+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843574882096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f20420 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.227+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f20e70 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.228+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(56 notify.6 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.228+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843574884800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f21290 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.228+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f21d70 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.228+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843574882096] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843574884800] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843574880352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f21880 con 0x7f204405f040 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=0 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=1 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=2 2024-09-14T10:55:46.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=3 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=4 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=5 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.229+0000 7f20559af800 20 add_watcher() i=6 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.230+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843574880352] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.230+0000 7f20559af800 20 add_watcher() i=7 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.230+0000 7f20559af800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.230+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f24d60 con 0x5559a8f111f0 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.231+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.231+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843574888576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f22180 con 0x5559a8f111f0 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843574888576] v37'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f1f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f20559af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f20559af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f20559af800 5 note: GC not initialized 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f1f08fe1640 20 reqs_thread_entry: start 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f20559af800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f20559af800 20 Filter name: none 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.232+0000 7f1e827fc640 20 reqs_thread_entry: start 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f58500 con 0x7f204c014070 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 : miss 2024-09-14T10:55:46.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:19a90ec8:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f59fc0 con 0x5559a8f111f0 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 info.flags=0x17 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 to cache LRU end 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 20 get_obj_state: octx=0x7f204c02c4e0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5559a8f5c6c8 s->prefetch_data=0 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.233+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 3.31s0 3:8f1014c8:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204405f040 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.234+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(64 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+950 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.234+0000 7f20559af800 10 manifest: total_size = 5 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.234+0000 7f20559af800 20 get_obj_state: setting s->obj_tag to _sa_eBgMIo4zAOxjsa-1Q4Sqim4TA6nQ 2024-09-14T10:55:46.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.235+0000 7f1f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.235+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843574888576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x5559a8f111f0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.236+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93843574888576] v37'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.236+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843574865552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204c014070 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.237+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93843574865552] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.237+0000 7f20559af800 20 remove_watcher() i=0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.237+0000 7f20559af800 2 removed watcher, disabling cache 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.237+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843574870016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x5559a8f111f0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.238+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93843574870016] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.238+0000 7f20559af800 20 remove_watcher() i=1 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.238+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843574873920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x5559a8f15be0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.239+0000 7f2053ca1640 1 -- 172.21.15.164:0/930445272 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93843574873920] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f204c02a070 con 0x5559a8f15be0 2024-09-14T10:55:46.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.239+0000 7f20559af800 20 remove_watcher() i=2 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.239+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843574876288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204c014070 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.240+0000 7f20534a0640 1 -- 172.21.15.164:0/930445272 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93843574876288] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2044051070 con 0x7f204c014070 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.240+0000 7f20559af800 20 remove_watcher() i=3 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.240+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843574878080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x5559a8f111f0 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.241+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93843574878080] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x5559a8f111f0 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.241+0000 7f20559af800 20 remove_watcher() i=4 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.241+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843574882096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204405f040 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.242+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93843574882096] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.242+0000 7f20559af800 20 remove_watcher() i=5 2024-09-14T10:55:46.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.242+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843574884800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204405f040 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.243+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93843574884800] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.243+0000 7f20559af800 20 remove_watcher() i=6 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.243+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843574880352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5559a8f5e750 con 0x7f204405f040 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93843574880352] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f203c039040 con 0x7f204405f040 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 20 remove_watcher() i=7 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f204405f040 msgr2=0x7f204407d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f204405f040 0x7f204407d760 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8f111f0 msgr2=0x5559a8f136b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8f111f0 0x5559a8f136b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f204c014070 msgr2=0x7f204c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f204c014070 0x7f204c036410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8f15be0 msgr2=0x5559a8f17fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.244+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8f15be0 0x5559a8f17fd0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f1c03ceb0 msgr2=0x7f1f1c03f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f1c03ceb0 0x7f1f1c03f370 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f204405dac0 tx=0x7f2044088000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 msgr2=0x5559a8ecca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/930445272 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8efbd00 0x5559a8ecca90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f204c02bfd0 tx=0x7f204c0543a0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 reap_dead start 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f2052c9f640 1 -- 172.21.15.164:0/930445272 reap_dead start 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 shutdown_connections 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 >> 172.21.15.164:0/930445272 conn(0x5559a8ef8100 msgr2=0x5559a8ef6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 shutdown_connections 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/930445272 wait complete. 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 msgr2=0x7f1f2c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 0x7f1f2c03f320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5559a8ed6300 tx=0x7f204405f500 comp rx=0 tx=0).stop 2024-09-14T10:55:46.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 msgr2=0x5559a8eef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x5559a8ed60d0 tx=0x7f204c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 shutdown_connections 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f2c03ce60 0x7f1f2c03f320 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/1995352672 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8eef2c0 0x5559a8eef6e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 >> 172.21.15.164:0/1995352672 conn(0x5559a8ee3670 msgr2=0x5559a8ee3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 shutdown_connections 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/1995352672 wait complete. 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 msgr2=0x5559a8edb920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 0x5559a8edb920 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 msgr2=0x5559a8ee00d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.245+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 0x5559a8ee00d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 msgr2=0x7f1f3803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 0x7f1f3803f320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f203c001d70 tx=0x7f203c0012d0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 msgr2=0x5559a8ed42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2044025c20 tx=0x7f2044002fb0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 shutdown_connections 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5559a8eddc30 0x5559a8ee00d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5559a8ddc8e0 0x5559a8edb920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1f3803ce60 0x7f1f3803f320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 --2- 172.21.15.164:0/2584599691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5559a8ddb7c0 0x5559a8ed42d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 >> 172.21.15.164:0/2584599691 conn(0x5559a8dd6fd0 msgr2=0x5559a8ec5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 shutdown_connections 2024-09-14T10:55:46.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.246+0000 7f20559af800 1 -- 172.21.15.164:0/2584599691 wait complete. 2024-09-14T10:55:46.255 INFO:teuthology.orchestra.run.smithi164.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-14T10:55:46.255 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-14T10:55:46.258 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-14T10:55:46.269 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:46.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-14T10:55:46.369 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-14T10:55:46.370 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-14T10:55:46.370 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-14T10:55:46.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-14T10:55:46.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-14T10:55:46.370 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-14T10:55:46.416 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.417 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.419+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5663020800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557463a0abd0 0x557463a0d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5663020800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557463a0d740 con 0x55746397a7d0 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5663020800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5574638917d0 con 0x557463a0abd0 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f565bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557463a0abd0 0x557463a0d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5660b0a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55746397a7d0 0x557463a09480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41602/0 (socket says 172.21.15.164:41602) 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f5660b0a640 1 -- 172.21.15.164:0/3921348929 learned_addr learned my addr 172.21.15.164:0/3921348929 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f565bfff640 1 -- 172.21.15.164:0/3921348929 >> v1:172.21.15.116:6789/0 conn(0x55746397a7d0 legacy=0x557463a09480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.420+0000 7f565bfff640 1 -- 172.21.15.164:0/3921348929 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463a0e970 con 0x557463a0abd0 2024-09-14T10:55:46.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.422+0000 7f565bfff640 1 --2- 172.21.15.164:0/3921348929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a0abd0 0x557463a0d090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f564c00a470 tx=0x7f564c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d789f7d3e8d22d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.422+0000 7f565b7fe640 1 -- 172.21.15.164:0/3921348929 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c053570 con 0x557463a0abd0 2024-09-14T10:55:46.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.422+0000 7f565b7fe640 1 -- 172.21.15.164:0/3921348929 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564c058070 con 0x557463a0abd0 2024-09-14T10:55:46.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.422+0000 7f565b7fe640 1 -- 172.21.15.164:0/3921348929 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f564c053880 con 0x557463a0abd0 2024-09-14T10:55:46.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 -- 172.21.15.164:0/3921348929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a0abd0 msgr2=0x557463a0d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 --2- 172.21.15.164:0/3921348929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a0abd0 0x557463a0d090 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f564c00a470 tx=0x7f564c045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:46.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 -- 172.21.15.164:0/3921348929 shutdown_connections 2024-09-14T10:55:46.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 --2- 172.21.15.164:0/3921348929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a0abd0 0x557463a0d090 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 -- 172.21.15.164:0/3921348929 >> 172.21.15.164:0/3921348929 conn(0x557463a00fd0 msgr2=0x557463a03410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 -- 172.21.15.164:0/3921348929 shutdown_connections 2024-09-14T10:55:46.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.423+0000 7f5663020800 1 -- 172.21.15.164:0/3921348929 wait complete. 2024-09-14T10:55:46.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5663020800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5663020800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55746389edd0 con 0x55746397a7d0 2024-09-14T10:55:46.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5660b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5660b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52168/0 (socket says 172.21.15.164:52168) 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.437+0000 7f5660b0a640 1 -- 172.21.15.164:0/3440512860 learned_addr learned my addr 172.21.15.164:0/3440512860 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.438+0000 7f5660b0a640 1 -- 172.21.15.164:0/3440512860 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463af6db0 con 0x55746397a7d0 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.438+0000 7f5660b0a640 1 --2- 172.21.15.164:0/3440512860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5654001e40 tx=0x7f5654001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb4c457d6bc9938 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.438+0000 7f554ee05640 1 -- 172.21.15.164:0/3440512860 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5654012020 con 0x55746397a7d0 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.438+0000 7f554ee05640 1 -- 172.21.15.164:0/3440512860 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565400e5a0 con 0x55746397a7d0 2024-09-14T10:55:46.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.438+0000 7f554ee05640 1 -- 172.21.15.164:0/3440512860 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565400e8a0 con 0x55746397a7d0 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- 172.21.15.164:0/3440512860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 msgr2=0x557463af67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 --2- 172.21.15.164:0/3440512860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5654001e40 tx=0x7f5654001e70 comp rx=0 tx=0).stop 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- 172.21.15.164:0/3440512860 shutdown_connections 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 --2- 172.21.15.164:0/3440512860 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463af67c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- 172.21.15.164:0/3440512860 >> 172.21.15.164:0/3440512860 conn(0x557463a00fd0 msgr2=0x557463af2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- 172.21.15.164:0/3440512860 shutdown_connections 2024-09-14T10:55:46.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- 172.21.15.164:0/3440512860 wait complete. 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5663020800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557463a0dc10 con 0x55746397a7d0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5660b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5660b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52178/0 (socket says 172.21.15.164:52178) 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.439+0000 7f5660b0a640 1 -- 172.21.15.164:0/3259838808 learned_addr learned my addr 172.21.15.164:0/3259838808 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f5660b0a640 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463afe890 con 0x55746397a7d0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f5660b0a640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f565400c010 tx=0x7f5654000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f554d602640 1 -- 172.21.15.164:0/3259838808 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5654012030 con 0x55746397a7d0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f554d602640 1 -- 172.21.15.164:0/3259838808 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56540014a0 con 0x55746397a7d0 2024-09-14T10:55:46.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557463afeb20 con 0x55746397a7d0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f554d602640 1 -- 172.21.15.164:0/3259838808 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565401a7a0 con 0x55746397a7d0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.440+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557463aff520 con 0x55746397a7d0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f554d602640 1 -- 172.21.15.164:0/3259838808 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5654015020 con 0x55746397a7d0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f554d602640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 0x7f554803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f554d602640 1 -- 172.21.15.164:0/3259838808 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5654020030 con 0x55746397a7d0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f565bfff640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 0x7f554803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 0x557463b05980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b00090 con 0x557463a0abd0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.441+0000 7f566130b640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 0x557463b05980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f565bfff640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 0x7f554803f320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f564c057000 tx=0x7f564c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f566130b640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 0x557463b05980 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f566130b640 1 -- 172.21.15.164:0/3259838808 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f565c00a4d0 con 0x557463a0abd0 2024-09-14T10:55:46.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463aff9b0 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f566130b640 1 -- 172.21.15.164:0/3259838808 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f565c00a4d0 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 0x557463b0a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b0a8b0 con 0x557463b07df0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.442+0000 7f5660b0a640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 0x557463b0a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.443+0000 7f5660b0a640 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 0x557463b0a1e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.443+0000 7f5660b0a640 1 -- 172.21.15.164:0/3259838808 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56540187b0 con 0x557463b07df0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.443+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b06c90 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.443+0000 7f566130b640 1 -- 172.21.15.164:0/3259838808 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f565c00a4d0 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.443+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b07130 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f566130b640 1 -- 172.21.15.164:0/3259838808 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f565c00a4d0 con 0x557463a0abd0 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f5663020800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f5663020800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5574638fd4a0 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52192/0 (socket says 172.21.15.164:52192) 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.444+0000 7f566130b640 1 -- 172.21.15.164:0/668946343 learned_addr learned my addr 172.21.15.164:0/668946343 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f566130b640 1 -- 172.21.15.164:0/668946343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463b19cf0 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f566130b640 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x557463b05ec0 tx=0x7f565c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f55467fc640 1 -- 172.21.15.164:0/668946343 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c014450 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f55467fc640 1 -- 172.21.15.164:0/668946343 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0145f0 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557463b1a520 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f55467fc640 1 -- 172.21.15.164:0/668946343 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c014910 con 0x557463b19290 2024-09-14T10:55:46.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.445+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557463b1aac0 con 0x557463b19290 2024-09-14T10:55:46.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f55467fc640 1 -- 172.21.15.164:0/668946343 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f565c011040 con 0x557463b19290 2024-09-14T10:55:46.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f55467fc640 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 0x7f553803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f55467fc640 1 -- 172.21.15.164:0/668946343 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f565c01e070 con 0x557463b19290 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5660b0a640 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 0x7f553803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5660b0a640 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 0x7f553803f320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x557463b05f60 tx=0x7f5654052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5663020800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.446+0000 7f5663020800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557463af71e0 con 0x557463a05470 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52202/0 (socket says 172.21.15.164:52202) 2024-09-14T10:55:46.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f566130b640 1 -- 172.21.15.164:0/1122046402 learned_addr learned my addr 172.21.15.164:0/1122046402 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f566130b640 1 -- 172.21.15.164:0/1122046402 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463a05e40 con 0x557463a05470 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f566130b640 1 --2- 172.21.15.164:0/1122046402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f565c016620 tx=0x7f565c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d7f276657f13dd server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f5537fff640 1 -- 172.21.15.164:0/1122046402 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c051020 con 0x557463a05470 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f5537fff640 1 -- 172.21.15.164:0/1122046402 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0560d0 con 0x557463a05470 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.447+0000 7f5537fff640 1 -- 172.21.15.164:0/1122046402 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c028070 con 0x557463a05470 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- 172.21.15.164:0/1122046402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 msgr2=0x557463a05850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 --2- 172.21.15.164:0/1122046402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f565c016620 tx=0x7f565c011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- 172.21.15.164:0/1122046402 shutdown_connections 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 --2- 172.21.15.164:0/1122046402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463a05850 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- 172.21.15.164:0/1122046402 >> 172.21.15.164:0/1122046402 conn(0x557463b220f0 msgr2=0x557463b20330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- 172.21.15.164:0/1122046402 shutdown_connections 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- 172.21.15.164:0/1122046402 wait complete. 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 Processor -- start 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- start start 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463b2f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f5663020800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557463a064d0 con 0x557463a05470 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463b2f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f566130b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463b2f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52212/0 (socket says 172.21.15.164:52212) 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 learned_addr learned my addr 172.21.15.164:0/1122088696 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.448+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557463b2fa40 con 0x557463a05470 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f566130b640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463b2f4e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f565c016620 tx=0x7f565c054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f55367fc640 1 -- 172.21.15.164:0/1122088696 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c022de0 con 0x557463a05470 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f55367fc640 1 -- 172.21.15.164:0/1122088696 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c054ba0 con 0x557463a05470 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f55367fc640 1 -- 172.21.15.164:0/1122088696 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c001770 con 0x557463a05470 2024-09-14T10:55:46.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557463b2fcd0 con 0x557463a05470 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.449+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557463b30650 con 0x557463a05470 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f55367fc640 1 -- 172.21.15.164:0/1122088696 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f565c034030 con 0x557463a05470 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f55367fc640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f552c03ce10 0x7f552c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f55367fc640 1 -- 172.21.15.164:0/1122088696 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f565c032070 con 0x557463a05470 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f5660b0a640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f552c03ce10 0x7f552c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f5660b0a640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f552c03ce10 0x7f552c03f2d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5654018ac0 tx=0x7f5654048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463b3b270 0x557463b3d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.450+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b3de80 con 0x557463b3b270 2024-09-14T10:55:46.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f565bfff640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463b3b270 0x557463b3d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f565bfff640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463b3b270 0x557463b3d730 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 20 realm 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b3e2b0 con 0x557463b3b270 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.451+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b3eb80 con 0x557463b3b270 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b3ef20 con 0x557463b3b270 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b3fc80 0x557463b42070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b42680 con 0x557463b3fc80 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f566130b640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b3fc80 0x557463b42070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.452+0000 7f566130b640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b3fc80 0x557463b42070 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f565c02a070 con 0x557463b3fc80 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5663020800 20 searching for the correct realm 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f565c02a070 con 0x557463b3fc80 2024-09-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f566130b640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f565c014070 0x7f565c036630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5660b0a640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f565c014070 0x7f565c036630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5660b0a640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f565c014070 0x7f565c036630 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5660b0a640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5654017050 0x7f565404b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.453+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5654017050 0x7f565404b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5654017050 0x7f565404b640 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.454+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.455+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c02a070 con 0x557463b3fc80 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.456+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c02a070 con 0x557463b3fc80 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.457+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.458+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.459+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.460+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3fc80 2024-09-14T10:55:46.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f5654017050 2024-09-14T10:55:46.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x557463b3b270 2024-09-14T10:55:46.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557463b43f70 con 0x7f565c014070 2024-09-14T10:55:46.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.461+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b43040 con 0x557463b3b270 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b43890 con 0x557463b3b270 2024-09-14T10:55:46.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b443f0 con 0x557463b3b270 2024-09-14T10:55:46.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 zone default found 2024-09-14T10:55:46.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 4 Realm: () 2024-09-14T10:55:46.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 zonegroup default 2024-09-14T10:55:46.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.462+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b44790 con 0x7f5654017050 2024-09-14T10:55:46.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b465a0 con 0x557463b3fc80 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b46a40 con 0x557463b3fc80 2024-09-14T10:55:46.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 started sync module instance, tier type = 2024-09-14T10:55:46.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.463+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b45a40 con 0x7f565c014070 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.464+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.464+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93958377332272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b456a0 con 0x7f565c014070 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.464+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b47970 con 0x557463b3b270 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.465+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93958377332272] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.465+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.465+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93958377338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b47d90 con 0x557463b3b270 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.465+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b48750 con 0x557463b3fc80 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.466+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93958377338048] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.467+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.467+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93958377342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b47d90 con 0x557463b3fc80 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.467+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b491f0 con 0x7f565c014070 2024-09-14T10:55:46.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.468+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93958377342112] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.468+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.468+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93958377339104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b47d00 con 0x7f565c014070 2024-09-14T10:55:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.468+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4a0b0 con 0x557463b3b270 2024-09-14T10:55:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.469+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93958377339104] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.469+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.469+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93958377348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4a020 con 0x557463b3b270 2024-09-14T10:55:46.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.469+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4af70 con 0x7f5654017050 2024-09-14T10:55:46.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.470+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93958377348096] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.470+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.470+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93958377350144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4af70 con 0x7f5654017050 2024-09-14T10:55:46.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.470+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4b930 con 0x7f5654017050 2024-09-14T10:55:46.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.471+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93958377350144] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.471+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.471+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93958377352352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4b930 con 0x7f5654017050 2024-09-14T10:55:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.471+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4c2f0 con 0x7f5654017050 2024-09-14T10:55:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93958377352352] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93958377354848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4c2f0 con 0x7f5654017050 2024-09-14T10:55:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=0 2024-09-14T10:55:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=1 2024-09-14T10:55:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=2 2024-09-14T10:55:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=3 2024-09-14T10:55:46.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=4 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=5 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.472+0000 7f5663020800 20 add_watcher() i=6 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93958377354848] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f5663020800 20 add_watcher() i=7 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f5663020800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b4f6f0 con 0x557463b3b270 2024-09-14T10:55:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.473+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93958377357328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b4cc40 con 0x557463b3b270 2024-09-14T10:55:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.474+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93958377357328] v37'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.475+0000 7f5516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.475+0000 7f5663020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.475+0000 7f5663020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.475+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b58040 con 0x557463b3b270 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.476+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.476+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b58040 con 0x7f5654017050 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.477+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.477+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b58b80 con 0x557463b3fc80 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.478+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.478+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b58b80 con 0x557463b3b270 2024-09-14T10:55:46.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.479+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.479+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59110 con 0x7f565c014070 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.480+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.480+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x557463b3fc80 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.481+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.481+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x557463b3b270 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.482+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.482+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x7f5654017050 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.483+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.483+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.484+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.484+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x557463b3fc80 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.485+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.485+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b59960 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.486+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.486+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b576b0 con 0x7f5654017050 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.487+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.487+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b576b0 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.488+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.488+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b576b0 con 0x7f5654017050 2024-09-14T10:55:46.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.489+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.489+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b574e0 con 0x557463b3b270 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.490+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.490+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b574e0 con 0x557463b3fc80 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.491+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'56 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.491+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b574e0 con 0x7f565c014070 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.492+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.492+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b574e0 con 0x557463b3fc80 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.493+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.493+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b574e0 con 0x557463b3b270 2024-09-14T10:55:46.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.494+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.494+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b57940 con 0x557463b3b270 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.495+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.495+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b57030 con 0x557463b3fc80 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.496+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'57 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.496+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b57660 con 0x7f565c014070 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.497+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.497+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575c0 con 0x557463b3fc80 2024-09-14T10:55:46.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.498+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.498+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575c0 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.499+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.499+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575c0 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.500+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.500+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575c0 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.501+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.501+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575c0 con 0x7f5654017050 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.502+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.502+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575e0 con 0x557463b3fc80 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.503+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.503+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575e0 con 0x7f5654017050 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.504+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.504+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575e0 con 0x557463b3fc80 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.505+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'58 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.505+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b575e0 con 0x7f5654017050 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.506+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.506+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b57620 con 0x7f565c014070 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.507+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.507+0000 7f5515fe3640 20 reqs_thread_entry: start 2024-09-14T10:55:46.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.507+0000 7f5663020800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 20 Filter name: none 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f54877fe640 20 reqs_thread_entry: start 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b84e10 con 0x7f565c014070 2024-09-14T10:55:46.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 : miss 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 8.18 8:19a90ec8:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b86720 con 0x557463b3b270 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 info.flags=0x17 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 to cache LRU end 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.508+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:96 4.1b 4:d9edf621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03c50 con 0x7f565c014070 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.509+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(96 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.509+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 4.1f 4:f8b3b149:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03c90 con 0x557463b3fc80 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.509+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(97 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.509+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03c90 con 0x557463b3b270 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.509+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(98 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f5663020800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 4.6 4:620167b9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x557463b3fc80 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(99 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:100 4.3d 4:bc443769:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x557463b3fc80 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(100 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 4.7 4:e3ace330:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x7f5654017050 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.510+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(101 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:102 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x557463b3b270 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(102 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f5663020800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-14T10:55:46.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 4.26 4:67a1ab18:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03c90 con 0x7f5654017050 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(103 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.511+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:104 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x557463b3fc80 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(104 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [call out=428b] v0'0 uv4 ondisk = 0) ==== 194+0+428 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f5663020800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:105 4.15 4:a8ee8d6f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x557463b3fc80 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(105 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c03cd0 con 0x7f565c014070 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.512+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(106 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [call out=701b] v0'0 uv9 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:107 3.19s0 3:9be30c4b:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_9c8454ddf7aa50116496bac348d7550d:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c015e0 con 0x557463b3b270 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(107 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_9c8454ddf7aa50116496bac348d7550d [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 10 manifest: total_size = 6 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.14750148747182809069 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 20 prepare_atomic_modification: state is not atomic. state=0x557463c030e8 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.513+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b8bad0 con 0x557463b3b270 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.514+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(108 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.514+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:109 3.19s0 3:9be30c4b:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b8bad0 con 0x557463b3b270 2024-09-14T10:55:46.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.515+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(109 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_9c8454ddf7aa50116496bac348d7550d [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.515+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:110 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b8c560 con 0x557463b3b270 2024-09-14T10:55:46.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.515+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.515+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:111 3.11s0 3:8baa2d5e:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_b1b9a972ccd8c962a473909b97007eb4:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f564c061000 con 0x557463b3fc80 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(111 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_b1b9a972ccd8c962a473909b97007eb4 [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 10 manifest: total_size = 3 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.16165057280251904380 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 20 prepare_atomic_modification: state is not atomic. state=0x557463c030e8 2024-09-14T10:55:46.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 2024-09-14T10:55:46.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:112 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b911f0 con 0x557463b3b270 2024-09-14T10:55:46.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(110 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.516+0000 7f5537fff640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-14T10:55:46.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.519+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(112 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.519+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:113 3.11s0 3:8baa2d5e:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b88330 con 0x557463b3fc80 2024-09-14T10:55:46.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.520+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(113 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_b1b9a972ccd8c962a473909b97007eb4 [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.520+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b8d1b0 con 0x557463b3b270 2024-09-14T10:55:46.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.520+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.520+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:115 3.2es0 3:74bbc068:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f565c06f000 con 0x7f565c014070 2024-09-14T10:55:46.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(115 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_c785e1ed2950e3e36b1e2ca01f299a54 [call out=24b,getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+915 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 10 manifest: total_size = 4 2024-09-14T10:55:46.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.604959860641552129 2024-09-14T10:55:46.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 20 prepare_atomic_modification: state is not atomic. state=0x557463c030e8 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.521+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:116 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b91280 con 0x557463b3fc80 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.522+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(114 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.522+0000 7f55377fe640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-14T10:55:46.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.522+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(116 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [stat,call,call] v37'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.522+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:117 3.2es0 3:74bbc068:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b871b0 con 0x7f565c014070 2024-09-14T10:55:46.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.523+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(117 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.523+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:118 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b89680 con 0x557463b3fc80 2024-09-14T10:55:46.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.523+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.523+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:119 3.15s0 3:aa3d3e49:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_24d27c169c2c881eb09a065116f2aa5c:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5654066000 con 0x7f565c014070 2024-09-14T10:55:46.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(119 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_24d27c169c2c881eb09a065116f2aa5c [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 10 manifest: total_size = 5 2024-09-14T10:55:46.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.4534942514881751300 2024-09-14T10:55:46.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 20 prepare_atomic_modification: state is not atomic. state=0x557463c030e8 2024-09-14T10:55:46.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 2024-09-14T10:55:46.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:120 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b92df0 con 0x7f565c014070 2024-09-14T10:55:46.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(118 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.524+0000 7f5537fff640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-14T10:55:46.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.525+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(120 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [stat,call,call] v37'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.525+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:121 3.15s0 3:aa3d3e49:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b871b0 con 0x7f565c014070 2024-09-14T10:55:46.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.527+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(121 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_24d27c169c2c881eb09a065116f2aa5c [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.527+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:122 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b89de0 con 0x7f565c014070 2024-09-14T10:55:46.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.527+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.527+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:123 3.31s0 3:8f1014c8:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5654033000 con 0x7f5654017050 2024-09-14T10:55:46.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(123 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+950 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 10 manifest: total_size = 5 2024-09-14T10:55:46.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 20 get_obj_state: setting s->obj_tag to _sa_eBgMIo4zAOxjsa-1Q4Sqim4TA6nQ 2024-09-14T10:55:46.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 20 get_obj_state: octx=0x7f565c054f10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x557463c030e8 s->prefetch_data=0 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 20 prepare_atomic_modification: state is not atomic. state=0x557463c030e8 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.528+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:124 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b934a0 con 0x7f565c014070 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.529+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(122 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [stat,call,call] v37'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.529+0000 7f55377fe640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-14T10:55:46.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.530+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(124 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [stat,call,call] v37'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.530+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:125 3.31s0 3:8f1014c8:::4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b8f2c0 con 0x7f5654017050 2024-09-14T10:55:46.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(125 4d2cef0f-8511-4251-8070-7385f93096af.4241.5_bb3aec0fdcdbc2974890f805c585d432 [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:126 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x7f565c014070 2024-09-14T10:55:46.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 20 list_objects_ordered: starting attempt 1 2024-09-14T10:55:46.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:127 4.1b 4:d9edf621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x7f565c014070 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:128 4.1f 4:f8b3b149:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x557463b3fc80 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:129 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x557463b3b270 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:130 4.6 4:620167b9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c033b0 con 0x557463b3fc80 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:131 4.3d 4:bc443769:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463c033b0 con 0x557463b3fc80 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:132 4.7 4:e3ace330:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b9d310 con 0x7f5654017050 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:133 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba0110 con 0x557463b3b270 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:134 4.26 4:67a1ab18:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f90 con 0x7f5654017050 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.531+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:135 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba5e10 con 0x557463b3fc80 2024-09-14T10:55:46.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(127 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:136 4.15 4:a8ee8d6f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(129 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(128 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:137 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba0110 con 0x7f565c014070 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(130 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(133 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f564c051070 con 0x557463b3b270 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(131 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(132 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(134 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c051070 con 0x7f5654017050 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(135 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(136 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(126 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [stat,call,call] v37'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.532+0000 7f55377fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(137 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.5])"; uploads.size()=0; is_truncated=0 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:138 4.1b 4:d9edf621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f10 con 0x7f565c014070 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:139 4.1f 4:f8b3b149:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2800 con 0x557463b3fc80 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:140 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x557463b3b270 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:141 4.6 4:620167b9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f10 con 0x557463b3fc80 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:142 4.3d 4:bc443769:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2800 con 0x557463b3fc80 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:143 4.7 4:e3ace330:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f10 con 0x7f5654017050 2024-09-14T10:55:46.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:144 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2800 con 0x557463b3b270 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:145 4.26 4:67a1ab18:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x7f5654017050 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f10 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(140 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(139 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:147 4.15 4:a8ee8d6f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b88670 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(138 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:148 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2800 con 0x7f565c014070 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(141 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(142 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(143 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(144 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.533+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(145 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.534+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(146 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.534+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(148 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.534+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(147 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.534+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2f10 con 0x7f565c014070 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.535+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(149 foo.buckets [call] v37'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.535+0000 7f5663020800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.535+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463c01950 con 0x7f565c014070 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(150 myfoo [call,call,delete] v37'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5663020800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5663020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93958378106624 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2d50 con 0x7f5654017050 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== watch-notify(notify (1) cookie 93958377352352 notify 158913789977 ret 0) ==== 191+0+0 (crc 0 0 0) 0x557463b85c60 con 0x7f5654017050 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5537fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 93958377352352 notifier 4661 bl.length()=149 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f5537fff640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5524003d60 con 0x7f5654017050 2024-09-14T10:55:46.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(151 notify.6 [notify cookie 93958378106624 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.536+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== watch-notify(notify_complete (2) cookie 93958378106624 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557463b58210 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.537+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:153 8.18 8:19a90ec8:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463c01950 con 0x557463b3b270 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.537+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(153 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [call,call,delete] v37'15 uv15 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f5663020800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5 from cache 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f5663020800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.5, ofs0, ns] 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:154 7.9 7:93e5b521:::notify.7:head [notify cookie 93958378106624 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b86690 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== watch-notify(notify (1) cookie 93958377354848 notify 158913789978 ret 0) ==== 248+0+0 (crc 0 0 0) 0x557463b58210 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f55377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 93958377354848 notifier 4661 bl.length()=206 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(154 notify.7 [notify cookie 93958378106624 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f55377fe640 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:155 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f54940032c0 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(155 notify.7 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.538+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== watch-notify(notify_complete (2) cookie 93958378106624 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557463b51b60 con 0x7f5654017050 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:156 4.1b 4:d9edf621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463c01950 con 0x7f565c014070 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:157 4.1f 4:f8b3b149:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463ba2d50 con 0x557463b3fc80 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:158 4.27 4:e6b0d54e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b89230 con 0x557463b3b270 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:159 4.6 4:620167b9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b9fe10 con 0x557463b3fc80 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:160 4.3d 4:bc443769:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463c01950 con 0x557463b3fc80 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:161 4.7 4:e3ace330:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463ba0f90 con 0x7f5654017050 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:162 4.9 4:91665b7f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b84be0 con 0x557463b3b270 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:163 4.26 4:67a1ab18:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b9fe10 con 0x7f5654017050 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:164 4.1f 4:fbd10051:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b854f0 con 0x557463b3fc80 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:165 4.15 4:a8ee8d6f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463c01950 con 0x557463b3fc80 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.539+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:166 4.e 4:7337a4a3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b84be0 con 0x7f565c014070 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.540+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(156 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.0 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.540+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(163 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.7 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.540+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(158 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.2 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.540+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(159 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.3 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.541+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(162 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.6 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.541+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(160 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.4 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.541+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(161 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.5 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.541+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(166 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.10 [delete] v37'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(157 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.1 [delete] v37'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(165 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.9 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 50 ==== osd_op_reply(164 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.5.8 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.5 : miss 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:167 6.6 6:61db8c43:::pubsub..bucket.myfoo%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557463b854f0 con 0x557463b3fc80 2024-09-14T10:55:46.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 51 ==== osd_op_reply(167 pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.5 info.flags=0x0 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 10 adding default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.5 to cache LRU end 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.543+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:168 6.6 6:61db8c43:::pubsub..bucket.myfoo%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b84be0 con 0x557463b3fc80 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.546+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 52 ==== osd_op_reply(168 pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.5 [delete] v37'14 uv12 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.546+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b84be0 con 0x7f565c014070 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.547+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(169 foo.buckets [call] v37'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.548+0000 7f5516fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.548+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93958377357328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x557463b3b270 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.549+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93958377357328] v37'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.549+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93958377332272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x7f565c014070 2024-09-14T10:55:46.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.550+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93958377332272] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.550+0000 7f5663020800 20 remove_watcher() i=0 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.550+0000 7f5663020800 2 removed watcher, disabling cache 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.550+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93958377338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x557463b3b270 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.551+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93958377338048] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.551+0000 7f5663020800 20 remove_watcher() i=1 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.551+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93958377342112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x557463b3fc80 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.552+0000 7f566130b640 1 -- 172.21.15.164:0/1122088696 <== osd.3 v2:172.21.15.164:6816/3361197980 53 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93958377342112] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f565c061040 con 0x557463b3fc80 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.552+0000 7f5663020800 20 remove_watcher() i=2 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.552+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93958377339104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x7f565c014070 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.553+0000 7f5660b0a640 1 -- 172.21.15.164:0/1122088696 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93958377339104] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56540187b0 con 0x7f565c014070 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.553+0000 7f5663020800 20 remove_watcher() i=3 2024-09-14T10:55:46.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.553+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93958377348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x557463b3b270 2024-09-14T10:55:46.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.554+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93958377348096] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x557463b3b270 2024-09-14T10:55:46.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.554+0000 7f5663020800 20 remove_watcher() i=4 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.554+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93958377350144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.556+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93958377350144] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.556+0000 7f5663020800 20 remove_watcher() i=5 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.556+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93958377352352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.557+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93958377352352] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.557+0000 7f5663020800 20 remove_watcher() i=6 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.557+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93958377354848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557463b53700 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93958377354848] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f564c090040 con 0x7f5654017050 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 20 remove_watcher() i=7 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5654017050 msgr2=0x7f565404b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5654017050 0x7f565404b640 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463b3b270 msgr2=0x557463b3d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463b3b270 0x557463b3d730 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f565c014070 msgr2=0x7f565c036630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f565c014070 0x7f565c036630 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b3fc80 msgr2=0x557463b42070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b3fc80 0x557463b42070 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f552c03ce10 msgr2=0x7f552c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f552c03ce10 0x7f552c03f2d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5654018ac0 tx=0x7f5654048000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 msgr2=0x557463b2f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 --2- 172.21.15.164:0/1122088696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463a05470 0x557463b2f4e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f565c016620 tx=0x7f565c054510 comp rx=0 tx=0).stop 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f565bfff640 1 -- 172.21.15.164:0/1122088696 reap_dead start 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 shutdown_connections 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 >> 172.21.15.164:0/1122088696 conn(0x557463b220f0 msgr2=0x557463b20300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 shutdown_connections 2024-09-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.558+0000 7f5663020800 1 -- 172.21.15.164:0/1122088696 wait complete. 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 msgr2=0x7f553803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 0x7f553803f320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x557463b05f60 tx=0x7f5654052770 comp rx=0 tx=0).stop 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 msgr2=0x557463b196b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x557463b05ec0 tx=0x7f565c018830 comp rx=0 tx=0).stop 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 shutdown_connections 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f553803ce60 0x7f553803f320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/668946343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557463b19290 0x557463b196b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 >> 172.21.15.164:0/668946343 conn(0x557463b0d640 msgr2=0x557463b0da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 shutdown_connections 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/668946343 wait complete. 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 msgr2=0x557463b05980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 0x557463b05980 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 msgr2=0x557463b0a1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 0x557463b0a1e0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 msgr2=0x7f554803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 0x7f554803f320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f564c057000 tx=0x7f564c052000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 msgr2=0x557463afe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f565400c010 tx=0x7f5654000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 shutdown_connections 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x557463b07df0 0x557463b0a1e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557463a0abd0 0x557463b05980 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f554803ce60 0x7f554803f320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 --2- 172.21.15.164:0/3259838808 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55746397a7d0 0x557463afe330 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 >> 172.21.15.164:0/3259838808 conn(0x557463a00fd0 msgr2=0x557463af7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 shutdown_connections 2024-09-14T10:55:46.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.559+0000 7f5663020800 1 -- 172.21.15.164:0/3259838808 wait complete. 2024-09-14T10:55:46.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:55:46.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:55:46.597 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-14T10:55:46.644 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.644 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b6bd21800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5621bd3dffd0 0x5621bd3e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b6bd21800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621bd3e2900 con 0x5621bd34cef0 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b6bd21800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5621bd2647d0 con 0x5621bd3dffd0 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b67243640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5621bd3dffd0 0x5621bd3e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b67a44640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5621bd34cef0 0x5621bd3de8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41616/0 (socket says 172.21.15.164:41616) 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b67a44640 1 -- 172.21.15.164:0/3075261320 learned_addr learned my addr 172.21.15.164:0/3075261320 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b67243640 1 -- 172.21.15.164:0/3075261320 >> v1:172.21.15.116:6789/0 conn(0x5621bd34cef0 legacy=0x5621bd3de8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b66a42640 1 -- 172.21.15.164:0/3075261320 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498911841 0 0) 0x5621bd3e2900 con 0x5621bd34cef0 2024-09-14T10:55:46.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.647+0000 7f1b67243640 1 -- 172.21.15.164:0/3075261320 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd3e3b30 con 0x5621bd3dffd0 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.649+0000 7f1b67243640 1 --2- 172.21.15.164:0/3075261320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd3e23c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000a470 tx=0x7f1b50045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee527c2b1965ac06 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.649+0000 7f1b66a42640 1 -- 172.21.15.164:0/3075261320 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b50053570 con 0x5621bd3dffd0 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.649+0000 7f1b66a42640 1 -- 172.21.15.164:0/3075261320 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b50058070 con 0x5621bd3dffd0 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.649+0000 7f1b66a42640 1 -- 172.21.15.164:0/3075261320 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b50053880 con 0x5621bd3dffd0 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3075261320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 msgr2=0x5621bd3e23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3075261320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd3e23c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000a470 tx=0x7f1b50045a20 comp rx=0 tx=0).stop 2024-09-14T10:55:46.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3075261320 shutdown_connections 2024-09-14T10:55:46.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3075261320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd3e23c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3075261320 >> 172.21.15.164:0/3075261320 conn(0x5621bd3d3fa0 msgr2=0x5621bd3d6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3075261320 shutdown_connections 2024-09-14T10:55:46.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.650+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3075261320 wait complete. 2024-09-14T10:55:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.663+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b6bd21800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b6bd21800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621bd271dd0 con 0x5621bd34cef0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b67a44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b67a44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52228/0 (socket says 172.21.15.164:52228) 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b67a44640 1 -- 172.21.15.164:0/570601897 learned_addr learned my addr 172.21.15.164:0/570601897 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b67a44640 1 -- 172.21.15.164:0/570601897 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd4cbe40 con 0x5621bd34cef0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1b67a44640 1 --2- 172.21.15.164:0/570601897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001ea0 tx=0x7f1b6000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e90c9066cbadd92 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1a55e0b640 1 -- 172.21.15.164:0/570601897 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b60008070 con 0x5621bd34cef0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1a55e0b640 1 -- 172.21.15.164:0/570601897 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6000d500 con 0x5621bd34cef0 2024-09-14T10:55:46.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.664+0000 7f1a55e0b640 1 -- 172.21.15.164:0/570601897 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6000d880 con 0x5621bd34cef0 2024-09-14T10:55:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 -- 172.21.15.164:0/570601897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 msgr2=0x5621bd4cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/570601897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1b60001ea0 tx=0x7f1b6000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 -- 172.21.15.164:0/570601897 shutdown_connections 2024-09-14T10:55:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/570601897 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd34cef0 0x5621bd4cb850 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 -- 172.21.15.164:0/570601897 >> 172.21.15.164:0/570601897 conn(0x5621bd3d3fa0 msgr2=0x5621bd4c71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 -- 172.21.15.164:0/570601897 shutdown_connections 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 -- 172.21.15.164:0/570601897 wait complete. 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.665+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b6bd21800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b6bd21800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621bd3e2dd0 con 0x5621bd3dffd0 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b67a44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b67a44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52236/0 (socket says 172.21.15.164:52236) 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b67a44640 1 -- 172.21.15.164:0/3686309274 learned_addr learned my addr 172.21.15.164:0/3686309274 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b67a44640 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd4d3b20 con 0x5621bd3dffd0 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.666+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1b600012f0 tx=0x7f1b60000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1a4ffff640 1 -- 172.21.15.164:0/3686309274 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6000de50 con 0x5621bd3dffd0 2024-09-14T10:55:46.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1a4ffff640 1 -- 172.21.15.164:0/3686309274 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6000f930 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd4d3db0 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1a4ffff640 1 -- 172.21.15.164:0/3686309274 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6000fc30 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd4d47b0 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.667+0000 7f1a4ffff640 1 -- 172.21.15.164:0/3686309274 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b60017040 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1a4ffff640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 0x7f1a5003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1a4ffff640 1 -- 172.21.15.164:0/3686309274 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1b60015020 con 0x5621bd3dffd0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b67243640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 0x7f1a5003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 0x5621bd4dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd4db190 con 0x5621bd4d52b0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b68245640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 0x5621bd4dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b67243640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 0x7f1a5003f4c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b50057000 tx=0x7f1b50052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.668+0000 7f1b68245640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 0x5621bd4dac10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b68245640 1 -- 172.21.15.164:0/3686309274 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b5800a4d0 con 0x5621bd4d52b0 2024-09-14T10:55:46.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd4d4c60 con 0x5621bd4d52b0 2024-09-14T10:55:46.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b68245640 1 -- 172.21.15.164:0/3686309274 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b5800a4d0 con 0x5621bd4d52b0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 0x5621bd4df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd4dffa0 con 0x5621bd4dd4e0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 0x5621bd4df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.669+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 0x5621bd4df8d0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b67a44640 1 -- 172.21.15.164:0/3686309274 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b6002d070 con 0x5621bd4dd4e0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd4dc350 con 0x5621bd4d52b0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b68245640 1 -- 172.21.15.164:0/3686309274 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b5800a4d0 con 0x5621bd4d52b0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd4dc820 con 0x5621bd4d52b0 2024-09-14T10:55:46.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b68245640 1 -- 172.21.15.164:0/3686309274 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b5800a4d0 con 0x5621bd4d52b0 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.670+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b6bd21800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b6bd21800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621bd2d04a0 con 0x5621bd4ee940 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52248/0 (socket says 172.21.15.164:52248) 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b68245640 1 -- 172.21.15.164:0/1388276132 learned_addr learned my addr 172.21.15.164:0/1388276132 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b68245640 1 -- 172.21.15.164:0/1388276132 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd4ef3a0 con 0x5621bd4ee940 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b68245640 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800a2a0 tx=0x7f1b58018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1a4d7fa640 1 -- 172.21.15.164:0/1388276132 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58014450 con 0x5621bd4ee940 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1a4d7fa640 1 -- 172.21.15.164:0/1388276132 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580145f0 con 0x5621bd4ee940 2024-09-14T10:55:46.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd4efbd0 con 0x5621bd4ee940 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.671+0000 7f1a4d7fa640 1 -- 172.21.15.164:0/1388276132 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58014910 con 0x5621bd4ee940 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.672+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd4f0170 con 0x5621bd4ee940 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.672+0000 7f1a4d7fa640 1 -- 172.21.15.164:0/1388276132 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b58011040 con 0x5621bd4ee940 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.672+0000 7f1a4d7fa640 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 0x7f1a4003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.672+0000 7f1a4d7fa640 1 -- 172.21.15.164:0/1388276132 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1b5801e070 con 0x5621bd4ee940 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b67a44640 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 0x7f1a4003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b67a44640 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 0x7f1a4003f320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b60052e90 tx=0x7f1b6004e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b6bd21800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b6bd21800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621bd4cc270 con 0x5621bd4fb360 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52264/0 (socket says 172.21.15.164:52264) 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b68245640 1 -- 172.21.15.164:0/2474224697 learned_addr learned my addr 172.21.15.164:0/2474224697 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.673+0000 7f1b68245640 1 -- 172.21.15.164:0/2474224697 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd4fbd50 con 0x5621bd4fb360 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b68245640 1 --2- 172.21.15.164:0/2474224697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b58018430 tx=0x7f1b58001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0d8131e3044ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1a46ffd640 1 -- 172.21.15.164:0/2474224697 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58051020 con 0x5621bd4fb360 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1a46ffd640 1 -- 172.21.15.164:0/2474224697 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b580560d0 con 0x5621bd4fb360 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1a46ffd640 1 -- 172.21.15.164:0/2474224697 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58028070 con 0x5621bd4fb360 2024-09-14T10:55:46.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 -- 172.21.15.164:0/2474224697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 msgr2=0x5621bd4fb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/2474224697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1b58018430 tx=0x7f1b58001440 comp rx=0 tx=0).stop 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 -- 172.21.15.164:0/2474224697 shutdown_connections 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/2474224697 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd4fb760 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 -- 172.21.15.164:0/2474224697 >> 172.21.15.164:0/2474224697 conn(0x5621bd4f7780 msgr2=0x5621bd4f59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 -- 172.21.15.164:0/2474224697 shutdown_connections 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 -- 172.21.15.164:0/2474224697 wait complete. 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.674+0000 7f1b6bd21800 1 Processor -- start 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b6bd21800 1 -- start start 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b6bd21800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd5029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b6bd21800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5621bd4fc370 con 0x5621bd4fb360 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd5029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b68245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd5029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52274/0 (socket says 172.21.15.164:52274) 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 learned_addr learned my addr 172.21.15.164:0/3824923823 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621bd502f10 con 0x5621bd4fb360 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b68245640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd5029b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1b58018430 tx=0x7f1b58011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1a457fa640 1 -- 172.21.15.164:0/3824923823 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58016440 con 0x5621bd4fb360 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1a457fa640 1 -- 172.21.15.164:0/3824923823 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b58054970 con 0x5621bd4fb360 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621bd5031a0 con 0x5621bd4fb360 2024-09-14T10:55:46.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1a457fa640 1 -- 172.21.15.164:0/3824923823 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b58054c70 con 0x5621bd4fb360 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.675+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621bd503b20 con 0x5621bd4fb360 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.676+0000 7f1a457fa640 1 -- 172.21.15.164:0/3824923823 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1b58034030 con 0x5621bd4fb360 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.676+0000 7f1a457fa640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3003ce60 0x7f1a3003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.676+0000 7f1a457fa640 1 -- 172.21.15.164:0/3824923823 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1b58032070 con 0x5621bd4fb360 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.676+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3003ce60 0x7f1a3003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3003ce60 0x7f1a3003f320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000bbf0 tx=0x7f1b60048000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd50e6c0 0x5621bd510b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5112d0 con 0x5621bd50e6c0 2024-09-14T10:55:46.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b67243640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd50e6c0 0x5621bd510b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.677+0000 7f1b67243640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd50e6c0 0x5621bd510b80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 realm 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd511700 con 0x5621bd50e6c0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd511fd0 con 0x5621bd50e6c0 2024-09-14T10:55:46.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd512370 con 0x5621bd50e6c0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.678+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd5130d0 0x5621bd5154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd515ad0 con 0x5621bd5130d0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd5130d0 0x5621bd5154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd5130d0 0x5621bd5154c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b5802a070 con 0x5621bd5130d0 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b6bd21800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b6bd21800 20 searching for the correct realm 2024-09-14T10:55:46.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b5802a070 con 0x5621bd5130d0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b58014070 0x7f1b5803da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.679+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b58014070 0x7f1b5803da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b58014070 0x7f1b5803da10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67a44640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5621bd34cef0 0x7f1b6004b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.680+0000 7f1b67243640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5621bd34cef0 0x7f1b6004b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5621bd34cef0 0x7f1b6004b200 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.681+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5802a070 con 0x5621bd5130d0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.682+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5802a070 con 0x5621bd5130d0 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.683+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b5802a070 con 0x5621bd5130d0 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.684+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.685+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.686+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd5130d0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd34cef0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.687+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5173c0 con 0x7f1b58014070 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5164c0 con 0x5621bd50e6c0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd516d10 con 0x5621bd50e6c0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.688+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd517840 con 0x5621bd50e6c0 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 zone default found 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 4 Realm: () 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 zonegroup default 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd517be0 con 0x5621bd34cef0 2024-09-14T10:55:46.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd5199c0 con 0x5621bd5130d0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519f00 con 0x5621bd5130d0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 started sync module instance, tier type = 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.689+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd518e60 con 0x7f1b58014070 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.690+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.690+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702910149200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd518ac0 con 0x7f1b58014070 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.690+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51ad20 con 0x5621bd50e6c0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.692+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702910149200] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.692+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.692+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702910153568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51b140 con 0x5621bd50e6c0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.692+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51bb60 con 0x5621bd5130d0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.693+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702910153568] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.693+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.693+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702910158416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51bb20 con 0x5621bd5130d0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.693+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51c5f0 con 0x7f1b58014070 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.694+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702910158416] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.694+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.694+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702910161184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51ca10 con 0x7f1b58014070 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.694+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51d450 con 0x5621bd50e6c0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.695+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.695+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702910161184] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.695+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702910164768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51dcf0 con 0x5621bd50e6c0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.695+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51a780 con 0x5621bd34cef0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.696+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.696+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702910169824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51a780 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.696+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702910164768] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.696+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51d840 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.697+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(56 notify.6 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.697+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702910167104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51f1d0 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.697+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51fbd0 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702910169824] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702910167104] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702910170880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51ed20 con 0x5621bd34cef0 2024-09-14T10:55:46.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=0 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=1 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=2 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=3 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=4 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=5 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.698+0000 7f1b6bd21800 20 add_watcher() i=6 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.699+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702910170880] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.699+0000 7f1b6bd21800 20 add_watcher() i=7 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.699+0000 7f1b6bd21800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.699+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51ed20 con 0x5621bd50e6c0 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.700+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.700+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702910174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51ed20 con 0x5621bd50e6c0 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702910174944] v37'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b6bd21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b6bd21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b6bd21800 5 note: GC not initialized 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1a1cfe1640 20 reqs_thread_entry: start 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b6bd21800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f1b6bd21800 20 Filter name: none 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.701+0000 7f19967fc640 20 reqs_thread_entry: start 2024-09-14T10:55:46.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd555d00 con 0x5621bd50e6c0 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.702+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd55bd90 con 0x5621bd50e6c0 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.703+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v37'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.703+0000 7f1b6bd21800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.703+0000 7f1b6bd21800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.703+0000 7f1b6bd21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.703+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94702910420848 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5621bd557620 con 0x5621bd50e6c0 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94702910164768 notify 158913789968 ret 0) ==== 621+0+0 (crc 0 0 0) 0x5621bd3e3b30 con 0x5621bd50e6c0 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1a46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789968 cookie 94702910164768 notifier 4668 bl.length()=579 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94702910420848 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1a46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1a46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1a46ffd640 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f1a2c003ea0 con 0x5621bd50e6c0 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.704+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94702910420848 notify 158913789968 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1b5005fa30 con 0x5621bd50e6c0 2024-09-14T10:55:46.717 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.705+0000 7f1a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.705+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702910174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd553ab0 con 0x5621bd50e6c0 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.706+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94702910174944] v37'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.706+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702910149200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd553ab0 con 0x7f1b58014070 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.707+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94702910149200] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.707+0000 7f1b6bd21800 20 remove_watcher() i=0 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.707+0000 7f1b6bd21800 2 removed watcher, disabling cache 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.707+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702910153568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519250 con 0x5621bd50e6c0 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.708+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94702910153568] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.708+0000 7f1b6bd21800 20 remove_watcher() i=1 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.708+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702910158416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519250 con 0x5621bd5130d0 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.709+0000 7f1b68245640 1 -- 172.21.15.164:0/3824923823 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94702910158416] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b58065040 con 0x5621bd5130d0 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.709+0000 7f1b6bd21800 20 remove_watcher() i=2 2024-09-14T10:55:46.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.709+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702910161184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51b650 con 0x7f1b58014070 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.710+0000 7f1b67a44640 1 -- 172.21.15.164:0/3824923823 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94702910161184] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b6002d070 con 0x7f1b58014070 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.710+0000 7f1b6bd21800 20 remove_watcher() i=3 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.710+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702910164768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519250 con 0x5621bd50e6c0 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.711+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94702910164768] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd50e6c0 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.711+0000 7f1b6bd21800 20 remove_watcher() i=4 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.711+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702910169824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd51b650 con 0x5621bd34cef0 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.712+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94702910169824] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.712+0000 7f1b6bd21800 20 remove_watcher() i=5 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.712+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702910167104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519250 con 0x5621bd34cef0 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.713+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94702910167104] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.713+0000 7f1b6bd21800 20 remove_watcher() i=6 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.713+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702910170880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5621bd519250 con 0x5621bd34cef0 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94702910170880] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b50051070 con 0x5621bd34cef0 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 20 remove_watcher() i=7 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5621bd34cef0 msgr2=0x7f1b6004b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x5621bd34cef0 0x7f1b6004b200 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd50e6c0 msgr2=0x5621bd510b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd50e6c0 0x5621bd510b80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b58014070 msgr2=0x7f1b5803da10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1b58014070 0x7f1b5803da10 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd5130d0 msgr2=0x5621bd5154c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd5130d0 0x5621bd5154c0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3003ce60 msgr2=0x7f1a3003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a3003ce60 0x7f1a3003f320 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000bbf0 tx=0x7f1b60048000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 msgr2=0x5621bd5029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3824923823 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4fb360 0x5621bd5029b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1b58018430 tx=0x7f1b58011f60 comp rx=0 tx=0).stop 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 reap_dead start 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b67243640 1 -- 172.21.15.164:0/3824923823 reap_dead start 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 shutdown_connections 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.714+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 >> 172.21.15.164:0/3824923823 conn(0x5621bd4f7780 msgr2=0x5621bd4f5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 shutdown_connections 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3824923823 wait complete. 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 msgr2=0x7f1a4003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 0x7f1a4003f320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b60052e90 tx=0x7f1b6004e040 comp rx=0 tx=0).stop 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 msgr2=0x5621bd4eed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800a2a0 tx=0x7f1b58018830 comp rx=0 tx=0).stop 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 shutdown_connections 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a4003ce60 0x7f1a4003f320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/1388276132 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd4ee940 0x5621bd4eed60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 >> 172.21.15.164:0/1388276132 conn(0x5621bd4e2cf0 msgr2=0x5621bd4e30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 shutdown_connections 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/1388276132 wait complete. 2024-09-14T10:55:46.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 msgr2=0x5621bd4dac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 0x5621bd4dac10 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 msgr2=0x5621bd4df8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 0x5621bd4df8d0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 msgr2=0x7f1a5003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 0x7f1a5003f4c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b50057000 tx=0x7f1b50052000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 msgr2=0x5621bd4d35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1b600012f0 tx=0x7f1b60000ed0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 shutdown_connections 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5621bd4dd4e0 0x5621bd4df8d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5621bd4d52b0 0x5621bd4dac10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1a5003d000 0x7f1a5003f4c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 --2- 172.21.15.164:0/3686309274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5621bd3dffd0 0x5621bd4d35c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 >> 172.21.15.164:0/3686309274 conn(0x5621bd3d3fa0 msgr2=0x5621bd4ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 shutdown_connections 2024-09-14T10:55:46.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.715+0000 7f1b6bd21800 1 -- 172.21.15.164:0/3686309274 wait complete. 2024-09-14T10:55:46.730 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:46.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:55:46.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-14T10:55:46.730 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-14T10:55:46.777 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.777 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.779+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1ea2d25800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5611b2384730 0x5611b2382f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1ea2d25800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611b2383910 con 0x5611b2383460 2024-09-14T10:55:46.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1ea2d25800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5611b22997d0 con 0x5611b2384730 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e933640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5611b2384730 0x5611b2382f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e933640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5611b2384730 0x5611b2382f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52288/0 (socket says 172.21.15.164:52288) 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e933640 1 -- 172.21.15.164:0/2243127471 learned_addr learned my addr 172.21.15.164:0/2243127471 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e933640 1 -- 172.21.15.164:0/2243127471 >> v1:172.21.15.116:6789/0 conn(0x5611b2383460 legacy=0x5611b2416900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e933640 1 -- 172.21.15.164:0/2243127471 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b2383ae0 con 0x5611b2384730 2024-09-14T10:55:46.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.780+0000 7f1e9e132640 1 -- 172.21.15.164:0/2243127471 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622469137 0 0) 0x5611b2383910 con 0x5611b2383460 2024-09-14T10:55:46.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.782+0000 7f1e9e933640 1 --2- 172.21.15.164:0/2243127471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2384730 0x5611b2382f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000a520 tx=0x7f1e90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a14e3bada943a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1e9e132640 1 -- 172.21.15.164:0/2243127471 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90055070 con 0x5611b2384730 2024-09-14T10:55:46.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1e9e132640 1 -- 172.21.15.164:0/2243127471 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e900515b0 con 0x5611b2384730 2024-09-14T10:55:46.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1e9e132640 1 -- 172.21.15.164:0/2243127471 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e900518d0 con 0x5611b2384730 2024-09-14T10:55:46.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2243127471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2384730 msgr2=0x5611b2382f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2243127471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2384730 0x5611b2382f20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000a520 tx=0x7f1e90045ba0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2243127471 shutdown_connections 2024-09-14T10:55:46.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2243127471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2384730 0x5611b2382f20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2243127471 >> 172.21.15.164:0/2243127471 conn(0x5611b240a1a0 msgr2=0x5611b240c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2243127471 shutdown_connections 2024-09-14T10:55:46.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.783+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2243127471 wait complete. 2024-09-14T10:55:46.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1ea2d25800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1ea2d25800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b22a6dd0 con 0x5611b2383460 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1e9e933640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1e9e933640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52298/0 (socket says 172.21.15.164:52298) 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.797+0000 7f1e9e933640 1 -- 172.21.15.164:0/2920148055 learned_addr learned my addr 172.21.15.164:0/2920148055 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.798+0000 7f1e9e933640 1 -- 172.21.15.164:0/2920148055 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b2500d80 con 0x5611b2383460 2024-09-14T10:55:46.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.798+0000 7f1e9e933640 1 --2- 172.21.15.164:0/2920148055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1e90045be0 tx=0x7f1e90051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ec8b22b99688f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.798+0000 7f1d8ce09640 1 -- 172.21.15.164:0/2920148055 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90051ac0 con 0x5611b2383460 2024-09-14T10:55:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.798+0000 7f1d8ce09640 1 -- 172.21.15.164:0/2920148055 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e90051c60 con 0x5611b2383460 2024-09-14T10:55:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.798+0000 7f1d8ce09640 1 -- 172.21.15.164:0/2920148055 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e90066460 con 0x5611b2383460 2024-09-14T10:55:46.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2920148055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 msgr2=0x5611b2500790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2920148055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1e90045be0 tx=0x7f1e90051000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2920148055 shutdown_connections 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2920148055 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2500790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2920148055 >> 172.21.15.164:0/2920148055 conn(0x5611b240a1a0 msgr2=0x5611b24fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2920148055 shutdown_connections 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2920148055 wait complete. 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1ea2d25800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b2418230 con 0x5611b2383460 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1e9e933640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1e9e933640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52312/0 (socket says 172.21.15.164:52312) 2024-09-14T10:55:46.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.799+0000 7f1e9e933640 1 -- 172.21.15.164:0/809601560 learned_addr learned my addr 172.21.15.164:0/809601560 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1e9e933640 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b2508670 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1e9e933640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e90025da0 tx=0x7f1e90003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1d8b606640 1 -- 172.21.15.164:0/809601560 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9005a650 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1d8b606640 1 -- 172.21.15.164:0/809601560 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9005a7f0 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1d8b606640 1 -- 172.21.15.164:0/809601560 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9005aad0 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611b2508900 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.800+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b2509300 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1d8b606640 1 -- 172.21.15.164:0/809601560 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1e90079060 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1d8b606640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 0x7f1d8403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1d8b606640 1 -- 172.21.15.164:0/809601560 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1e90062070 con 0x5611b2383460 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1e96132640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 0x7f1d8403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.803 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 0x5611b250f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b250fca0 con 0x5611b2384730 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.801+0000 7f1e9f134640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 0x5611b250f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1e96132640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 0x7f1d8403f2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e88000f60 tx=0x7f1e880013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1e9f134640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 0x5611b250f760 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1e9f134640 1 -- 172.21.15.164:0/809601560 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e9800a4d0 con 0x5611b2384730 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2510040 con 0x5611b2384730 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1e9f134640 1 -- 172.21.15.164:0/809601560 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e9800a4d0 con 0x5611b2384730 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 0x5611b2514000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2514790 con 0x5611b2511b80 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.802+0000 7f1e9e933640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 0x5611b2514000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.803+0000 7f1e9e933640 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 0x5611b2514000 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.803+0000 7f1e9e933640 1 -- 172.21.15.164:0/809601560 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1e90057030 con 0x5611b2511b80 2024-09-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.803+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2510890 con 0x5611b2384730 2024-09-14T10:55:46.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.803+0000 7f1e9f134640 1 -- 172.21.15.164:0/809601560 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e9800a4d0 con 0x5611b2384730 2024-09-14T10:55:46.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.803+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2510cf0 con 0x5611b2384730 2024-09-14T10:55:46.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1e9f134640 1 -- 172.21.15.164:0/809601560 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1e9800a4d0 con 0x5611b2384730 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1ea2d25800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1ea2d25800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b23054a0 con 0x5611b25231a0 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52314/0 (socket says 172.21.15.164:52314) 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.804+0000 7f1e9f134640 1 -- 172.21.15.164:0/2179539180 learned_addr learned my addr 172.21.15.164:0/2179539180 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1e9f134640 1 -- 172.21.15.164:0/2179539180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b2523c00 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1e9f134640 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x5611b2509110 tx=0x7f1e98018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1d88e01640 1 -- 172.21.15.164:0/2179539180 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98014450 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1d88e01640 1 -- 172.21.15.164:0/2179539180 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98014610 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1d88e01640 1 -- 172.21.15.164:0/2179539180 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98014930 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611b2524430 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.805+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b25249d0 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1d88e01640 1 -- 172.21.15.164:0/2179539180 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1e98011040 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1d88e01640 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 0x7f1d7803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1d88e01640 1 -- 172.21.15.164:0/2179539180 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1e9801e070 con 0x5611b25231a0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1e9e933640 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 0x7f1d7803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1e9e933640 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 0x7f1d7803f2d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5611b250a240 tx=0x7f1e90085320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1ea2d25800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.806+0000 7f1ea2d25800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b25010f0 con 0x5611b252fc40 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52322/0 (socket says 172.21.15.164:52322) 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1e9f134640 1 -- 172.21.15.164:0/1636648854 learned_addr learned my addr 172.21.15.164:0/1636648854 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1e9f134640 1 -- 172.21.15.164:0/1636648854 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b2530630 con 0x5611b252fc40 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1e9f134640 1 --2- 172.21.15.164:0/1636648854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1e98016fd0 tx=0x7f1e98011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9ec01ad83208d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1d827fc640 1 -- 172.21.15.164:0/1636648854 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9804b070 con 0x5611b252fc40 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1d827fc640 1 -- 172.21.15.164:0/1636648854 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98051070 con 0x5611b252fc40 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.807+0000 7f1d827fc640 1 -- 172.21.15.164:0/1636648854 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98056070 con 0x5611b252fc40 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- 172.21.15.164:0/1636648854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 msgr2=0x5611b2530040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/1636648854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1e98016fd0 tx=0x7f1e98011a80 comp rx=0 tx=0).stop 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- 172.21.15.164:0/1636648854 shutdown_connections 2024-09-14T10:55:46.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/1636648854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2530040 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- 172.21.15.164:0/1636648854 >> 172.21.15.164:0/1636648854 conn(0x5611b252c040 msgr2=0x5611b252a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- 172.21.15.164:0/1636648854 shutdown_connections 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- 172.21.15.164:0/1636648854 wait complete. 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 Processor -- start 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- start start 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1ea2d25800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5611b2530c50 con 0x5611b252fc40 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1e9f134640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52336/0 (socket says 172.21.15.164:52336) 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 learned_addr learned my addr 172.21.15.164:0/4047998578 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.808+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611b25377e0 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1e9f134640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1e98053420 tx=0x7f1e98054530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1d80ff9640 1 -- 172.21.15.164:0/4047998578 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9804b040 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1d80ff9640 1 -- 172.21.15.164:0/4047998578 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e980167c0 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611b2537a70 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1d80ff9640 1 -- 172.21.15.164:0/4047998578 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e98011330 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.809+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b25383f0 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1d80ff9640 1 -- 172.21.15.164:0/4047998578 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1e98014ad0 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1d80ff9640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d6803ce10 0x7f1d6803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1d80ff9640 1 -- 172.21.15.164:0/4047998578 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1e9800e040 con 0x5611b252fc40 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1e9e933640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d6803ce10 0x7f1d6803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1e9e933640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d6803ce10 0x7f1d6803f2d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1e900507b0 tx=0x7f1e9008f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2542fd0 0x5611b2545490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.810+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2545be0 con 0x5611b2542fd0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1e96132640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2542fd0 0x5611b2545490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1e96132640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2542fd0 0x5611b2545490 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e880104c0 con 0x5611b2542fd0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 20 realm 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2542320 con 0x5611b2542fd0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e880104c0 con 0x5611b2542fd0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.811+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b25466d0 con 0x5611b2542fd0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e880104c0 con 0x5611b2542fd0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2546fa0 con 0x5611b2542fd0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1e880104c0 con 0x5611b2542fd0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b25479c0 0x5611b2549db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254a4f0 con 0x5611b25479c0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1e9f134640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b25479c0 0x5611b2549db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.812+0000 7f1e9f134640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b25479c0 0x5611b2549db0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1e9802a070 con 0x5611b25479c0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1ea2d25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1ea2d25800 20 searching for the correct realm 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1e9802a070 con 0x5611b25479c0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9f134640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1e98014070 0x7f1e9802c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9e933640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1e98014070 0x7f1e9802c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.813+0000 7f1e9e933640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1e98014070 0x7f1e9802c3e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e9e933640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1e900a4040 0x7f1e90050820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e96132640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1e900a4040 0x7f1e90050820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e96132640 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1e900a4040 0x7f1e90050820 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e880104c0 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.814+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e880104c0 con 0x5611b2542fd0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.815+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9802a070 con 0x5611b25479c0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.816+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e9802a070 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.817+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.818+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.819+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.820+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b25479c0 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e900a4040 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x5611b2542fd0 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5611b254bde0 con 0x7f1e98014070 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.821+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254aee0 con 0x5611b2542fd0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254b730 con 0x5611b2542fd0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254c260 con 0x5611b2542fd0 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 zone default found 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 4 Realm: () 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 zonegroup default 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.822+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254c600 con 0x7f1e900a4040 2024-09-14T10:55:46.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254e3e0 con 0x5611b25479c0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b254e920 con 0x5611b25479c0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 started sync module instance, tier type = 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.823+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254d880 con 0x7f1e98014070 2024-09-14T10:55:46.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.824+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.824+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634006338672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254d4e0 con 0x7f1e98014070 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.824+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254f850 con 0x5611b2542fd0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.825+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634006338672] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.825+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.825+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634006344608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254fc70 con 0x5611b2542fd0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.825+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2550630 con 0x5611b25479c0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.826+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.826+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634006348160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2550a90 con 0x5611b25479c0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.826+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2551590 con 0x7f1e98014070 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.827+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634006344608] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.827+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634006348160] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.828+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.828+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634006352000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25505a0 con 0x7f1e98014070 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.828+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2551fd0 con 0x5611b2542fd0 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.829+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.829+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634006354992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25526c0 con 0x5611b2542fd0 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.829+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25531e0 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.829+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634006352000] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.830+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.830+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634006359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25531a0 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.830+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2553bf0 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.830+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634006354992] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.831+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634006359216] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.831+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.831+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634006345664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2553740 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.831+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2554490 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634006345664] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634006356240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2553740 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=0 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=1 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=2 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=3 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=4 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=5 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.832+0000 7f1ea2d25800 20 add_watcher() i=6 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634006356240] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1ea2d25800 20 add_watcher() i=7 2024-09-14T10:55:46.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1ea2d25800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b2557490 con 0x5611b2542fd0 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.833+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634006363440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25549b0 con 0x5611b2542fd0 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634006363440] v37'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1d557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1ea2d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1ea2d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1ea2d25800 5 note: GC not initialized 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.834+0000 7f1ccffff640 20 reqs_thread_entry: start 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 20 Filter name: none 2024-09-14T10:55:46.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ccdffb640 20 reqs_thread_entry: start 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b258a7a0 con 0x5611b2542fd0 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 20 rados_obj.operate() r=0 bl.length=403 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.835+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b25908a0 con 0x5611b2542fd0 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v37'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1ea2d25800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1ea2d25800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1ea2d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94634006610544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5611b258c0c0 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify (1) cookie 94634006354992 notify 158913789969 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1e8803b7f0 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1d827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789969 cookie 94634006354992 notifier 4675 bl.length()=567 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1d827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1d827fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(64 notify.4 [notify cookie 94634006610544 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1d827fc640 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f1d64003ea0 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.837+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== watch-notify(notify_complete (2) cookie 94634006610544 notify 158913789969 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1e8803b9c0 con 0x5611b2542fd0 2024-09-14T10:55:46.850 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-14T10:55:23.409882Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:55:23.409869Z","tags":[],"group_ids":[]} 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.838+0000 7f1d557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.838+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634006363440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2588590 con 0x5611b2542fd0 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.839+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94634006363440] v37'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.839+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634006338672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2588590 con 0x7f1e98014070 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.840+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94634006338672] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.840+0000 7f1ea2d25800 20 remove_watcher() i=0 2024-09-14T10:55:46.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.840+0000 7f1ea2d25800 2 removed watcher, disabling cache 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.840+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634006344608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254dc70 con 0x5611b2542fd0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.841+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94634006344608] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.841+0000 7f1ea2d25800 20 remove_watcher() i=1 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.841+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634006348160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254dc70 con 0x5611b25479c0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.842+0000 7f1e9f134640 1 -- 172.21.15.164:0/4047998578 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94634006348160] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e98064040 con 0x5611b25479c0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.842+0000 7f1ea2d25800 20 remove_watcher() i=2 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.842+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634006352000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2550180 con 0x7f1e98014070 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.843+0000 7f1e9e933640 1 -- 172.21.15.164:0/4047998578 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94634006352000] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e90057030 con 0x7f1e98014070 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.843+0000 7f1ea2d25800 20 remove_watcher() i=3 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.843+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634006354992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254dc70 con 0x5611b2542fd0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.844+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94634006354992] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x5611b2542fd0 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.844+0000 7f1ea2d25800 20 remove_watcher() i=4 2024-09-14T10:55:46.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.844+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634006359216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2551080 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.845+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94634006359216] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.845+0000 7f1ea2d25800 20 remove_watcher() i=5 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.845+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634006345664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b2550180 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.846+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94634006345664] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.846+0000 7f1ea2d25800 20 remove_watcher() i=6 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.846+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634006356240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5611b254dc70 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94634006356240] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1e8802a040 con 0x7f1e900a4040 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 20 remove_watcher() i=7 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1e900a4040 msgr2=0x7f1e90050820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f1e900a4040 0x7f1e90050820 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2542fd0 msgr2=0x5611b2545490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2542fd0 0x5611b2545490 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1e98014070 msgr2=0x7f1e9802c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f1e98014070 0x7f1e9802c3e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b25479c0 msgr2=0x5611b2549db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.847+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b25479c0 0x5611b2549db0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d6803ce10 msgr2=0x7f1d6803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d6803ce10 0x7f1d6803f2d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1e900507b0 tx=0x7f1e9008f000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 msgr2=0x5611b2537280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1e96132640 1 -- 172.21.15.164:0/4047998578 reap_dead start 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1e98053420 tx=0x7f1e98054530 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 shutdown_connections 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/4047998578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b252fc40 0x5611b2537280 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 >> 172.21.15.164:0/4047998578 conn(0x5611b252c040 msgr2=0x5611b252a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 shutdown_connections 2024-09-14T10:55:46.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/4047998578 wait complete. 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 msgr2=0x7f1d7803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 0x7f1d7803f2d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5611b250a240 tx=0x7f1e90085320 comp rx=0 tx=0).stop 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 msgr2=0x5611b25235c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x5611b2509110 tx=0x7f1e98018830 comp rx=0 tx=0).stop 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 shutdown_connections 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d7803ce10 0x7f1d7803f2d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/2179539180 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b25231a0 0x5611b25235c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 >> 172.21.15.164:0/2179539180 conn(0x5611b2517550 msgr2=0x5611b2517930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 shutdown_connections 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/2179539180 wait complete. 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 msgr2=0x5611b250f760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 0x5611b250f760 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 msgr2=0x5611b2514000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.848+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 0x5611b2514000 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 msgr2=0x7f1d8403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 0x7f1d8403f2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e88000f60 tx=0x7f1e880013f0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 msgr2=0x5611b2508110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e90025da0 tx=0x7f1e90003020 comp rx=0 tx=0).stop 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 shutdown_connections 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5611b2511b80 0x5611b2514000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5611b2384730 0x5611b250f760 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f1d8403ce10 0x7f1d8403f2d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 --2- 172.21.15.164:0/809601560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5611b2383460 0x5611b2508110 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 >> 172.21.15.164:0/809601560 conn(0x5611b240a1a0 msgr2=0x5611b24fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 shutdown_connections 2024-09-14T10:55:46.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.849+0000 7f1ea2d25800 1 -- 172.21.15.164:0/809601560 wait complete. 2024-09-14T10:55:46.862 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-14T10:55:23.409882Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:55:23.409869Z', 'tags': [], 'group_ids': []} 2024-09-14T10:55:46.874 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:46.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:46.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-14T10:55:46.874 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-14T10:55:46.919 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:46.919 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:46.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.922+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.922+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.922+0000 7f2cc5d26800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55953049d710 0x55953052c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.922+0000 7f2cc5d26800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595305306f0 con 0x55953052ca40 2024-09-14T10:55:46.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.922+0000 7f2cc5d26800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5595303b47d0 con 0x55953049d710 2024-09-14T10:55:46.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cc1ad6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55953049d710 0x55953052c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cc1ad6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55953049d710 0x55953052c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52342/0 (socket says 172.21.15.164:52342) 2024-09-14T10:55:46.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1204800037 learned_addr learned my addr 172.21.15.164:0/1204800037 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cb92d5640 1 --1- 172.21.15.164:0/1204800037 >> v1:172.21.15.116:6789/0 conn(0x55953052ca40 0x55953052ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:41628/0 (socket says 172.21.15.164:41628) 2024-09-14T10:55:46.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1204800037 >> v1:172.21.15.116:6789/0 conn(0x55953052ca40 legacy=0x55953052ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.923+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1204800037 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559530531920 con 0x55953049d710 2024-09-14T10:55:46.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/1204800037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x55953052c500 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005fd0 tx=0x7f2cb4045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ca51dacc623266 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc12d5640 1 -- 172.21.15.164:0/1204800037 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb404e600 con 0x55953049d710 2024-09-14T10:55:46.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc12d5640 1 -- 172.21.15.164:0/1204800037 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb404e7a0 con 0x55953049d710 2024-09-14T10:55:46.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc12d5640 1 -- 172.21.15.164:0/1204800037 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb404eaa0 con 0x55953049d710 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1204800037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 msgr2=0x55953052c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.925+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1204800037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x55953052c500 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005fd0 tx=0x7f2cb4045cf0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.926+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1204800037 shutdown_connections 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.926+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1204800037 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x55953052c500 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.926+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1204800037 >> 172.21.15.164:0/1204800037 conn(0x559530523fb0 msgr2=0x5595305263f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.926+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1204800037 shutdown_connections 2024-09-14T10:55:46.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.926+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1204800037 wait complete. 2024-09-14T10:55:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.939+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.939+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.939+0000 7f2cc5d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.939+0000 7f2cc5d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5595303c1dd0 con 0x55953049d710 2024-09-14T10:55:46.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2cc1ad6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2cc1ad6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52344/0 (socket says 172.21.15.164:52344) 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1201513757 learned_addr learned my addr 172.21.15.164:0/1201513757 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1201513757 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559530619db0 con 0x55953049d710 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/1201513757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005fd0 tx=0x7f2cb4050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4610d4b2e0a8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2bafe07640 1 -- 172.21.15.164:0/1201513757 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb404eb40 con 0x55953049d710 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2bafe07640 1 -- 172.21.15.164:0/1201513757 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb4066070 con 0x55953049d710 2024-09-14T10:55:46.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.940+0000 7f2bafe07640 1 -- 172.21.15.164:0/1201513757 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb404ee50 con 0x55953049d710 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1201513757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 msgr2=0x5595306197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1201513757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005fd0 tx=0x7f2cb4050000 comp rx=0 tx=0).stop 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1201513757 shutdown_connections 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1201513757 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306197c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1201513757 >> 172.21.15.164:0/1201513757 conn(0x559530523fb0 msgr2=0x559530615140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1201513757 shutdown_connections 2024-09-14T10:55:46.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1201513757 wait complete. 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.941+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc5d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc5d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559530530bc0 con 0x55953049d710 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc1ad6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc1ad6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52346/0 (socket says 172.21.15.164:52346) 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1555088558 learned_addr learned my addr 172.21.15.164:0/1555088558 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559530621710 con 0x55953049d710 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4063040 tx=0x7f2cb4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2bae604640 1 -- 172.21.15.164:0/1555088558 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb406d420 con 0x55953049d710 2024-09-14T10:55:46.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2bae604640 1 -- 172.21.15.164:0/1555088558 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb4071030 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2bae604640 1 -- 172.21.15.164:0/1555088558 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb406d6f0 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.942+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595306219a0 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.943+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595306223a0 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.943+0000 7f2bae604640 1 -- 172.21.15.164:0/1555088558 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2cb406d960 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2bae604640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 0x7f2ba803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2bae604640 1 -- 172.21.15.164:0/1555088558 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2cb4098e00 con 0x55953049d710 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 0x7f2ba803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 0x559530628800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530622f90 con 0x55953052ca40 2024-09-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 0x559530628800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 0x7f2ba803f2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55953049dcd0 tx=0x7f2cac001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 0x559530628800 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.944+0000 7f2cc22d7640 1 -- 172.21.15.164:0/1555088558 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x55953052ca40 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530629280 con 0x55953052ca40 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc22d7640 1 -- 172.21.15.164:0/1555088558 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cbc0083e0 con 0x55953052ca40 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 0x55953062d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55953062d7c0 con 0x55953062ab90 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 0x55953062d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 0x55953062d030 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.945+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/1555088558 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2cb407d070 con 0x55953062ab90 2024-09-14T10:55:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530629ad0 con 0x55953052ca40 2024-09-14T10:55:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc22d7640 1 -- 172.21.15.164:0/1555088558 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cbc0083e0 con 0x55953052ca40 2024-09-14T10:55:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530629eb0 con 0x55953052ca40 2024-09-14T10:55:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc22d7640 1 -- 172.21.15.164:0/1555088558 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2cbc0083e0 con 0x55953052ca40 2024-09-14T10:55:46.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.946+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc5d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc5d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5595304204a0 con 0x55953063c200 2024-09-14T10:55:46.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52350/0 (socket says 172.21.15.164:52350) 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc22d7640 1 -- 172.21.15.164:0/806954969 learned_addr learned my addr 172.21.15.164:0/806954969 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc22d7640 1 -- 172.21.15.164:0/806954969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55953063cc60 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5595306227a0 tx=0x7f2cbc00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2ba77fe640 1 -- 172.21.15.164:0/806954969 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc007d60 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2ba77fe640 1 -- 172.21.15.164:0/806954969 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc01e020 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55953063d490 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.947+0000 7f2ba77fe640 1 -- 172.21.15.164:0/806954969 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc019590 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.948+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55953063da30 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.948+0000 7f2ba77fe640 1 -- 172.21.15.164:0/806954969 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2cbc016040 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.948+0000 7f2ba77fe640 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 0x7f2b9c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.948+0000 7f2ba77fe640 1 -- 172.21.15.164:0/806954969 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2cbc01f030 con 0x55953063c200 2024-09-14T10:55:46.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 0x7f2b9c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 0x7f2b9c03f2d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559530622980 tx=0x7f2cb406b800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc5d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc5d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55953061a120 con 0x5595305284f0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52362/0 (socket says 172.21.15.164:52362) 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc22d7640 1 -- 172.21.15.164:0/30168329 learned_addr learned my addr 172.21.15.164:0/30168329 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.949+0000 7f2cc22d7640 1 -- 172.21.15.164:0/30168329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559530528ec0 con 0x5595305284f0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/30168329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc054440 tx=0x7f2cbc045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596ea7b979d1ca74 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2ba57fa640 1 -- 172.21.15.164:0/30168329 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc01d040 con 0x5595305284f0 2024-09-14T10:55:46.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2ba57fa640 1 -- 172.21.15.164:0/30168329 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc051070 con 0x5595305284f0 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2ba57fa640 1 -- 172.21.15.164:0/30168329 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc0184e0 con 0x5595305284f0 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 -- 172.21.15.164:0/30168329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 msgr2=0x5595305288d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/30168329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc054440 tx=0x7f2cbc045490 comp rx=0 tx=0).stop 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 -- 172.21.15.164:0/30168329 shutdown_connections 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/30168329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x5595305288d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 -- 172.21.15.164:0/30168329 >> 172.21.15.164:0/30168329 conn(0x559530645060 msgr2=0x5595306432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 -- 172.21.15.164:0/30168329 shutdown_connections 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 -- 172.21.15.164:0/30168329 wait complete. 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.950+0000 7f2cc5d26800 1 Processor -- start 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc5d26800 1 -- start start 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc5d26800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc5d26800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559530529550 con 0x5595305284f0 2024-09-14T10:55:46.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc22d7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52374/0 (socket says 172.21.15.164:52374) 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 learned_addr learned my addr 172.21.15.164:0/2947845112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559530652990 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc008fd0 tx=0x7f2cbc0543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2b937fe640 1 -- 172.21.15.164:0/2947845112 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc01d030 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2b937fe640 1 -- 172.21.15.164:0/2947845112 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc014dd0 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2b937fe640 1 -- 172.21.15.164:0/2947845112 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc016460 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559530652c20 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.951+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595306535a0 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.952+0000 7f2b937fe640 1 -- 172.21.15.164:0/2947845112 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2cbc016600 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.952+0000 7f2b937fe640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b8c03ce10 0x7f2b8c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.952+0000 7f2b937fe640 1 -- 172.21.15.164:0/2947845112 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2cbc033030 con 0x5595305284f0 2024-09-14T10:55:46.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.952+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b8c03ce10 0x7f2b8c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b8c03ce10 0x7f2b8c03f2d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4007000 tx=0x7f2cb4094000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953065dfd0 0x559530660490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530660be0 con 0x55953065dfd0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953065dfd0 0x559530660490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.953+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953065dfd0 0x559530660490 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cac00bdb0 con 0x55953065dfd0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 realm 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55953065d320 con 0x55953065dfd0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cac00bdb0 con 0x55953065dfd0 2024-09-14T10:55:46.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595306616d0 con 0x55953065dfd0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cac00bdb0 con 0x55953065dfd0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.954+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530661fa0 con 0x55953065dfd0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cac00bdb0 con 0x55953065dfd0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5595306629c0 0x559530664db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5595306629c0 0x559530664db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5595306629c0 0x559530664db0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 20 searching for the correct realm 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530666d90 con 0x5595306629c0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.955+0000 7f2cc22d7640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2cbc019040 0x7f2cbc023a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2cbc019040 0x7f2cbc023a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2cbc019040 0x7f2cbc023a30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc1ad6640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2cb406d040 0x7f2cb406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:55:46.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.956+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2cb406d040 0x7f2cb406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2cb406d040 0x7f2cb406a890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac00bdb0 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac00bdb0 con 0x55953065dfd0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.957+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.958+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.959+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.960+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.961+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x55953065dfd0 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.962+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x5595306629c0 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.963+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cb406d040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac02b040 con 0x7f2cb406d040 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x55953065dfd0 2024-09-14T10:55:46.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559530665480 con 0x7f2cbc019040 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530665d40 con 0x55953065dfd0 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.964+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530666130 con 0x55953065dfd0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530666550 con 0x55953065dfd0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 zone default found 2024-09-14T10:55:46.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 4 Realm: () 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 zonegroup default 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530667210 con 0x7f2cb406d040 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.965+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530668ff0 con 0x5595306629c0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530669500 con 0x5595306629c0 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 20 started sync module instance, tier type = 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.966+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559530668490 con 0x7f2cbc019040 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.967+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.967+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94099250511840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559530669960 con 0x7f2cbc019040 2024-09-14T10:55:46.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.967+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066a1b0 con 0x55953065dfd0 2024-09-14T10:55:46.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.968+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94099250511840] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.968+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.968+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94099250514096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066a2f0 con 0x55953065dfd0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.968+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066ae10 con 0x5595306629c0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.969+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94099250514096] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.969+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.969+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94099250522336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066add0 con 0x5595306629c0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.969+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066b880 con 0x7f2cbc019040 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.970+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94099250522336] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.970+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.970+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94099250525136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066bca0 con 0x7f2cbc019040 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.970+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066c6c0 con 0x55953065dfd0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.971+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.971+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94099250528688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066cf90 con 0x55953065dfd0 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.971+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066da60 con 0x7f2cb406d040 2024-09-14T10:55:46.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.971+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94099250525136] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.972+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.972+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94099250533712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066da20 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.972+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94099250528688] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.972+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066e470 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.973+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94099250533712] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.973+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.973+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94099250531168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066dfc0 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.974+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066e980 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.974+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94099250531168] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94099250519360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066e980 con 0x7f2cb406d040 2024-09-14T10:55:46.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=0 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=1 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=2 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=3 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=4 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=5 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=6 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94099250519360] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 20 add_watcher() i=7 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.975+0000 7f2cc5d26800 2 all 8 watchers are set, enabling cache 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.976+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559530671cc0 con 0x55953065dfd0 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.976+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.976+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94099250538048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953066ef10 con 0x55953065dfd0 2024-09-14T10:55:46.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.977+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94099250538048] v37'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.977+0000 7f2b737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.977+0000 7f2cc5d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.977+0000 7f2cc5d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.977+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067a690 con 0x55953065dfd0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.978+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.978+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067a690 con 0x7f2cb406d040 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.979+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.979+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b100 con 0x5595306629c0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.980+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.980+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b0b0 con 0x55953065dfd0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.981+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.981+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b0b0 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.982+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'66 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.982+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b520 con 0x5595306629c0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.983+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.983+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x55953065dfd0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.984+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.984+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067a690 con 0x7f2cb406d040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.985+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.985+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.986+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.986+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x5595306629c0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.987+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.987+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.988+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'67 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.988+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x7f2cb406d040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.989+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.989+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067b9d0 con 0x7f2cbc019040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.990+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.990+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067ba60 con 0x7f2cb406d040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.991+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:46.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.991+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067ba60 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.992+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.992+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067ba60 con 0x5595306629c0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.993+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'59 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.993+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb50 con 0x7f2cbc019040 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.994+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'68 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.994+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb50 con 0x5595306629c0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.995+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.995+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067baf0 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.996+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.996+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067baf0 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.997+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.997+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb20 con 0x5595306629c0 2024-09-14T10:55:46.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.998+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'60 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.998+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb20 con 0x7f2cbc019040 2024-09-14T10:55:46.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.999+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:46.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:46.999+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb60 con 0x5595306629c0 2024-09-14T10:55:46.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.000+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.000+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bb60 con 0x5595306629c0 2024-09-14T10:55:46.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.001+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:46.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.001+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bba0 con 0x5595306629c0 2024-09-14T10:55:47.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.002+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:47.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.002+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bba0 con 0x5595306629c0 2024-09-14T10:55:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.003+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.003+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbc0 con 0x7f2cb406d040 2024-09-14T10:55:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.004+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.004+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbe0 con 0x5595306629c0 2024-09-14T10:55:47.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.005+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:47.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.005+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbe0 con 0x7f2cb406d040 2024-09-14T10:55:47.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.006+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.006+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbe0 con 0x5595306629c0 2024-09-14T10:55:47.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.007+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'61 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:47.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.007+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbe0 con 0x7f2cb406d040 2024-09-14T10:55:47.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.008+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.008+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55953067bbe0 con 0x7f2cbc019040 2024-09-14T10:55:47.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.009+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:47.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.009+0000 7f2b727fc640 20 reqs_thread_entry: start 2024-09-14T10:55:47.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 20 init_complete bucket index max shards: 11 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 20 Filter name: none 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2ae3fff640 20 reqs_thread_entry: start 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 20 rados->read ofs=0 len=0 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ae0 con 0x55953065dfd0 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.010+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cbc019040 2024-09-14T10:55:47.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.011+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:47.010 INFO:teuthology.orchestra.run.smithi164.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-14T10:55:47.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.012+0000 7f2b737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:55:47.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.012+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94099250538048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x55953065dfd0 2024-09-14T10:55:47.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94099250538048] v37'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:47.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94099250511840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cbc019040 2024-09-14T10:55:47.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94099250511840] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:47.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cc5d26800 20 remove_watcher() i=0 2024-09-14T10:55:47.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cc5d26800 2 removed watcher, disabling cache 2024-09-14T10:55:47.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.013+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94099250514096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x55953065dfd0 2024-09-14T10:55:47.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.015+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94099250514096] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:47.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.015+0000 7f2cc5d26800 20 remove_watcher() i=1 2024-09-14T10:55:47.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.015+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94099250522336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x5595306629c0 2024-09-14T10:55:47.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.016+0000 7f2cc22d7640 1 -- 172.21.15.164:0/2947845112 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94099250522336] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cbc0083e0 con 0x5595306629c0 2024-09-14T10:55:47.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.016+0000 7f2cc5d26800 20 remove_watcher() i=2 2024-09-14T10:55:47.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.016+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94099250525136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cbc019040 2024-09-14T10:55:47.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.017+0000 7f2cc1ad6640 1 -- 172.21.15.164:0/2947845112 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94099250525136] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb407d070 con 0x7f2cbc019040 2024-09-14T10:55:47.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.017+0000 7f2cc5d26800 20 remove_watcher() i=3 2024-09-14T10:55:47.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.017+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94099250528688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x55953065dfd0 2024-09-14T10:55:47.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.018+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94099250528688] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x55953065dfd0 2024-09-14T10:55:47.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.018+0000 7f2cc5d26800 20 remove_watcher() i=4 2024-09-14T10:55:47.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.018+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94099250533712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cb406d040 2024-09-14T10:55:47.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.019+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94099250533712] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.019+0000 7f2cc5d26800 20 remove_watcher() i=5 2024-09-14T10:55:47.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.019+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94099250531168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cb406d040 2024-09-14T10:55:47.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.020+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94099250531168] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.020+0000 7f2cc5d26800 20 remove_watcher() i=6 2024-09-14T10:55:47.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.020+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94099250519360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595306a6ad0 con 0x7f2cb406d040 2024-09-14T10:55:47.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94099250519360] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac03b040 con 0x7f2cb406d040 2024-09-14T10:55:47.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 20 remove_watcher() i=7 2024-09-14T10:55:47.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2cb406d040 msgr2=0x7f2cb406a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2cb406d040 0x7f2cb406a890 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953065dfd0 msgr2=0x559530660490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953065dfd0 0x559530660490 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2cbc019040 msgr2=0x7f2cbc023a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2cbc019040 0x7f2cbc023a30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5595306629c0 msgr2=0x559530664db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5595306629c0 0x559530664db0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b8c03ce10 msgr2=0x7f2b8c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b8c03ce10 0x7f2b8c03f2d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4007000 tx=0x7f2cb4094000 comp rx=0 tx=0).stop 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cb92d5640 1 -- 172.21.15.164:0/2947845112 reap_dead start 2024-09-14T10:55:47.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 msgr2=0x559530652430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc008fd0 tx=0x7f2cbc0543d0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 shutdown_connections 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/2947845112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5595305284f0 0x559530652430 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 >> 172.21.15.164:0/2947845112 conn(0x559530645060 msgr2=0x559530643270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 shutdown_connections 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/2947845112 wait complete. 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 msgr2=0x7f2b9c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 0x7f2b9c03f2d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559530622980 tx=0x7f2cb406b800 comp rx=0 tx=0).stop 2024-09-14T10:55:47.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 msgr2=0x55953063c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x5595306227a0 tx=0x7f2cbc00af20 comp rx=0 tx=0).stop 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 shutdown_connections 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2b9c03ce10 0x7f2b9c03f2d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/806954969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953063c200 0x55953063c620 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 >> 172.21.15.164:0/806954969 conn(0x5595306305b0 msgr2=0x559530630990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 shutdown_connections 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.021+0000 7f2cc5d26800 1 -- 172.21.15.164:0/806954969 wait complete. 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 msgr2=0x559530628800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 0x559530628800 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 msgr2=0x55953062d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 0x55953062d030 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 msgr2=0x7f2ba803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 0x7f2ba803f2d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55953049dcd0 tx=0x7f2cac001390 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 msgr2=0x5595306211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4063040 tx=0x7f2cb4003330 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 shutdown_connections 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55953062ab90 0x55953062d030 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55953052ca40 0x559530628800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ba803ce10 0x7f2ba803f2d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 --2- 172.21.15.164:0/1555088558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55953049d710 0x5595306211b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 >> 172.21.15.164:0/1555088558 conn(0x559530523fb0 msgr2=0x55953061abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:55:47.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 shutdown_connections 2024-09-14T10:55:47.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:55:47.022+0000 7f2cc5d26800 1 -- 172.21.15.164:0/1555088558 wait complete. 2024-09-14T10:55:47.028 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:55:47.044 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:55:47.048 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-14T10:56:22.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-14T10:56:22.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-14T10:56:22.050 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-14T10:56:22.103 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.104 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.106+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.106+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb497d39800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e337b347a0 0x55e337b34ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb497d39800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e337b36480 con 0x55e337b358c0 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb497d39800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e3379c07d0 con 0x55e337b347a0 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb493a81640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e337b347a0 0x55e337b34ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb493280640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55e337b358c0 0x55e337b35d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45384/0 (socket says 172.21.15.164:45384) 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb493280640 1 -- 172.21.15.164:0/2141014750 learned_addr learned my addr 172.21.15.164:0/2141014750 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb493a81640 1 -- 172.21.15.164:0/2141014750 >> v1:172.21.15.116:6789/0 conn(0x55e337b358c0 legacy=0x55e337b35d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.107+0000 7fb493a81640 1 -- 172.21.15.164:0/2141014750 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337b36650 con 0x55e337b347a0 2024-09-14T10:56:22.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.109+0000 7fb493a81640 1 --2- 172.21.15.164:0/2141014750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337b34ba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb484005fd0 tx=0x7fb484045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810756a88d79961a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.109+0000 7fb492a7f640 1 -- 172.21.15.164:0/2141014750 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb484058530 con 0x55e337b347a0 2024-09-14T10:56:22.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.109+0000 7fb492a7f640 1 -- 172.21.15.164:0/2141014750 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4840586d0 con 0x55e337b347a0 2024-09-14T10:56:22.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.109+0000 7fb492a7f640 1 -- 172.21.15.164:0/2141014750 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4840589d0 con 0x55e337b347a0 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 -- 172.21.15.164:0/2141014750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 msgr2=0x55e337b34ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 --2- 172.21.15.164:0/2141014750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337b34ba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb484005fd0 tx=0x7fb484045c30 comp rx=0 tx=0).stop 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 -- 172.21.15.164:0/2141014750 shutdown_connections 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 --2- 172.21.15.164:0/2141014750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337b34ba0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 -- 172.21.15.164:0/2141014750 >> 172.21.15.164:0/2141014750 conn(0x55e337b2ffb0 msgr2=0x55e337b323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 -- 172.21.15.164:0/2141014750 shutdown_connections 2024-09-14T10:56:22.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.110+0000 7fb497d39800 1 -- 172.21.15.164:0/2141014750 wait complete. 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb497d39800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb497d39800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e3379cddd0 con 0x55e337b347a0 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb493a81640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb493a81640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52568/0 (socket says 172.21.15.164:52568) 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.126+0000 7fb493a81640 1 -- 172.21.15.164:0/949220630 learned_addr learned my addr 172.21.15.164:0/949220630 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.127+0000 7fb493a81640 1 -- 172.21.15.164:0/949220630 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337c24d00 con 0x55e337b347a0 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.127+0000 7fb493a81640 1 --2- 172.21.15.164:0/949220630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb484025a60 tx=0x7fb484051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d2b235d81a2e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.127+0000 7fb381e0b640 1 -- 172.21.15.164:0/949220630 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4840589b0 con 0x55e337b347a0 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.127+0000 7fb381e0b640 1 -- 172.21.15.164:0/949220630 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb484068070 con 0x55e337b347a0 2024-09-14T10:56:22.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.127+0000 7fb381e0b640 1 -- 172.21.15.164:0/949220630 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb484058c80 con 0x55e337b347a0 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- 172.21.15.164:0/949220630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 msgr2=0x55e337c24710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 --2- 172.21.15.164:0/949220630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb484025a60 tx=0x7fb484051000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- 172.21.15.164:0/949220630 shutdown_connections 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 --2- 172.21.15.164:0/949220630 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c24710 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- 172.21.15.164:0/949220630 >> 172.21.15.164:0/949220630 conn(0x55e337b2ffb0 msgr2=0x55e337c20090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- 172.21.15.164:0/949220630 shutdown_connections 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- 172.21.15.164:0/949220630 wait complete. 2024-09-14T10:56:22.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.128+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb497d39800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb497d39800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e337b3bdb0 con 0x55e337b347a0 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb493a81640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb493a81640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52576/0 (socket says 172.21.15.164:52576) 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb493a81640 1 -- 172.21.15.164:0/2750921219 learned_addr learned my addr 172.21.15.164:0/2750921219 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb493a81640 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337c2d6e0 con 0x55e337b347a0 2024-09-14T10:56:22.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb493a81640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb484025a60 tx=0x7fb484003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb37bfff640 1 -- 172.21.15.164:0/2750921219 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4840635f0 con 0x55e337b347a0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb37bfff640 1 -- 172.21.15.164:0/2750921219 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb484063790 con 0x55e337b347a0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e337c2d970 con 0x55e337b347a0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.129+0000 7fb37bfff640 1 -- 172.21.15.164:0/2750921219 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb484063a90 con 0x55e337b347a0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.130+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e337c2e370 con 0x55e337b347a0 2024-09-14T10:56:22.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.130+0000 7fb37bfff640 1 -- 172.21.15.164:0/2750921219 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb484075020 con 0x55e337b347a0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb37bfff640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 0x7fb37c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb37bfff640 1 -- 172.21.15.164:0/2750921219 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb4840988c0 con 0x55e337b347a0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb493280640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 0x7fb37c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 0x55e337c347d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c2ef50 con 0x55e337b358c0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb494282640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 0x55e337c347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb493280640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 0x7fb37c03f2d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb488001d70 tx=0x7fb4880012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.131+0000 7fb494282640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 0x55e337c347d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb494282640 1 -- 172.21.15.164:0/2750921219 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb48c0083e0 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c2e820 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb494282640 1 -- 172.21.15.164:0/2750921219 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb48c0083e0 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 0x55e337c39090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c39760 con 0x55e337c36ca0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb493a81640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 0x55e337c39090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.132+0000 7fb493a81640 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 0x55e337c39090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.133+0000 7fb493a81640 1 -- 172.21.15.164:0/2750921219 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb48406dd00 con 0x55e337c36ca0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.133+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c35b40 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.133+0000 7fb494282640 1 -- 172.21.15.164:0/2750921219 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb48c0083e0 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.133+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c36020 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.133+0000 7fb494282640 1 -- 172.21.15.164:0/2750921219 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb48c0083e0 con 0x55e337b358c0 2024-09-14T10:56:22.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb497d39800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb497d39800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e337a2c4a0 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52590/0 (socket says 172.21.15.164:52590) 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.134+0000 7fb494282640 1 -- 172.21.15.164:0/3707440053 learned_addr learned my addr 172.21.15.164:0/3707440053 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb494282640 1 -- 172.21.15.164:0/3707440053 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337c48ba0 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb494282640 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x55e337c2e180 tx=0x7fb48c00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb3797fa640 1 -- 172.21.15.164:0/3707440053 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c007dc0 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb3797fa640 1 -- 172.21.15.164:0/3707440053 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c01e020 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e337c493d0 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb3797fa640 1 -- 172.21.15.164:0/3707440053 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c019570 con 0x55e337c48140 2024-09-14T10:56:22.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.135+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e337c49970 con 0x55e337c48140 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.136+0000 7fb3797fa640 1 -- 172.21.15.164:0/3707440053 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb48c016040 con 0x55e337c48140 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.136+0000 7fb3797fa640 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 0x7fb36c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.136+0000 7fb3797fa640 1 -- 172.21.15.164:0/3707440053 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb48c01f030 con 0x55e337c48140 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.136+0000 7fb493a81640 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 0x7fb36c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb493a81640 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 0x7fb36c03f320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e337c34e10 tx=0x7fb484063cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb497d39800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb497d39800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e337c25070 con 0x55e337c28aa0 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52592/0 (socket says 172.21.15.164:52592) 2024-09-14T10:56:22.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb494282640 1 -- 172.21.15.164:0/2646138236 learned_addr learned my addr 172.21.15.164:0/2646138236 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.137+0000 7fb494282640 1 -- 172.21.15.164:0/2646138236 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337c29470 con 0x55e337c28aa0 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.138+0000 7fb494282640 1 --2- 172.21.15.164:0/2646138236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0174f0 tx=0x7fb48c019ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1ff992ddf7bf5d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.138+0000 7fb372ffd640 1 -- 172.21.15.164:0/2646138236 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c04b070 con 0x55e337c28aa0 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.138+0000 7fb372ffd640 1 -- 172.21.15.164:0/2646138236 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c015d50 con 0x55e337c28aa0 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.138+0000 7fb372ffd640 1 -- 172.21.15.164:0/2646138236 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c01d040 con 0x55e337c28aa0 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- 172.21.15.164:0/2646138236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 msgr2=0x55e337c28e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 --2- 172.21.15.164:0/2646138236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0174f0 tx=0x7fb48c019ae0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- 172.21.15.164:0/2646138236 shutdown_connections 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 --2- 172.21.15.164:0/2646138236 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c28e80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- 172.21.15.164:0/2646138236 >> 172.21.15.164:0/2646138236 conn(0x55e337c50f60 msgr2=0x55e337c4f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- 172.21.15.164:0/2646138236 shutdown_connections 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- 172.21.15.164:0/2646138236 wait complete. 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 Processor -- start 2024-09-14T10:56:22.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- start start 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb497d39800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e337c29b00 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb494282640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52598/0 (socket says 172.21.15.164:52598) 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.139+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 learned_addr learned my addr 172.21.15.164:0/110159562 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e337c5e980 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb494282640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb48c017b70 tx=0x7fb48c054720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb3717fa640 1 -- 172.21.15.164:0/110159562 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c04b070 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb3717fa640 1 -- 172.21.15.164:0/110159562 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0153e0 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e337c5ec10 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb3717fa640 1 -- 172.21.15.164:0/110159562 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb48c01d030 con 0x55e337c28aa0 2024-09-14T10:56:22.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.140+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e337c5f590 con 0x55e337c28aa0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.141+0000 7fb3717fa640 1 -- 172.21.15.164:0/110159562 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb48c056070 con 0x55e337c28aa0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.141+0000 7fb3717fa640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb35c03ce10 0x7fb35c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.141+0000 7fb3717fa640 1 -- 172.21.15.164:0/110159562 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb48c041cf0 con 0x55e337c28aa0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.141+0000 7fb493a81640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb35c03ce10 0x7fb35c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337c69ee0 0x55e337c6c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c6caf0 con 0x55e337c69ee0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb493280640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337c69ee0 0x55e337c6c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb493a81640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb35c03ce10 0x7fb35c03f2d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb484059fd0 tx=0x7fb484088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb493280640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337c69ee0 0x55e337c6c3a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb488009050 con 0x55e337c69ee0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 20 realm 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.142+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c69230 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb488009050 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c6d5d0 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb488009050 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c6dea0 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb488009050 con 0x55e337c69ee0 2024-09-14T10:56:22.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c6e7e0 0x55e337c70bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c71310 con 0x55e337c6e7e0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.143+0000 7fb494282640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c6e7e0 0x55e337c70bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb494282640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c6e7e0 0x55e337c70bd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb48c03e070 con 0x55e337c6e7e0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb497d39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb497d39800 20 searching for the correct realm 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb48c03e070 con 0x55e337c6e7e0 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb494282640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb48c037020 0x7fb48c02d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.144+0000 7fb493a81640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb48c037020 0x7fb48c02d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.145+0000 7fb493a81640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb48c037020 0x7fb48c02d900 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.145+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.145+0000 7fb493a81640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb484098c20 0x7fb4840980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.145+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.145+0000 7fb493280640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb484098c20 0x7fb4840980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb484098c20 0x7fb4840980b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488009050 con 0x7fb484098c20 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488009050 con 0x55e337c69ee0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.146+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.147+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.148+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.149+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.150+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.151+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.152+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c6e7e0 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb484098c20 2024-09-14T10:56:22.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb488029040 con 0x7fb484098c20 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.153+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x55e337c69ee0 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72ca0 con 0x7fb48c037020 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c71d90 con 0x55e337c69ee0 2024-09-14T10:56:22.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c719d0 con 0x55e337c69ee0 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.154+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb488029040 con 0x55e337c69ee0 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c726b0 con 0x55e337c69ee0 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 zone default found 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 4 Realm: () 2024-09-14T10:56:22.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 zonegroup default 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c72210 con 0x7fb484098c20 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c75070 con 0x55e337c6e7e0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.155+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c755b0 con 0x55e337c6e7e0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.156+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.156+0000 7fb497d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.156+0000 7fb497d39800 20 started sync module instance, tier type = 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.156+0000 7fb497d39800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.156+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c744e0 con 0x7fb48c037020 2024-09-14T10:56:22.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.157+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.157+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434381744336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c75ec0 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.157+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c76710 con 0x55e337c69ee0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.158+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434381744336] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.158+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.158+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434381748752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c767f0 con 0x55e337c69ee0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.158+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c77310 con 0x55e337c6e7e0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.159+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434381748752] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.160+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.160+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434381753824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c772d0 con 0x55e337c6e7e0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.160+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c77d90 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.161+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.161+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434381756576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c78630 con 0x7fb48c037020 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.161+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c79110 con 0x55e337c69ee0 2024-09-14T10:56:22.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.161+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434381753824] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.162+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434381756576] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.162+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.162+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434381758848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c76260 con 0x55e337c69ee0 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.162+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c799f0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.163+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.163+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434381763760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c79e40 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.163+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7a940 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.163+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434381758848] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.164+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434381763760] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.164+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.164+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434381767728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c798d0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.164+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7af20 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.165+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434381767728] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.165+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.165+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434381761568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7af20 con 0x7fb484098c20 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=0 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=1 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=2 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=3 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=4 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=5 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb497d39800 20 add_watcher() i=6 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.166+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434381761568] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.167+0000 7fb497d39800 20 add_watcher() i=7 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.167+0000 7fb497d39800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.167+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7e1b0 con 0x55e337c69ee0 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.167+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.167+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434381769696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7b4b0 con 0x55e337c69ee0 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434381769696] v37'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb497d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb497d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb497d39800 5 note: GC not initialized 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb348fe1640 20 reqs_thread_entry: start 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.168+0000 7fb497d39800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb497d39800 20 Filter name: none 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb2c27fc640 20 reqs_thread_entry: start 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a80 con 0x55e337c69ee0 2024-09-14T10:56:22.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a80 con 0x7fb48c037020 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.169+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.170+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c69ee0 2024-09-14T10:56:22.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c6e7e0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x55e337c6e7e0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.171+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1a40 con 0x7fb484098c20 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb48c037020 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.172+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.173+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.174+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb48c037020 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.175+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c69ee0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.176+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.177+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.177+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x55e337c6e7e0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.177+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.177+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e337cb1470 con 0x7fb484098c20 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.177+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.178+0000 7fb349fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.178+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434381769696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337c7c980 con 0x55e337c69ee0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.179+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94434381769696] v37'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.179+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434381744336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x7fb48c037020 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.180+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94434381744336] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.180+0000 7fb497d39800 20 remove_watcher() i=0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.180+0000 7fb497d39800 2 removed watcher, disabling cache 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.180+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434381748752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x55e337c69ee0 2024-09-14T10:56:22.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.182+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94434381748752] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.182+0000 7fb497d39800 20 remove_watcher() i=1 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.182+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434381753824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x55e337c6e7e0 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.183+0000 7fb494282640 1 -- 172.21.15.164:0/110159562 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94434381753824] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48c05f040 con 0x55e337c6e7e0 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.183+0000 7fb497d39800 20 remove_watcher() i=2 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.183+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434381756576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x7fb48c037020 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.184+0000 7fb493a81640 1 -- 172.21.15.164:0/110159562 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94434381756576] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48406dd00 con 0x7fb48c037020 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.184+0000 7fb497d39800 20 remove_watcher() i=3 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.184+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434381758848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x55e337c69ee0 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.185+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94434381758848] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x55e337c69ee0 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.185+0000 7fb497d39800 20 remove_watcher() i=4 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.185+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434381763760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x7fb484098c20 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.186+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94434381763760] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.186+0000 7fb497d39800 20 remove_watcher() i=5 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.186+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434381767728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x7fb484098c20 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.187+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94434381767728] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.187+0000 7fb497d39800 20 remove_watcher() i=6 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.187+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434381761568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e337caee70 con 0x7fb484098c20 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94434381761568] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb48803a1c0 con 0x7fb484098c20 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 20 remove_watcher() i=7 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb484098c20 msgr2=0x7fb4840980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb484098c20 0x7fb4840980b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337c69ee0 msgr2=0x55e337c6c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337c69ee0 0x55e337c6c3a0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb48c037020 msgr2=0x7fb48c02d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb48c037020 0x7fb48c02d900 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c6e7e0 msgr2=0x55e337c70bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c6e7e0 0x55e337c70bd0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb35c03ce10 msgr2=0x7fb35c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb35c03ce10 0x7fb35c03f2d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb484059fd0 tx=0x7fb484088000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 msgr2=0x55e337c5e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb48c017b70 tx=0x7fb48c054720 comp rx=0 tx=0).stop 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb493280640 1 -- 172.21.15.164:0/110159562 reap_dead start 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 shutdown_connections 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 --2- 172.21.15.164:0/110159562 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c28aa0 0x55e337c5e420 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.188+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 >> 172.21.15.164:0/110159562 conn(0x55e337c50f60 msgr2=0x55e337c4f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 shutdown_connections 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/110159562 wait complete. 2024-09-14T10:56:22.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 msgr2=0x7fb36c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 0x7fb36c03f320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55e337c34e10 tx=0x7fb484063cd0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 msgr2=0x55e337c48560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x55e337c2e180 tx=0x7fb48c00af40 comp rx=0 tx=0).stop 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 shutdown_connections 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb36c03ce60 0x7fb36c03f320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/3707440053 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337c48140 0x55e337c48560 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 >> 172.21.15.164:0/3707440053 conn(0x55e337c3c4f0 msgr2=0x55e337c3c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 shutdown_connections 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/3707440053 wait complete. 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 msgr2=0x55e337c347d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 0x55e337c347d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 msgr2=0x55e337c39090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 0x55e337c39090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 msgr2=0x7fb37c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 0x7fb37c03f2d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb488001d70 tx=0x7fb4880012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 msgr2=0x55e337c2d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb484025a60 tx=0x7fb484003330 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 shutdown_connections 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e337c36ca0 0x55e337c39090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e337b358c0 0x55e337c347d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb37c03ce10 0x7fb37c03f2d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 --2- 172.21.15.164:0/2750921219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e337b347a0 0x55e337c2d180 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.189+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 >> 172.21.15.164:0/2750921219 conn(0x55e337b2ffb0 msgr2=0x55e337c1e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.190+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 shutdown_connections 2024-09-14T10:56:22.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.190+0000 7fb497d39800 1 -- 172.21.15.164:0/2750921219 wait complete. 2024-09-14T10:56:22.204 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.205 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-14T10:56:22.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-14T10:56:22.205 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-14T10:56:22.248 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.248 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.250+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.250+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc19a746800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b81d56ebf0 0x55b81d571000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc19a746800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b81d571680 con 0x55b81d56a980 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc19a746800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55b81d3f57d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc197a36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b81d56ebf0 0x55b81d571000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc197a36640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b81d56ebf0 0x55b81d571000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52608/0 (socket says 172.21.15.164:52608) 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc197a36640 1 -- 172.21.15.164:0/3217810362 learned_addr learned my addr 172.21.15.164:0/3217810362 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc198237640 1 --1- 172.21.15.164:0/3217810362 >> v1:172.21.15.116:6789/0 conn(0x55b81d56a980 0x55b81d56ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45386/0 (socket says 172.21.15.164:45386) 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc197a36640 1 -- 172.21.15.164:0/3217810362 >> v1:172.21.15.116:6789/0 conn(0x55b81d56a980 legacy=0x55b81d56ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.251+0000 7fc197a36640 1 -- 172.21.15.164:0/3217810362 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d5728b0 con 0x55b81d56ebf0 2024-09-14T10:56:22.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.253+0000 7fc197a36640 1 --2- 172.21.15.164:0/3217810362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56ebf0 0x55b81d571000 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc18000a520 tx=0x7fc180045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeec4761f90e2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.253+0000 7fc197235640 1 -- 172.21.15.164:0/3217810362 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc180055070 con 0x55b81d56ebf0 2024-09-14T10:56:22.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.253+0000 7fc197235640 1 -- 172.21.15.164:0/3217810362 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1800515b0 con 0x55b81d56ebf0 2024-09-14T10:56:22.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.253+0000 7fc197235640 1 -- 172.21.15.164:0/3217810362 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1800518d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 -- 172.21.15.164:0/3217810362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56ebf0 msgr2=0x55b81d571000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 --2- 172.21.15.164:0/3217810362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56ebf0 0x55b81d571000 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc18000a520 tx=0x7fc180045ba0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 -- 172.21.15.164:0/3217810362 shutdown_connections 2024-09-14T10:56:22.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 --2- 172.21.15.164:0/3217810362 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56ebf0 0x55b81d571000 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 -- 172.21.15.164:0/3217810362 >> 172.21.15.164:0/3217810362 conn(0x55b81d566170 msgr2=0x55b81d5685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 -- 172.21.15.164:0/3217810362 shutdown_connections 2024-09-14T10:56:22.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.254+0000 7fc19a746800 1 -- 172.21.15.164:0/3217810362 wait complete. 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc19a746800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc19a746800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b81d402dd0 con 0x55b81d56a980 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc198237640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc198237640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52616/0 (socket says 172.21.15.164:52616) 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc198237640 1 -- 172.21.15.164:0/2163475261 learned_addr learned my addr 172.21.15.164:0/2163475261 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.268+0000 7fc198237640 1 -- 172.21.15.164:0/2163475261 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d65ad30 con 0x55b81d56a980 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc198237640 1 --2- 172.21.15.164:0/2163475261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b260 tx=0x7fc18800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74251d9690e05062 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc08660c640 1 -- 172.21.15.164:0/2163475261 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18800be60 con 0x55b81d56a980 2024-09-14T10:56:22.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc08660c640 1 -- 172.21.15.164:0/2163475261 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188006070 con 0x55b81d56a980 2024-09-14T10:56:22.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc08660c640 1 -- 172.21.15.164:0/2163475261 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18800e710 con 0x55b81d56a980 2024-09-14T10:56:22.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc19a746800 1 -- 172.21.15.164:0/2163475261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 msgr2=0x55b81d65a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc19a746800 1 --2- 172.21.15.164:0/2163475261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc18800b260 tx=0x7fc18800b660 comp rx=0 tx=0).stop 2024-09-14T10:56:22.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc19a746800 1 -- 172.21.15.164:0/2163475261 shutdown_connections 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc19a746800 1 --2- 172.21.15.164:0/2163475261 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d65a740 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.269+0000 7fc19a746800 1 -- 172.21.15.164:0/2163475261 >> 172.21.15.164:0/2163475261 conn(0x55b81d566170 msgr2=0x55b81d6560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 -- 172.21.15.164:0/2163475261 shutdown_connections 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 -- 172.21.15.164:0/2163475261 wait complete. 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc19a746800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b81d571b50 con 0x55b81d56a980 2024-09-14T10:56:22.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc198237640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc198237640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52630/0 (socket says 172.21.15.164:52630) 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.270+0000 7fc198237640 1 -- 172.21.15.164:0/724196050 learned_addr learned my addr 172.21.15.164:0/724196050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc198237640 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d662800 con 0x55b81d56a980 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc198237640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55b81d65b6d0 tx=0x7fc188000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc084e09640 1 -- 172.21.15.164:0/724196050 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18800ee10 con 0x55b81d56a980 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc084e09640 1 -- 172.21.15.164:0/724196050 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18800fa30 con 0x55b81d56a980 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b81d662a90 con 0x55b81d56a980 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc084e09640 1 -- 172.21.15.164:0/724196050 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc18800fd30 con 0x55b81d56a980 2024-09-14T10:56:22.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.271+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81d663490 con 0x55b81d56a980 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc084e09640 1 -- 172.21.15.164:0/724196050 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc188017070 con 0x55b81d56a980 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc084e09640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 0x7fc08003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc084e09640 1 -- 172.21.15.164:0/724196050 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc188015020 con 0x55b81d56a980 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc197a36640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 0x7fc08003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 0x55b81d6698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d669e30 con 0x55b81d56ebf0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.272+0000 7fc198a38640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 0x55b81d6698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc197a36640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 0x7fc08003f2d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc180057000 tx=0x7fc180052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc198a38640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 0x55b81d6698f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc198a38640 1 -- 172.21.15.164:0/724196050 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc19000a4d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d66a1d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc198a38640 1 -- 172.21.15.164:0/724196050 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc19000a4d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 0x55b81d66e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.273+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d66e8e0 con 0x55b81d66bcd0 2024-09-14T10:56:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc198237640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 0x55b81d66e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc198237640 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 0x55b81d66e150 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc198237640 1 -- 172.21.15.164:0/724196050 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc18802e070 con 0x55b81d66bcd0 2024-09-14T10:56:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d66aa20 con 0x55b81d56ebf0 2024-09-14T10:56:22.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc198a38640 1 -- 172.21.15.164:0/724196050 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc19000a4d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.274+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d66ae70 con 0x55b81d56ebf0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc198a38640 1 -- 172.21.15.164:0/724196050 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc19000a4d0 con 0x55b81d56ebf0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc19a746800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc19a746800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b81d4614a0 con 0x55b81d67d2c0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52638/0 (socket says 172.21.15.164:52638) 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.275+0000 7fc198a38640 1 -- 172.21.15.164:0/2965592995 learned_addr learned my addr 172.21.15.164:0/2965592995 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc198a38640 1 -- 172.21.15.164:0/2965592995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d67dd20 con 0x55b81d67d2c0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc198a38640 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc19000a2a0 tx=0x7fc190018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc07dffb640 1 -- 172.21.15.164:0/2965592995 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190014450 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc07dffb640 1 -- 172.21.15.164:0/2965592995 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1900145f0 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc07dffb640 1 -- 172.21.15.164:0/2965592995 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190014910 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b81d67e550 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.276+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81d67eaf0 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.277+0000 7fc07dffb640 1 -- 172.21.15.164:0/2965592995 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc190011040 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.277+0000 7fc07dffb640 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 0x7fc07003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.277+0000 7fc07dffb640 1 -- 172.21.15.164:0/2965592995 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc19001e070 con 0x55b81d67d2c0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.277+0000 7fc198237640 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 0x7fc07003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc198237640 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 0x7fc07003f320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b81d664390 tx=0x7fc18800ff50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc19a746800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc19a746800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b81d65b160 con 0x55b81d4dffb0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52644/0 (socket says 172.21.15.164:52644) 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc198a38640 1 -- 172.21.15.164:0/4236755606 learned_addr learned my addr 172.21.15.164:0/4236755606 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.278+0000 7fc198a38640 1 -- 172.21.15.164:0/4236755606 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d4e08f0 con 0x55b81d4dffb0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc198a38640 1 --2- 172.21.15.164:0/4236755606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc190016fd0 tx=0x7fc190011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c689fef002cda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc06f7fe640 1 -- 172.21.15.164:0/4236755606 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190051020 con 0x55b81d4dffb0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc06f7fe640 1 -- 172.21.15.164:0/4236755606 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc190022de0 con 0x55b81d4dffb0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc06f7fe640 1 -- 172.21.15.164:0/4236755606 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190028070 con 0x55b81d4dffb0 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 -- 172.21.15.164:0/4236755606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 msgr2=0x55b81d4e03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 --2- 172.21.15.164:0/4236755606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc190016fd0 tx=0x7fc190011a80 comp rx=0 tx=0).stop 2024-09-14T10:56:22.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 -- 172.21.15.164:0/4236755606 shutdown_connections 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 --2- 172.21.15.164:0/4236755606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d4e03b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 -- 172.21.15.164:0/4236755606 >> 172.21.15.164:0/4236755606 conn(0x55b81d6860e0 msgr2=0x55b81d684320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 -- 172.21.15.164:0/4236755606 shutdown_connections 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.279+0000 7fc19a746800 1 -- 172.21.15.164:0/4236755606 wait complete. 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc19a746800 1 Processor -- start 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc19a746800 1 -- start start 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc19a746800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc19a746800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b81d4dee70 con 0x55b81d4dffb0 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc198a38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52648/0 (socket says 172.21.15.164:52648) 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 learned_addr learned my addr 172.21.15.164:0/3149128624 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81d693a40 con 0x55b81d4dffb0 2024-09-14T10:56:22.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc198a38640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc190022f90 tx=0x7fc190054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc06dffb640 1 -- 172.21.15.164:0/3149128624 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190016440 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc06dffb640 1 -- 172.21.15.164:0/3149128624 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc190045130 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.280+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b81d693cd0 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.281+0000 7fc06dffb640 1 -- 172.21.15.164:0/3149128624 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc190045410 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.281+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81d694650 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.281+0000 7fc06dffb640 1 -- 172.21.15.164:0/3149128624 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc190034030 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc06dffb640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc06003ce10 0x7fc06003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc06dffb640 1 -- 172.21.15.164:0/3149128624 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc190032070 con 0x55b81d4dffb0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc198237640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc06003ce10 0x7fc06003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d69f250 0x55b81d6a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a1e30 con 0x55b81d69f250 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc197a36640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d69f250 0x55b81d6a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc198237640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc06003ce10 0x7fc06003f2d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1880176b0 tx=0x7fc188032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.282+0000 7fc197a36640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d69f250 0x55b81d6a16e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 realm 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a2260 con 0x55b81d69f250 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a2b30 con 0x55b81d69f250 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a2ed0 con 0x55b81d69f250 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d6a3c30 0x55b81d6a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a6560 con 0x55b81d6a3c30 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.283+0000 7fc198a38640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d6a3c30 0x55b81d6a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198a38640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d6a3c30 0x55b81d6a6020 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc19a746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc19a746800 20 searching for the correct realm 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198a38640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc19004dc20 0x7fc19002ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.284+0000 7fc198237640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc19004dc20 0x7fc19002ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.285+0000 7fc198237640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc19004dc20 0x7fc19002ca50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.285+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.285+0000 7fc198237640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc18800f070 0x7fc18801b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.285+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.285+0000 7fc197a36640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc18800f070 0x7fc18801b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc18800f070 0x7fc18801b760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.286+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.287+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.288+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.289+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.290+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x55b81d69f250 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.291+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180057030 con 0x7fc18800f070 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d6a3c30 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc18800f070 2024-09-14T10:56:22.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.292+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x55b81d69f250 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7ee0 con 0x7fc19004dc20 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a7000 con 0x55b81d69f250 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a78a0 con 0x55b81d69f250 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.293+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a8390 con 0x55b81d69f250 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 zone default found 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 4 Realm: () 2024-09-14T10:56:22.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 zonegroup default 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a8730 con 0x7fc18800f070 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6aa250 con 0x55b81d6a3c30 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.294+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6aa700 con 0x55b81d6a3c30 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.295+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.295+0000 7fc19a746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.295+0000 7fc19a746800 20 started sync module instance, tier type = 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.295+0000 7fc19a746800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.295+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a95c0 con 0x7fc19004dc20 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.296+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.296+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249255868848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6a9220 con 0x7fc19004dc20 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.296+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ab630 con 0x55b81d69f250 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.297+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249255868848] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.297+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.297+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249255874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ab5a0 con 0x55b81d69f250 2024-09-14T10:56:22.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.297+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ac4f0 con 0x55b81d6a3c30 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.298+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.299+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249255878720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ac950 con 0x55b81d6a3c30 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.299+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249255874944] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.299+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6aba80 con 0x7fc19004dc20 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.300+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.300+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249255882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ad7e0 con 0x7fc19004dc20 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.300+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ae2c0 con 0x55b81d69f250 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.300+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249255878720] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.301+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.301+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249255886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ae6b0 con 0x55b81d69f250 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.301+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6af110 con 0x7fc18800f070 2024-09-14T10:56:22.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.301+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249255882512] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.302+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.302+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249255883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6af110 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.302+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6afb20 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.302+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249255886288] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.303+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249255883568] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.303+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.303+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249255879776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6af670 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.303+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6b0030 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249255879776] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249255889904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6b0030 con 0x7fc18800f070 2024-09-14T10:56:22.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=0 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=1 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=2 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=3 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=4 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=5 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.304+0000 7fc19a746800 20 add_watcher() i=6 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.305+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249255889904] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.305+0000 7fc19a746800 20 add_watcher() i=7 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.305+0000 7fc19a746800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.305+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6b3340 con 0x55b81d69f250 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.306+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.306+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249255894256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6b05c0 con 0x55b81d69f250 2024-09-14T10:56:22.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.306+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249255894256] v37'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc04e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 5 note: GC not initialized 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc04d7e2640 20 reqs_thread_entry: start 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 20 Filter name: none 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fbfbeffd640 20 reqs_thread_entry: start 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c40 con 0x55b81d69f250 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.307+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c40 con 0x7fc19004dc20 2024-09-14T10:56:22.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d69f250 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.308+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d69f250 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d69f250 2024-09-14T10:56:22.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d6a3c30 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x55b81d6a3c30 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.309+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6c00 con 0x7fc18800f070 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc19004dc20 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.310+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.311+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.312+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc19004dc20 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.313+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d69f250 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.314+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.315+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.315+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6e6650 con 0x7fc18800f070 2024-09-14T10:56:22.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.315+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.316+0000 7fc04e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.316+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249255894256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6b1a90 con 0x55b81d69f250 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.317+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94249255894256] v37'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.317+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249255868848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6afcf0 con 0x7fc19004dc20 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.318+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94249255868848] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.318+0000 7fc19a746800 20 remove_watcher() i=0 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.318+0000 7fc19a746800 2 removed watcher, disabling cache 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.318+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249255874944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6afcf0 con 0x55b81d69f250 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.319+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94249255874944] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.320+0000 7fc19a746800 20 remove_watcher() i=1 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.320+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249255878720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ab180 con 0x55b81d6a3c30 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.321+0000 7fc198a38640 1 -- 172.21.15.164:0/3149128624 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94249255878720] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19002a070 con 0x55b81d6a3c30 2024-09-14T10:56:22.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.321+0000 7fc19a746800 20 remove_watcher() i=2 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.321+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249255882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6afcf0 con 0x7fc19004dc20 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.322+0000 7fc198237640 1 -- 172.21.15.164:0/3149128624 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94249255882512] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18802e070 con 0x7fc19004dc20 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.322+0000 7fc19a746800 20 remove_watcher() i=3 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.322+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249255886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ac040 con 0x55b81d69f250 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.323+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94249255886288] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x55b81d69f250 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.323+0000 7fc19a746800 20 remove_watcher() i=4 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.323+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249255883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ab180 con 0x7fc18800f070 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.324+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94249255883568] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.324+0000 7fc19a746800 20 remove_watcher() i=5 2024-09-14T10:56:22.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.324+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249255879776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6afcf0 con 0x7fc18800f070 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.325+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94249255879776] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.325+0000 7fc19a746800 20 remove_watcher() i=6 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.325+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249255889904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b81d6ab180 con 0x7fc18800f070 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94249255889904] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc180089040 con 0x7fc18800f070 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 20 remove_watcher() i=7 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc18800f070 msgr2=0x7fc18801b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc18800f070 0x7fc18801b760 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d69f250 msgr2=0x55b81d6a16e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d69f250 0x55b81d6a16e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc19004dc20 msgr2=0x7fc19002ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc19004dc20 0x7fc19002ca50 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d6a3c30 msgr2=0x55b81d6a6020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d6a3c30 0x55b81d6a6020 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc06003ce10 msgr2=0x7fc06003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc06003ce10 0x7fc06003f2d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc1880176b0 tx=0x7fc188032000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 msgr2=0x55b81d6934e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc197a36640 1 -- 172.21.15.164:0/3149128624 reap_dead start 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc190022f90 tx=0x7fc190054580 comp rx=0 tx=0).stop 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 shutdown_connections 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 --2- 172.21.15.164:0/3149128624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d4dffb0 0x55b81d6934e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 >> 172.21.15.164:0/3149128624 conn(0x55b81d6860e0 msgr2=0x55b81d6842f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 shutdown_connections 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.326+0000 7fc19a746800 1 -- 172.21.15.164:0/3149128624 wait complete. 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 msgr2=0x7fc07003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 0x7fc07003f320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55b81d664390 tx=0x7fc18800ff50 comp rx=0 tx=0).stop 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 msgr2=0x55b81d67d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc19000a2a0 tx=0x7fc190018830 comp rx=0 tx=0).stop 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 shutdown_connections 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc07003ce60 0x7fc07003f320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/2965592995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d67d2c0 0x55b81d67d6e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 >> 172.21.15.164:0/2965592995 conn(0x55b81d671670 msgr2=0x55b81d671a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 shutdown_connections 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/2965592995 wait complete. 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 msgr2=0x55b81d6698f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 0x55b81d6698f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 msgr2=0x55b81d66e150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 0x55b81d66e150 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 msgr2=0x7fc08003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 0x7fc08003f2d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc180057000 tx=0x7fc180052000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 msgr2=0x55b81d6622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55b81d65b6d0 tx=0x7fc188000ed0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 shutdown_connections 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b81d66bcd0 0x55b81d66e150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b81d56ebf0 0x55b81d6698f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc08003ce10 0x7fc08003f2d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 --2- 172.21.15.164:0/724196050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b81d56a980 0x55b81d6622a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 >> 172.21.15.164:0/724196050 conn(0x55b81d566170 msgr2=0x55b81d65bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 shutdown_connections 2024-09-14T10:56:22.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.327+0000 7fc19a746800 1 -- 172.21.15.164:0/724196050 wait complete. 2024-09-14T10:56:22.349 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.349 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.349 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-14T10:56:22.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-14T10:56:22.350 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-14T10:56:22.434 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.434 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.437+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.437+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.437+0000 7fb271410800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56334755dc00 0x563347560070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.437+0000 7fb271410800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633475606f0 con 0x5633474cd730 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.437+0000 7fb271410800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5633473e47d0 con 0x56334755dc00 2024-09-14T10:56:22.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb2643bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56334755dc00 0x563347560070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb2643bb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56334755dc00 0x563347560070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52650/0 (socket says 172.21.15.164:52650) 2024-09-14T10:56:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb2643bb640 1 -- 172.21.15.164:0/2276663998 learned_addr learned my addr 172.21.15.164:0/2276663998 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb26cbbc640 1 --1- 172.21.15.164:0/2276663998 >> v1:172.21.15.116:6789/0 conn(0x5633474cd730 0x56334755c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45396/0 (socket says 172.21.15.164:45396) 2024-09-14T10:56:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb2643bb640 1 -- 172.21.15.164:0/2276663998 >> v1:172.21.15.116:6789/0 conn(0x5633474cd730 legacy=0x56334755c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.438+0000 7fb2643bb640 1 -- 172.21.15.164:0/2276663998 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563347561920 con 0x56334755dc00 2024-09-14T10:56:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.440+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2276663998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334755dc00 0x563347560070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb25400a520 tx=0x7fb254045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e39069e8ae51ab server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.440+0000 7fb267fff640 1 -- 172.21.15.164:0/2276663998 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb254055070 con 0x56334755dc00 2024-09-14T10:56:22.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.440+0000 7fb267fff640 1 -- 172.21.15.164:0/2276663998 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540515b0 con 0x56334755dc00 2024-09-14T10:56:22.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.440+0000 7fb267fff640 1 -- 172.21.15.164:0/2276663998 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2540518d0 con 0x56334755dc00 2024-09-14T10:56:22.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 -- 172.21.15.164:0/2276663998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334755dc00 msgr2=0x563347560070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 --2- 172.21.15.164:0/2276663998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334755dc00 0x563347560070 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb25400a520 tx=0x7fb254045ba0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 -- 172.21.15.164:0/2276663998 shutdown_connections 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 --2- 172.21.15.164:0/2276663998 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334755dc00 0x563347560070 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 -- 172.21.15.164:0/2276663998 >> 172.21.15.164:0/2276663998 conn(0x563347553fb0 msgr2=0x5633475563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 -- 172.21.15.164:0/2276663998 shutdown_connections 2024-09-14T10:56:22.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.441+0000 7fb271410800 1 -- 172.21.15.164:0/2276663998 wait complete. 2024-09-14T10:56:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.455+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.455+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.455+0000 7fb271410800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.455+0000 7fb271410800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633473f1dd0 con 0x5633474cd730 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb26cbbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb26cbbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52660/0 (socket says 172.21.15.164:52660) 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb26cbbc640 1 -- 172.21.15.164:0/868748735 learned_addr learned my addr 172.21.15.164:0/868748735 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb26cbbc640 1 -- 172.21.15.164:0/868748735 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563347649da0 con 0x5633474cd730 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/868748735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00b260 tx=0x7fb25c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb8f4eb90cc54e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb15ae0d640 1 -- 172.21.15.164:0/868748735 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c00be60 con 0x5633474cd730 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb15ae0d640 1 -- 172.21.15.164:0/868748735 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c006070 con 0x5633474cd730 2024-09-14T10:56:22.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.456+0000 7fb15ae0d640 1 -- 172.21.15.164:0/868748735 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c00e710 con 0x5633474cd730 2024-09-14T10:56:22.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- 172.21.15.164:0/868748735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 msgr2=0x5633476497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 --2- 172.21.15.164:0/868748735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00b260 tx=0x7fb25c00b660 comp rx=0 tx=0).stop 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- 172.21.15.164:0/868748735 shutdown_connections 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 --2- 172.21.15.164:0/868748735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476497b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- 172.21.15.164:0/868748735 >> 172.21.15.164:0/868748735 conn(0x563347553fb0 msgr2=0x563347645130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- 172.21.15.164:0/868748735 shutdown_connections 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- 172.21.15.164:0/868748735 wait complete. 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.457+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb271410800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb271410800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563347560bc0 con 0x5633474cd730 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb26cbbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb26cbbc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52672/0 (socket says 172.21.15.164:52672) 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2627648777 learned_addr learned my addr 172.21.15.164:0/2627648777 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563347651820 con 0x5633474cd730 2024-09-14T10:56:22.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56334764a740 tx=0x7fb25c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb15960a640 1 -- 172.21.15.164:0/2627648777 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c00f810 con 0x5633474cd730 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb15960a640 1 -- 172.21.15.164:0/2627648777 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c00f9b0 con 0x5633474cd730 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563347651ab0 con 0x5633474cd730 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb15960a640 1 -- 172.21.15.164:0/2627648777 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c00fcd0 con 0x5633474cd730 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.458+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633476524b0 con 0x5633474cd730 2024-09-14T10:56:22.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.459+0000 7fb15960a640 1 -- 172.21.15.164:0/2627648777 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb25c017070 con 0x5633474cd730 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb15960a640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 0x7fb15403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb15960a640 1 -- 172.21.15.164:0/2627648777 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb25c015020 con 0x5633474cd730 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 0x7fb15403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 0x563347658910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347658e50 con 0x56334755dc00 2024-09-14T10:56:22.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 0x563347658910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 0x7fb15403f2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb254057000 tx=0x7fb254052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 0x563347658910 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2627648777 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb26800a4d0 con 0x56334755dc00 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.460+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633476591f0 con 0x56334755dc00 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2627648777 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb26800a4d0 con 0x56334755dc00 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 0x56334765d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56334765d900 con 0x56334765acf0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 0x56334765d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 0x56334765d170 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2627648777 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb25c02e070 con 0x56334765acf0 2024-09-14T10:56:22.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.461+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347659a40 con 0x56334755dc00 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.462+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2627648777 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb26800a4d0 con 0x56334755dc00 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.462+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347659e90 con 0x56334755dc00 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.462+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2627648777 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb26800a4d0 con 0x56334755dc00 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.462+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.462+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb271410800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb271410800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633474504a0 con 0x56334766c2e0 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52688/0 (socket says 172.21.15.164:52688) 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2634614729 learned_addr learned my addr 172.21.15.164:0/2634614729 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2634614729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56334766cd40 con 0x56334766c2e0 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.463+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb26800a2a0 tx=0x7fb268018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.464+0000 7fb1527fc640 1 -- 172.21.15.164:0/2634614729 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268014450 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.464+0000 7fb1527fc640 1 -- 172.21.15.164:0/2634614729 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2680145f0 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.464+0000 7fb1527fc640 1 -- 172.21.15.164:0/2634614729 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268014910 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.464+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56334766d570 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.464+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56334766db10 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb1527fc640 1 -- 172.21.15.164:0/2634614729 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb268011040 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb1527fc640 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 0x7fb14403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb1527fc640 1 -- 172.21.15.164:0/2634614729 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb26801e070 con 0x56334766c2e0 2024-09-14T10:56:22.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 0x7fb14403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 0x7fb14403f320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5633476533b0 tx=0x7fb25c00ff00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb271410800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.465+0000 7fb271410800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56334764a1d0 con 0x563347678d20 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52704/0 (socket says 172.21.15.164:52704) 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb26d3bd640 1 -- 172.21.15.164:0/3981792471 learned_addr learned my addr 172.21.15.164:0/3981792471 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb26d3bd640 1 -- 172.21.15.164:0/3981792471 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563347679710 con 0x563347678d20 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/3981792471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb268016fd0 tx=0x7fb268011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7143b62163c7869c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb143fff640 1 -- 172.21.15.164:0/3981792471 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268051020 con 0x563347678d20 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb143fff640 1 -- 172.21.15.164:0/3981792471 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268022de0 con 0x563347678d20 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.466+0000 7fb143fff640 1 -- 172.21.15.164:0/3981792471 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268028070 con 0x563347678d20 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- 172.21.15.164:0/3981792471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 msgr2=0x563347679120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 --2- 172.21.15.164:0/3981792471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb268016fd0 tx=0x7fb268011a80 comp rx=0 tx=0).stop 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- 172.21.15.164:0/3981792471 shutdown_connections 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 --2- 172.21.15.164:0/3981792471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347679120 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- 172.21.15.164:0/3981792471 >> 172.21.15.164:0/3981792471 conn(0x563347675120 msgr2=0x563347673360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- 172.21.15.164:0/3981792471 shutdown_connections 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- 172.21.15.164:0/3981792471 wait complete. 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 Processor -- start 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- start start 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347559bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.467+0000 7fb271410800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563347679d30 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347559bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb26d3bd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347559bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52708/0 (socket says 172.21.15.164:52708) 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 learned_addr learned my addr 172.21.15.164:0/2021407488 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56334755a110 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347559bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb268022f90 tx=0x7fb268054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb1427fc640 1 -- 172.21.15.164:0/2021407488 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268016440 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb1427fc640 1 -- 172.21.15.164:0/2021407488 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb268032070 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633475584c0 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb1427fc640 1 -- 172.21.15.164:0/2021407488 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb268045d80 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.468+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563347558a00 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb1427fc640 1 -- 172.21.15.164:0/2021407488 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb268001770 con 0x563347678d20 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb1427fc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb13803ce10 0x7fb13803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb1427fc640 1 -- 172.21.15.164:0/2021407488 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb26800e040 con 0x563347678d20 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb13803ce10 0x7fb13803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334768e260 0x5633476906f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.469+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347690e40 con 0x56334768e260 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334768e260 0x5633476906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb13803ce10 0x7fb13803f2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x56334765dd00 tx=0x7fb25c04b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334768e260 0x5633476906f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 20 realm 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347691270 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.470+0000 7fb271410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347691b40 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347691ee0 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563347692c40 0x563347695030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347695570 con 0x563347692c40 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563347692c40 0x563347695030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.471+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563347692c40 0x563347695030 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb271410800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb271410800 20 searching for the correct realm 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26d3bd640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb26804dc20 0x7fb2680080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb26804dc20 0x7fb2680080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.472+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb26804dc20 0x7fb2680080c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb26cbbc640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb25c00f070 0x7fb25c0539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb25c00f070 0x7fb25c0539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb2643bb640 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb25c00f070 0x7fb25c0539a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.473+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.474+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.475+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.476+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.477+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.478+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x56334768e260 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254057030 con 0x7fb25c00f070 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.479+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x563347692c40 2024-09-14T10:56:22.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb25c00f070 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.480+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x56334768e260 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563347696ec0 con 0x7fb26804dc20 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347695fe0 con 0x56334768e260 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347696880 con 0x56334768e260 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.481+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347695c20 con 0x56334768e260 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 zone default found 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 4 Realm: () 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 zonegroup default 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347696460 con 0x7fb25c00f070 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563347699240 con 0x563347692c40 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633476998b0 con 0x563347692c40 2024-09-14T10:56:22.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.482+0000 7fb271410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.483+0000 7fb271410800 20 started sync module instance, tier type = 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.483+0000 7fb271410800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.483+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563347698650 con 0x7fb26804dc20 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.484+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.484+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94778241417632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563347699d10 con 0x7fb26804dc20 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.484+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769a560 con 0x56334768e260 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.485+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94778241417632] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.485+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.485+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94778241425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769a980 con 0x56334768e260 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.485+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769b1d0 con 0x563347692c40 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.486+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94778241425584] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.486+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.486+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94778241427120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769b0c0 con 0x563347692c40 2024-09-14T10:56:22.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.486+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769bbe0 con 0x7fb26804dc20 2024-09-14T10:56:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.488+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.488+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94778241427120] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.488+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94778241431216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769c480 con 0x7fb26804dc20 2024-09-14T10:56:22.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.488+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769ab50 con 0x56334768e260 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.489+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.489+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94778241431216] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.489+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94778241433552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769cf20 con 0x56334768e260 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.489+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769d8e0 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.490+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.490+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94778241438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769d850 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.490+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769e890 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.490+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94778241433552] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.491+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94778241438768] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.491+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.491+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94778241440976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769e370 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.491+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769ed40 con 0x7fb25c00f070 2024-09-14T10:56:22.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94778241440976] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94778241436272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769ed40 con 0x7fb25c00f070 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=0 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=1 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=2 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=3 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=4 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=5 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.492+0000 7fb271410800 20 add_watcher() i=6 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.493+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94778241436272] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.493+0000 7fb271410800 20 add_watcher() i=7 2024-09-14T10:56:22.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.493+0000 7fb271410800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.493+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633476a20b0 con 0x56334768e260 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.494+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.494+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94778241444352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769f2d0 con 0x56334768e260 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.494+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94778241444352] v37'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb1237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 5 note: GC not initialized 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb1227e4640 20 reqs_thread_entry: start 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 20 Filter name: none 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb11b7fe640 20 reqs_thread_entry: start 2024-09-14T10:56:22.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.495+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633476d4e60 con 0x56334768e260 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.496+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.496+0000 7fb271410800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.496+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633476d6250 con 0x7fb25c00f070 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.496+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.497+0000 7fb1237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.497+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94778241444352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633476d4780 con 0x56334768e260 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.498+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94778241444352] v37'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.498+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94778241417632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769ea00 con 0x7fb26804dc20 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.499+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94778241417632] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.499+0000 7fb271410800 20 remove_watcher() i=0 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.499+0000 7fb271410800 2 removed watcher, disabling cache 2024-09-14T10:56:22.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.499+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94778241425584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633476981a0 con 0x56334768e260 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.500+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94778241425584] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.500+0000 7fb271410800 20 remove_watcher() i=1 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.500+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94778241427120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633476981a0 con 0x563347692c40 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.501+0000 7fb26d3bd640 1 -- 172.21.15.164:0/2021407488 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94778241427120] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb26802a070 con 0x563347692c40 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.501+0000 7fb271410800 20 remove_watcher() i=2 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.501+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94778241431216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769a6b0 con 0x7fb26804dc20 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.502+0000 7fb26cbbc640 1 -- 172.21.15.164:0/2021407488 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94778241431216] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25c02e070 con 0x7fb26804dc20 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.502+0000 7fb271410800 20 remove_watcher() i=3 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.502+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94778241433552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633476981a0 con 0x56334768e260 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.504+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94778241433552] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x56334768e260 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.504+0000 7fb271410800 20 remove_watcher() i=4 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.504+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94778241438768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769b6b0 con 0x7fb25c00f070 2024-09-14T10:56:22.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.505+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94778241438768] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.505+0000 7fb271410800 20 remove_watcher() i=5 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.505+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94778241440976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56334769bfd0 con 0x7fb25c00f070 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.506+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94778241440976] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.506+0000 7fb271410800 20 remove_watcher() i=6 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.506+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94778241436272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5633476981a0 con 0x7fb25c00f070 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94778241436272] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb254089040 con 0x7fb25c00f070 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 20 remove_watcher() i=7 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb25c00f070 msgr2=0x7fb25c0539a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fb25c00f070 0x7fb25c0539a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334768e260 msgr2=0x5633476906f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334768e260 0x5633476906f0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb26804dc20 msgr2=0x7fb2680080c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb26804dc20 0x7fb2680080c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563347692c40 msgr2=0x563347695030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563347692c40 0x563347695030 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb13803ce10 msgr2=0x7fb13803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb13803ce10 0x7fb13803f2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x56334765dd00 tx=0x7fb25c04b000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 msgr2=0x563347559bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2021407488 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563347678d20 0x563347559bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb268022f90 tx=0x7fb268054580 comp rx=0 tx=0).stop 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 reap_dead start 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb2643bb640 1 -- 172.21.15.164:0/2021407488 reap_dead start 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 shutdown_connections 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 >> 172.21.15.164:0/2021407488 conn(0x563347675120 msgr2=0x563347673330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 shutdown_connections 2024-09-14T10:56:22.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2021407488 wait complete. 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 msgr2=0x7fb14403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 0x7fb14403f320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5633476533b0 tx=0x7fb25c00ff00 comp rx=0 tx=0).stop 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 msgr2=0x56334766c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb26800a2a0 tx=0x7fb268018830 comp rx=0 tx=0).stop 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 shutdown_connections 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb14403ce60 0x7fb14403f320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 --2- 172.21.15.164:0/2634614729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56334766c2e0 0x56334766c700 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 >> 172.21.15.164:0/2634614729 conn(0x563347660690 msgr2=0x563347660a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 shutdown_connections 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.507+0000 7fb271410800 1 -- 172.21.15.164:0/2634614729 wait complete. 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 msgr2=0x563347658910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 0x563347658910 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 msgr2=0x56334765d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 0x56334765d170 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 msgr2=0x7fb15403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 0x7fb15403f2d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb254057000 tx=0x7fb254052000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 msgr2=0x5633476512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x56334764a740 tx=0x7fb25c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 shutdown_connections 2024-09-14T10:56:22.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56334765acf0 0x56334765d170 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56334755dc00 0x563347658910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb15403ce10 0x7fb15403f2d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 --2- 172.21.15.164:0/2627648777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633474cd730 0x5633476512c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 >> 172.21.15.164:0/2627648777 conn(0x563347553fb0 msgr2=0x56334764aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 shutdown_connections 2024-09-14T10:56:22.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.508+0000 7fb271410800 1 -- 172.21.15.164:0/2627648777 wait complete. 2024-09-14T10:56:22.531 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.531 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.532 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-14T10:56:22.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-14T10:56:22.532 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-14T10:56:22.579 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.580 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.582+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.582+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.582+0000 7f9fb5a63800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558a04178bc0 0x558a0417b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.582+0000 7f9fb5a63800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a0417b700 con 0x558a040e87b0 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.582+0000 7f9fb5a63800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x558a03fff7d0 con 0x558a04178bc0 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.583+0000 7f9fb2d53640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558a04178bc0 0x558a0417b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.583+0000 7f9fb3554640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x558a040e87b0 0x558a041774a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45398/0 (socket says 172.21.15.164:45398) 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.583+0000 7f9fb3554640 1 -- 172.21.15.164:0/325636423 learned_addr learned my addr 172.21.15.164:0/325636423 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.583+0000 7f9fb2d53640 1 -- 172.21.15.164:0/325636423 >> v1:172.21.15.116:6789/0 conn(0x558a040e87b0 legacy=0x558a041774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.583+0000 7f9fb2d53640 1 -- 172.21.15.164:0/325636423 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0417c930 con 0x558a04178bc0 2024-09-14T10:56:22.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.585+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/325636423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a0417b080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800a470 tx=0x7f9fa8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d117ff2fb8a0d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.585+0000 7f9fb2552640 1 -- 172.21.15.164:0/325636423 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa8053570 con 0x558a04178bc0 2024-09-14T10:56:22.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.585+0000 7f9fb2552640 1 -- 172.21.15.164:0/325636423 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa8058070 con 0x558a04178bc0 2024-09-14T10:56:22.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.585+0000 7f9fb2552640 1 -- 172.21.15.164:0/325636423 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa8053880 con 0x558a04178bc0 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 -- 172.21.15.164:0/325636423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 msgr2=0x558a0417b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/325636423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a0417b080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800a470 tx=0x7f9fa8045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 -- 172.21.15.164:0/325636423 shutdown_connections 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/325636423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a0417b080 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 -- 172.21.15.164:0/325636423 >> 172.21.15.164:0/325636423 conn(0x558a0416efd0 msgr2=0x558a04171410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 -- 172.21.15.164:0/325636423 shutdown_connections 2024-09-14T10:56:22.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.586+0000 7f9fb5a63800 1 -- 172.21.15.164:0/325636423 wait complete. 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.599+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.599+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb5a63800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb5a63800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558a0400cdd0 con 0x558a040e87b0 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb3554640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb3554640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52724/0 (socket says 172.21.15.164:52724) 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb3554640 1 -- 172.21.15.164:0/1687323429 learned_addr learned my addr 172.21.15.164:0/1687323429 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb3554640 1 -- 172.21.15.164:0/1687323429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a04264de0 con 0x558a040e87b0 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1687323429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001800 tx=0x7f9fa4001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f9da33acf9ece server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9ea160a640 1 -- 172.21.15.164:0/1687323429 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4004520 con 0x558a040e87b0 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9ea160a640 1 -- 172.21.15.164:0/1687323429 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa40046c0 con 0x558a040e87b0 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.600+0000 7f9ea160a640 1 -- 172.21.15.164:0/1687323429 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa40049e0 con 0x558a040e87b0 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1687323429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 msgr2=0x558a042647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1687323429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4001800 tx=0x7f9fa4001cc0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1687323429 shutdown_connections 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1687323429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a040e87b0 0x558a042647f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1687323429 >> 172.21.15.164:0/1687323429 conn(0x558a0416efd0 msgr2=0x558a04260170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1687323429 shutdown_connections 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.601+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1687323429 wait complete. 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb5a63800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb5a63800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558a0417bbd0 con 0x558a04178bc0 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb3554640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb3554640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52726/0 (socket says 172.21.15.164:52726) 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb3554640 1 -- 172.21.15.164:0/4091202734 learned_addr learned my addr 172.21.15.164:0/4091202734 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.602+0000 7f9fb3554640 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a04175110 con 0x558a04178bc0 2024-09-14T10:56:22.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9fb3554640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40066b0 tx=0x7f9fa4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9e9fe07640 1 -- 172.21.15.164:0/4091202734 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4022020 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9e9fe07640 1 -- 172.21.15.164:0/4091202734 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fa4014870 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a041734c0 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9e9fe07640 1 -- 172.21.15.164:0/4091202734 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fa4014bb0 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.603+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a04173a80 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9e9fe07640 1 -- 172.21.15.164:0/4091202734 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9fa4025020 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9e9fe07640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 0x7f9e9803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9e9fe07640 1 -- 172.21.15.164:0/4091202734 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9fa4018030 con 0x558a04178bc0 2024-09-14T10:56:22.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 0x7f9e9803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 0x558a04275e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a04276390 con 0x558a04273a60 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 0x558a04275e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.604+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 0x7f9e9803f2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8057000 tx=0x7f9fa8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 0x558a04275e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb3d55640 1 -- 172.21.15.164:0/4091202734 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fac0083e0 con 0x558a04273a60 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a04173f80 con 0x558a04273a60 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb3d55640 1 -- 172.21.15.164:0/4091202734 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fac0083e0 con 0x558a04273a60 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 0x558a0427aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a0427b1a0 con 0x558a042786e0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb3554640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 0x558a0427aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.605+0000 7f9fb3554640 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 0x558a0427aad0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.606 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.606+0000 7f9fb3554640 1 -- 172.21.15.164:0/4091202734 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fa401b070 con 0x558a042786e0 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.606+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a04277580 con 0x558a04273a60 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.606+0000 7f9fb3d55640 1 -- 172.21.15.164:0/4091202734 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fac0083e0 con 0x558a04273a60 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.606+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a04277a60 con 0x558a04273a60 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.606+0000 7f9fb3d55640 1 -- 172.21.15.164:0/4091202734 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fac0083e0 con 0x558a04273a60 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb5a63800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb5a63800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558a0406b4a0 con 0x558a04289bc0 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52738/0 (socket says 172.21.15.164:52738) 2024-09-14T10:56:22.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.607+0000 7f9fb3d55640 1 -- 172.21.15.164:0/914514908 learned_addr learned my addr 172.21.15.164:0/914514908 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9fb3d55640 1 -- 172.21.15.164:0/914514908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0428a620 con 0x558a04289bc0 2024-09-14T10:56:22.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x558a04174750 tx=0x7f9fac00af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9e9d602640 1 -- 172.21.15.164:0/914514908 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac007dc0 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9e9d602640 1 -- 172.21.15.164:0/914514908 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac01e020 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9e9d602640 1 -- 172.21.15.164:0/914514908 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac019570 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a0428ae50 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.608+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a0428b3f0 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.609+0000 7f9e9d602640 1 -- 172.21.15.164:0/914514908 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9fac016040 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.609+0000 7f9e9d602640 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 0x7f9e8c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.609+0000 7f9e9d602640 1 -- 172.21.15.164:0/914514908 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9fac01f030 con 0x558a04289bc0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.609+0000 7f9fb3554640 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 0x7f9e8c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3554640 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 0x7f9e8c03f320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x558a04276830 tx=0x7f9fa4006980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb5a63800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb5a63800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558a04265210 con 0x558a04296570 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52750/0 (socket says 172.21.15.164:52750) 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3d55640 1 -- 172.21.15.164:0/2577604290 learned_addr learned my addr 172.21.15.164:0/2577604290 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3d55640 1 -- 172.21.15.164:0/2577604290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a04296f60 con 0x558a04296570 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.610+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/2577604290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fac018fd0 tx=0x7f9fac019eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8755466641aee1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9e96ffd640 1 -- 172.21.15.164:0/2577604290 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac04b070 con 0x558a04296570 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9e96ffd640 1 -- 172.21.15.164:0/2577604290 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac056070 con 0x558a04296570 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9e96ffd640 1 -- 172.21.15.164:0/2577604290 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac01d040 con 0x558a04296570 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- 172.21.15.164:0/2577604290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 msgr2=0x558a04296970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/2577604290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fac018fd0 tx=0x7f9fac019eb0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- 172.21.15.164:0/2577604290 shutdown_connections 2024-09-14T10:56:22.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/2577604290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a04296970 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- 172.21.15.164:0/2577604290 >> 172.21.15.164:0/2577604290 conn(0x558a04292970 msgr2=0x558a04290bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- 172.21.15.164:0/2577604290 shutdown_connections 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- 172.21.15.164:0/2577604290 wait complete. 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 Processor -- start 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- start start 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.611+0000 7f9fb5a63800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558a04297580 con 0x558a04296570 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb3d55640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52762/0 (socket says 172.21.15.164:52762) 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 learned_addr learned my addr 172.21.15.164:0/1508972408 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a0429e0b0 con 0x558a04296570 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9fac053620 tx=0x7f9fac054690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9e957fa640 1 -- 172.21.15.164:0/1508972408 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac04b030 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9e957fa640 1 -- 172.21.15.164:0/1508972408 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac015d00 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a0429e340 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9e957fa640 1 -- 172.21.15.164:0/1508972408 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fac01d040 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.612+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a0429ecc0 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.613+0000 7f9e957fa640 1 -- 172.21.15.164:0/1508972408 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9fac0188f0 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.613+0000 7f9e957fa640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e7c03cdc0 0x7f9e7c03f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.613+0000 7f9e957fa640 1 -- 172.21.15.164:0/1508972408 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9fac04c070 con 0x558a04296570 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.613+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.613+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e7c03cdc0 0x7f9e7c03f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a042a96d0 0x558a042abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042ac2b0 con 0x558a042a96d0 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a042a96d0 0x558a042abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e7c03cdc0 0x7f9e7c03f280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4026780 tx=0x7f9fa4033000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a042a96d0 0x558a042abb60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 20 realm 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042ac6e0 con 0x558a042a96d0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.614+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042acfb0 con 0x558a042a96d0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042ad350 con 0x558a042a96d0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042ae0b0 0x558a042b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b09e0 con 0x558a042ae0b0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042ae0b0 0x558a042b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.615+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042ae0b0 0x558a042b04a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb5a63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb5a63800 20 searching for the correct realm 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3d55640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9fac019040 0x7f9fac037040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9fac019040 0x7f9fac037040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.616+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9fac019040 0x7f9fac037040 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.617+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.617+0000 7f9fb3554640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9fa4027020 0x7f9fa401e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.617+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.617+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9fa4027020 0x7f9fa401e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.617+0000 7f9fb2d53640 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9fa4027020 0x7f9fa401e3f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.618+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.619+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.620+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.621+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.622+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.623+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042ae0b0 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fa4027020 2024-09-14T10:56:22.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x558a042a96d0 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.624+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558a042b2330 con 0x7f9fac019040 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b1450 con 0x558a042a96d0 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b1cf0 con 0x558a042a96d0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b1090 con 0x558a042a96d0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 zone default found 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 4 Realm: () 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 zonegroup default 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.625+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b1920 con 0x7f9fa4027020 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b4700 con 0x558a042ae0b0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042b4d40 con 0x558a042ae0b0 2024-09-14T10:56:22.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 started sync module instance, tier type = 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.626+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b3b70 con 0x7f9fac019040 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.627+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.627+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051263788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b51a0 con 0x7f9fac019040 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.627+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b59f0 con 0x558a042a96d0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.628+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051263788736] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.629+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.629+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051263790944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b5a70 con 0x558a042a96d0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.629+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b6570 con 0x558a042ae0b0 2024-09-14T10:56:22.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.630+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.630+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051263799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b6570 con 0x558a042ae0b0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.630+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051263790944] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.630+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b5540 con 0x7f9fac019040 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.631+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.631+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051263799392] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.631+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051263803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b79b0 con 0x7f9fac019040 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.631+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b6990 con 0x558a042a96d0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.632+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.632+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051263803440] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.632+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051263807168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b8790 con 0x558a042a96d0 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.632+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b7500 con 0x7f9fa4027020 2024-09-14T10:56:22.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.633+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.633+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051263804672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9150 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.633+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9bb0 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.634+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051263807168] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.634+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051263804672] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.635+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.635+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051263808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b8ca0 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.635+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042ba240 con 0x7f9fa4027020 2024-09-14T10:56:22.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051263808224] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051263813264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042ba240 con 0x7f9fa4027020 2024-09-14T10:56:22.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=0 2024-09-14T10:56:22.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=1 2024-09-14T10:56:22.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=2 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=3 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=4 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=5 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.636+0000 7f9fb5a63800 20 add_watcher() i=6 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051263813264] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb5a63800 20 add_watcher() i=7 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb5a63800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042bd3c0 con 0x558a042a96d0 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.637+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051263815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042ba660 con 0x558a042a96d0 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.638+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051263815056] v37'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.638+0000 7f9e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.638+0000 7f9fb5a63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.638+0000 7f9fb5a63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.638+0000 7f9fb5a63800 5 note: GC not initialized 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9e68fe1640 20 reqs_thread_entry: start 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 20 Filter name: none 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9de27fc640 20 reqs_thread_entry: start 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042f01d0 con 0x558a042a96d0 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.639+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558a042f15c0 con 0x7f9fa4027020 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.640+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.641+0000 7f9e69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.641+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051263815056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042efaf0 con 0x558a042a96d0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.642+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94051263815056] v37'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.642+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051263788736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x7f9fac019040 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.643+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94051263788736] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.643+0000 7f9fb5a63800 20 remove_watcher() i=0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.643+0000 7f9fb5a63800 2 removed watcher, disabling cache 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.643+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051263790944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x558a042a96d0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.644+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94051263790944] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.644+0000 7f9fb5a63800 20 remove_watcher() i=1 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.644+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051263799392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b3f60 con 0x558a042ae0b0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.645+0000 7f9fb3d55640 1 -- 172.21.15.164:0/1508972408 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94051263799392] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fac02a070 con 0x558a042ae0b0 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.645+0000 7f9fb5a63800 20 remove_watcher() i=2 2024-09-14T10:56:22.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.645+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051263803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x7f9fac019040 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.646+0000 7f9fb3554640 1 -- 172.21.15.164:0/1508972408 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94051263803440] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa401b070 con 0x7f9fac019040 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.646+0000 7f9fb5a63800 20 remove_watcher() i=3 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.646+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051263807168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b7030 con 0x558a042a96d0 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.647+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94051263807168] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x558a042a96d0 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.647+0000 7f9fb5a63800 20 remove_watcher() i=4 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.647+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051263804672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x7f9fa4027020 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.648+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94051263804672] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.648+0000 7f9fb5a63800 20 remove_watcher() i=5 2024-09-14T10:56:22.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.648+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051263808224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x7f9fa4027020 2024-09-14T10:56:22.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.649+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94051263808224] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.649+0000 7f9fb5a63800 20 remove_watcher() i=6 2024-09-14T10:56:22.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.649+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051263813264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558a042b9d90 con 0x7f9fa4027020 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94051263813264] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fa8051070 con 0x7f9fa4027020 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 20 remove_watcher() i=7 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9fa4027020 msgr2=0x7f9fa401e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9fa4027020 0x7f9fa401e3f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a042a96d0 msgr2=0x558a042abb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a042a96d0 0x558a042abb60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9fac019040 msgr2=0x7f9fac037040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9fac019040 0x7f9fac037040 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042ae0b0 msgr2=0x558a042b04a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.650+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042ae0b0 0x558a042b04a0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e7c03cdc0 msgr2=0x7f9e7c03f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e7c03cdc0 0x7f9e7c03f280 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4026780 tx=0x7f9fa4033000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 msgr2=0x558a0429db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb2d53640 1 -- 172.21.15.164:0/1508972408 reap_dead start 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9fac053620 tx=0x7f9fac054690 comp rx=0 tx=0).stop 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 shutdown_connections 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/1508972408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04296570 0x558a0429db50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 >> 172.21.15.164:0/1508972408 conn(0x558a04292970 msgr2=0x558a04290b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 shutdown_connections 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/1508972408 wait complete. 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 msgr2=0x7f9e8c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 0x7f9e8c03f320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x558a04276830 tx=0x7f9fa4006980 comp rx=0 tx=0).stop 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 msgr2=0x558a04289fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x558a04174750 tx=0x7f9fac00af40 comp rx=0 tx=0).stop 2024-09-14T10:56:22.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 shutdown_connections 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e8c03ce60 0x7f9e8c03f320 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/914514908 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04289bc0 0x558a04289fe0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 >> 172.21.15.164:0/914514908 conn(0x558a0427df70 msgr2=0x558a0427e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 shutdown_connections 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/914514908 wait complete. 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 msgr2=0x558a04275e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 0x558a04275e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 msgr2=0x558a0427aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 0x558a0427aad0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 msgr2=0x7f9e9803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 0x7f9e9803f2d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8057000 tx=0x7f9fa8052000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 msgr2=0x558a04174bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.651+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40066b0 tx=0x7f9fa4001250 comp rx=0 tx=0).stop 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 shutdown_connections 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558a042786e0 0x558a0427aad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558a04273a60 0x558a04275e50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9e9803ce10 0x7f9e9803f2d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 --2- 172.21.15.164:0/4091202734 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558a04178bc0 0x558a04174bb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 >> 172.21.15.164:0/4091202734 conn(0x558a0416efd0 msgr2=0x558a04265d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 shutdown_connections 2024-09-14T10:56:22.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.652+0000 7f9fb5a63800 1 -- 172.21.15.164:0/4091202734 wait complete. 2024-09-14T10:56:22.658 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.658 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.659 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-14T10:56:22.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-14T10:56:22.659 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-14T10:56:22.705 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.706 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.708+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5de87800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555841fe99b0 0x555841fe9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5de87800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555841feb550 con 0x555841fea990 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5de87800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555841e747d0 con 0x555841fe99b0 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5b971640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555841fe99b0 0x555841fe9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5b170640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x555841fea990 0x555841feae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45406/0 (socket says 172.21.15.164:45406) 2024-09-14T10:56:22.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5b170640 1 -- 172.21.15.164:0/2492155071 learned_addr learned my addr 172.21.15.164:0/2492155071 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:22.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5b971640 1 -- 172.21.15.164:0/2492155071 >> v1:172.21.15.116:6789/0 conn(0x555841fea990 legacy=0x555841feae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.709+0000 7f7c5b971640 1 -- 172.21.15.164:0/2492155071 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555841feb720 con 0x555841fe99b0 2024-09-14T10:56:22.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.711+0000 7f7c5b971640 1 --2- 172.21.15.164:0/2492155071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x555841fe9db0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00a470 tx=0x7f7c4c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d3c67bd7cae80a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.711+0000 7f7c5a96f640 1 -- 172.21.15.164:0/2492155071 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c053570 con 0x555841fe99b0 2024-09-14T10:56:22.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.711+0000 7f7c5a96f640 1 -- 172.21.15.164:0/2492155071 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c058070 con 0x555841fe99b0 2024-09-14T10:56:22.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.711+0000 7f7c5a96f640 1 -- 172.21.15.164:0/2492155071 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c053880 con 0x555841fe99b0 2024-09-14T10:56:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 -- 172.21.15.164:0/2492155071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 msgr2=0x555841fe9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 --2- 172.21.15.164:0/2492155071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x555841fe9db0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00a470 tx=0x7f7c4c045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 -- 172.21.15.164:0/2492155071 shutdown_connections 2024-09-14T10:56:22.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 --2- 172.21.15.164:0/2492155071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x555841fe9db0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 -- 172.21.15.164:0/2492155071 >> 172.21.15.164:0/2492155071 conn(0x555841fe51a0 msgr2=0x555841fe7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 -- 172.21.15.164:0/2492155071 shutdown_connections 2024-09-14T10:56:22.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.712+0000 7f7c5de87800 1 -- 172.21.15.164:0/2492155071 wait complete. 2024-09-14T10:56:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5de87800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5de87800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555841e81dd0 con 0x555841fe99b0 2024-09-14T10:56:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5b971640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5b971640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52776/0 (socket says 172.21.15.164:52776) 2024-09-14T10:56:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.727+0000 7f7c5b971640 1 -- 172.21.15.164:0/2252412013 learned_addr learned my addr 172.21.15.164:0/2252412013 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.728+0000 7f7c5b971640 1 -- 172.21.15.164:0/2252412013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558420d9db0 con 0x555841fe99b0 2024-09-14T10:56:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.728+0000 7f7c5b971640 1 --2- 172.21.15.164:0/2252412013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c025c20 tx=0x7f7c4c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fac4ffe34e565c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.728+0000 7f7b49e0b640 1 -- 172.21.15.164:0/2252412013 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c053570 con 0x555841fe99b0 2024-09-14T10:56:22.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.728+0000 7f7b49e0b640 1 -- 172.21.15.164:0/2252412013 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c063070 con 0x555841fe99b0 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.728+0000 7f7b49e0b640 1 -- 172.21.15.164:0/2252412013 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c053840 con 0x555841fe99b0 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- 172.21.15.164:0/2252412013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 msgr2=0x5558420d97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 --2- 172.21.15.164:0/2252412013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c025c20 tx=0x7f7c4c051000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- 172.21.15.164:0/2252412013 shutdown_connections 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 --2- 172.21.15.164:0/2252412013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420d97c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- 172.21.15.164:0/2252412013 >> 172.21.15.164:0/2252412013 conn(0x555841fe51a0 msgr2=0x5558420d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- 172.21.15.164:0/2252412013 shutdown_connections 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- 172.21.15.164:0/2252412013 wait complete. 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5de87800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555841ff0e80 con 0x555841fe99b0 2024-09-14T10:56:22.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5b971640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5b971640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52790/0 (socket says 172.21.15.164:52790) 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.729+0000 7f7c5b971640 1 -- 172.21.15.164:0/915290687 learned_addr learned my addr 172.21.15.164:0/915290687 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7c5b971640 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558420e1700 con 0x555841fe99b0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7c5b971640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c053d60 tx=0x7f7c4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7b43fff640 1 -- 172.21.15.164:0/915290687 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c068470 con 0x555841fe99b0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7b43fff640 1 -- 172.21.15.164:0/915290687 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c4c068610 con 0x555841fe99b0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558420e1990 con 0x555841fe99b0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7b43fff640 1 -- 172.21.15.164:0/915290687 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c4c0688f0 con 0x555841fe99b0 2024-09-14T10:56:22.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.730+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558420e2390 con 0x555841fe99b0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.731+0000 7f7b43fff640 1 -- 172.21.15.164:0/915290687 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7c4c068a90 con 0x555841fe99b0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.731+0000 7f7b43fff640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 0x7f7b4403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.731+0000 7f7b43fff640 1 -- 172.21.15.164:0/915290687 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7c4c098900 con 0x555841fe99b0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.731+0000 7f7c5b170640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 0x7f7b4403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 0x5558420e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558420e2f70 con 0x555841fea990 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5c172640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 0x5558420e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5b170640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 0x7f7b4403f2d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c44001d70 tx=0x7f7c440012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5c172640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 0x5558420e87f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5c172640 1 -- 172.21.15.164:0/915290687 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c5400a4d0 con 0x555841fea990 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.732+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558420e9230 con 0x555841fea990 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5c172640 1 -- 172.21.15.164:0/915290687 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c5400a4d0 con 0x555841fea990 2024-09-14T10:56:22.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 0x5558420ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558420ed770 con 0x5558420eab40 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5b971640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 0x5558420ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5b971640 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 0x5558420ecfe0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5b971640 1 -- 172.21.15.164:0/915290687 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c4c079020 con 0x5558420eab40 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.733+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558420e9a80 con 0x555841fea990 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5c172640 1 -- 172.21.15.164:0/915290687 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c5400a4d0 con 0x555841fea990 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558420e9e20 con 0x555841fea990 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5c172640 1 -- 172.21.15.164:0/915290687 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c5400a4d0 con 0x555841fea990 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5de87800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.734+0000 7f7c5de87800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555841ee04a0 con 0x5558420fc0e0 2024-09-14T10:56:22.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52802/0 (socket says 172.21.15.164:52802) 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5c172640 1 -- 172.21.15.164:0/3596437475 learned_addr learned my addr 172.21.15.164:0/3596437475 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5c172640 1 -- 172.21.15.164:0/3596437475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558420fcb40 con 0x5558420fc0e0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5c172640 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x5558420e2030 tx=0x7f7c54018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7b417fa640 1 -- 172.21.15.164:0/3596437475 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c540180d0 con 0x5558420fc0e0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7b417fa640 1 -- 172.21.15.164:0/3596437475 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c54018290 con 0x5558420fc0e0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558420fd370 con 0x5558420fc0e0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.735+0000 7f7b417fa640 1 -- 172.21.15.164:0/3596437475 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c54014450 con 0x5558420fc0e0 2024-09-14T10:56:22.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.736+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558420fd910 con 0x5558420fc0e0 2024-09-14T10:56:22.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.736+0000 7f7b417fa640 1 -- 172.21.15.164:0/3596437475 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7c54011040 con 0x5558420fc0e0 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7b417fa640 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 0x7f7b3403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7b417fa640 1 -- 172.21.15.164:0/3596437475 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7c5401e070 con 0x5558420fc0e0 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 0x7f7b3403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 0x7f7b3403f320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5558420e2a70 tx=0x7f7c4c096f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5de87800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5de87800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5558420da180 con 0x555842108b40 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52804/0 (socket says 172.21.15.164:52804) 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.737+0000 7f7c5c172640 1 -- 172.21.15.164:0/4261472765 learned_addr learned my addr 172.21.15.164:0/4261472765 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5c172640 1 -- 172.21.15.164:0/4261472765 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555842109530 con 0x555842108b40 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5c172640 1 --2- 172.21.15.164:0/4261472765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c54011a40 tx=0x7f7c54022ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0902b0f8fb8c767 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7b3affd640 1 -- 172.21.15.164:0/4261472765 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c54011e00 con 0x555842108b40 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7b3affd640 1 -- 172.21.15.164:0/4261472765 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5402b350 con 0x555842108b40 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7b3affd640 1 -- 172.21.15.164:0/4261472765 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c540133b0 con 0x555842108b40 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 -- 172.21.15.164:0/4261472765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 msgr2=0x555842108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 --2- 172.21.15.164:0/4261472765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c54011a40 tx=0x7f7c54022ce0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 -- 172.21.15.164:0/4261472765 shutdown_connections 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 --2- 172.21.15.164:0/4261472765 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842108f40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 -- 172.21.15.164:0/4261472765 >> 172.21.15.164:0/4261472765 conn(0x555842104f40 msgr2=0x555842103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 -- 172.21.15.164:0/4261472765 shutdown_connections 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.738+0000 7f7c5de87800 1 -- 172.21.15.164:0/4261472765 wait complete. 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5de87800 1 Processor -- start 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5de87800 1 -- start start 2024-09-14T10:56:22.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5de87800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5de87800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555842109b50 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5c172640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52820/0 (socket says 172.21.15.164:52820) 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 learned_addr learned my addr 172.21.15.164:0/3389462645 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.739+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558421106b0 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7c5c172640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c54011aa0 tx=0x7f7c54054060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7b397fa640 1 -- 172.21.15.164:0/3389462645 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c54011b10 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7b397fa640 1 -- 172.21.15.164:0/3389462645 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5402b500 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7b397fa640 1 -- 172.21.15.164:0/3389462645 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c5402b8f0 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555842110940 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.740+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558421112c0 con 0x555842108b40 2024-09-14T10:56:22.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7b397fa640 1 -- 172.21.15.164:0/3389462645 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7c5402ba90 con 0x555842108b40 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7b397fa640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b2403ce10 0x7f7b2403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7b397fa640 1 -- 172.21.15.164:0/3389462645 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7c5400e040 con 0x555842108b40 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b2403ce10 0x7f7b2403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55584211bef0 0x55584211e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55584211ead0 con 0x55584211bef0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5b170640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55584211bef0 0x55584211e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.741+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b2403ce10 0x7f7b2403f2d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c052d00 tx=0x7f7c4c089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5b170640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55584211bef0 0x55584211e380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c44009050 con 0x55584211bef0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 realm 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55584211b300 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c44009050 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55584211f5b0 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c44009050 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.742+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55584211fe80 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c44009050 con 0x55584211bef0 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558421207c0 0x555842122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558421232f0 con 0x5558421207c0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5c172640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558421207c0 0x555842122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5c172640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558421207c0 0x555842122bb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c5403e070 con 0x5558421207c0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 20 searching for the correct realm 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c5403e070 con 0x5558421207c0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.743+0000 7f7c5c172640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7c54037020 0x7f7c5405f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7c54037020 0x7f7c5405f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7c54037020 0x7f7c5405f650 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5b971640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f7c4c0a5040 0x7f7c4c08f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.744+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f7c4c0a5040 0x7f7c4c08f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f7c4c0a5040 0x7f7c4c08f9e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44009050 con 0x7f7c4c0a5040 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44009050 con 0x55584211bef0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.745+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.746+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5403e070 con 0x5558421207c0 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.747+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c5403e070 con 0x5558421207c0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.748+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.749+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.750+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x55584211bef0 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.751+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x5558421207c0 2024-09-14T10:56:22.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c4c0a5040 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c44029040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.752+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x55584211bef0 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555842124c80 con 0x7f7c54037020 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842123d70 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842124610 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.753+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558421239b0 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 zone default found 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 4 Realm: () 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 zonegroup default 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5558421241f0 con 0x7f7c4c0a5040 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842127020 con 0x5558421207c0 2024-09-14T10:56:22.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842127500 con 0x5558421207c0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.754+0000 7f7c5de87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.755+0000 7f7c5de87800 20 started sync module instance, tier type = 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.755+0000 7f7c5de87800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.755+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421264c0 con 0x7f7c54037020 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.756+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.756+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93837553985712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555842127e10 con 0x7f7c54037020 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.756+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555842128660 con 0x55584211bef0 2024-09-14T10:56:22.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.757+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93837553985712] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.757+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.757+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93837553992112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555842128a80 con 0x55584211bef0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.757+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421292d0 con 0x5558421207c0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.758+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93837553992112] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.759+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.759+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93837553993648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555842129670 con 0x5558421207c0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.759+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212a090 con 0x7f7c54037020 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.760+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.760+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93837553998720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212a090 con 0x7f7c54037020 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.760+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212b070 con 0x55584211bef0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.760+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93837553993648] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.761+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.761+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93837553994800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212b030 con 0x55584211bef0 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.761+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212bb00 con 0x7f7c4c0a5040 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.761+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93837553998720] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.762+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.762+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93837554001072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212bb00 con 0x7f7c4c0a5040 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.762+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c510 con 0x7f7c4c0a5040 2024-09-14T10:56:22.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.762+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93837553994800] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.763+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93837554001072] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.763+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.763+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93837554002816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c060 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.763+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212ca20 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.764+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93837554002816] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93837554005504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212ca20 con 0x7f7c4c0a5040 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=0 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=1 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=2 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=3 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=4 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=5 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.765+0000 7f7c5de87800 20 add_watcher() i=6 2024-09-14T10:56:22.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.766+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93837554005504] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.766+0000 7f7c5de87800 20 add_watcher() i=7 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.766+0000 7f7c5de87800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.766+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55584212fd00 con 0x55584211bef0 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.767+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.767+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93837554009824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212cfb0 con 0x55584211bef0 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93837554009824] v37'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5de87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5de87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5de87800 5 note: GC not initialized 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7b10fe1640 20 reqs_thread_entry: start 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5de87800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.768+0000 7f7c5de87800 20 Filter name: none 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7a8a7fc640 20 reqs_thread_entry: start 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5de87800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842162c20 con 0x55584211bef0 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5de87800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555842164010 con 0x7f7c4c0a5040 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.769+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.770+0000 7f7b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.770+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93837554009824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212e4f0 con 0x55584211bef0 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.771+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93837554009824] v37'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.771+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93837553985712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c6e0 con 0x7f7c54037020 2024-09-14T10:56:22.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.772+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93837553985712] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.772+0000 7f7c5de87800 20 remove_watcher() i=0 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.772+0000 7f7c5de87800 2 removed watcher, disabling cache 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.772+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93837553992112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c6e0 con 0x55584211bef0 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.774+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93837553992112] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.774+0000 7f7c5de87800 20 remove_watcher() i=1 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.774+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93837553993648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421281b0 con 0x5558421207c0 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.775+0000 7f7c5c172640 1 -- 172.21.15.164:0/3389462645 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93837553993648] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c54068040 con 0x5558421207c0 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.775+0000 7f7c5de87800 20 remove_watcher() i=2 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.775+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93837553998720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c6e0 con 0x7f7c54037020 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.776+0000 7f7c5b971640 1 -- 172.21.15.164:0/3389462645 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93837553998720] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c4c079020 con 0x7f7c54037020 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.776+0000 7f7c5de87800 20 remove_watcher() i=3 2024-09-14T10:56:22.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.776+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93837553994800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421287b0 con 0x55584211bef0 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.777+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93837553994800] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x55584211bef0 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.777+0000 7f7c5de87800 20 remove_watcher() i=4 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.777+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93837554001072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421281b0 con 0x7f7c4c0a5040 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.778+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93837554001072] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.778+0000 7f7c5de87800 20 remove_watcher() i=5 2024-09-14T10:56:22.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.778+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93837554002816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55584212c6e0 con 0x7f7c4c0a5040 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.779+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93837554002816] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.779+0000 7f7c5de87800 20 remove_watcher() i=6 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.779+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93837554005504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5558421287b0 con 0x7f7c4c0a5040 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93837554005504] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c44039040 con 0x7f7c4c0a5040 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 20 remove_watcher() i=7 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f7c4c0a5040 msgr2=0x7f7c4c08f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f7c4c0a5040 0x7f7c4c08f9e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55584211bef0 msgr2=0x55584211e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55584211bef0 0x55584211e380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7c54037020 msgr2=0x7f7c5405f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f7c54037020 0x7f7c5405f650 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558421207c0 msgr2=0x555842122bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558421207c0 0x555842122bb0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b2403ce10 msgr2=0x7f7b2403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b2403ce10 0x7f7b2403f2d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c052d00 tx=0x7f7c4c089000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5b170640 1 -- 172.21.15.164:0/3389462645 reap_dead start 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 msgr2=0x555842110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c54011aa0 tx=0x7f7c54054060 comp rx=0 tx=0).stop 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 shutdown_connections 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3389462645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555842108b40 0x555842110150 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 >> 172.21.15.164:0/3389462645 conn(0x555842104f40 msgr2=0x555842103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 shutdown_connections 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.780+0000 7f7c5de87800 1 -- 172.21.15.164:0/3389462645 wait complete. 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 msgr2=0x7f7b3403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 0x7f7b3403f320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x5558420e2a70 tx=0x7f7c4c096f90 comp rx=0 tx=0).stop 2024-09-14T10:56:22.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 msgr2=0x5558420fc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x5558420e2030 tx=0x7f7c54018830 comp rx=0 tx=0).stop 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 shutdown_connections 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b3403ce60 0x7f7b3403f320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/3596437475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5558420fc0e0 0x5558420fc500 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 >> 172.21.15.164:0/3596437475 conn(0x5558420f0490 msgr2=0x5558420f0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 shutdown_connections 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/3596437475 wait complete. 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 msgr2=0x5558420e87f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 0x5558420e87f0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 msgr2=0x5558420ecfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 0x5558420ecfe0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 msgr2=0x7f7b4403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 0x7f7b4403f2d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7c44001d70 tx=0x7f7c440012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 msgr2=0x5558420e11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c053d60 tx=0x7f7c4c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 shutdown_connections 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5558420eab40 0x5558420ecfe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555841fea990 0x5558420e87f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7b4403ce10 0x7f7b4403f2d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 --2- 172.21.15.164:0/915290687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555841fe99b0 0x5558420e11a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 >> 172.21.15.164:0/915290687 conn(0x555841fe51a0 msgr2=0x5558420d3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 shutdown_connections 2024-09-14T10:56:22.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.781+0000 7f7c5de87800 1 -- 172.21.15.164:0/915290687 wait complete. 2024-09-14T10:56:22.787 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.788 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-14T10:56:22.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-14T10:56:22.788 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-14T10:56:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.834 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.837+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.837+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.837+0000 7fa941d2e800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b331452ed0 0x55b3314e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.837+0000 7fa941d2e800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3314e8920 con 0x55b3314e4e10 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.837+0000 7fa941d2e800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55b33136a7d0 con 0x55b331452ed0 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.838+0000 7fa93dadd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b331452ed0 0x55b3314e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.838+0000 7fa93d2dc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55b3314e4e10 0x55b3314e7200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45418/0 (socket says 172.21.15.164:45418) 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.838+0000 7fa93d2dc640 1 -- 172.21.15.164:0/1013192621 learned_addr learned my addr 172.21.15.164:0/1013192621 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.838+0000 7fa93dadd640 1 -- 172.21.15.164:0/1013192621 >> v1:172.21.15.116:6789/0 conn(0x55b3314e4e10 legacy=0x55b3314e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.838+0000 7fa93dadd640 1 -- 172.21.15.164:0/1013192621 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3314e9b30 con 0x55b331452ed0 2024-09-14T10:56:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa93dadd640 1 --2- 172.21.15.164:0/1013192621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3314e48d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa930005fd0 tx=0x7fa930045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f8575d9a80df52 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa93cadb640 1 -- 172.21.15.164:0/1013192621 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa930058530 con 0x55b331452ed0 2024-09-14T10:56:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa93cadb640 1 -- 172.21.15.164:0/1013192621 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9300586d0 con 0x55b331452ed0 2024-09-14T10:56:22.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa93cadb640 1 -- 172.21.15.164:0/1013192621 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9300589d0 con 0x55b331452ed0 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa941d2e800 1 -- 172.21.15.164:0/1013192621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 msgr2=0x55b3314e48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.840+0000 7fa941d2e800 1 --2- 172.21.15.164:0/1013192621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3314e48d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa930005fd0 tx=0x7fa930045c30 comp rx=0 tx=0).stop 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.841+0000 7fa941d2e800 1 -- 172.21.15.164:0/1013192621 shutdown_connections 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.841+0000 7fa941d2e800 1 --2- 172.21.15.164:0/1013192621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3314e48d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.841+0000 7fa941d2e800 1 -- 172.21.15.164:0/1013192621 >> 172.21.15.164:0/1013192621 conn(0x55b3314d9fa0 msgr2=0x55b3314dc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.841+0000 7fa941d2e800 1 -- 172.21.15.164:0/1013192621 shutdown_connections 2024-09-14T10:56:22.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.841+0000 7fa941d2e800 1 -- 172.21.15.164:0/1013192621 wait complete. 2024-09-14T10:56:22.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.854+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.854+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.854+0000 7fa941d2e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.854+0000 7fa941d2e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b331377dd0 con 0x55b331452ed0 2024-09-14T10:56:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa93dadd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa93dadd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52830/0 (socket says 172.21.15.164:52830) 2024-09-14T10:56:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa93dadd640 1 -- 172.21.15.164:0/2701235239 learned_addr learned my addr 172.21.15.164:0/2701235239 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa93dadd640 1 -- 172.21.15.164:0/2701235239 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3315d2030 con 0x55b331452ed0 2024-09-14T10:56:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa93dadd640 1 --2- 172.21.15.164:0/2701235239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa930025a60 tx=0x7fa930051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21e4182784881b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa82be07640 1 -- 172.21.15.164:0/2701235239 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa930058a30 con 0x55b331452ed0 2024-09-14T10:56:22.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa82be07640 1 -- 172.21.15.164:0/2701235239 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa930068070 con 0x55b331452ed0 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.855+0000 7fa82be07640 1 -- 172.21.15.164:0/2701235239 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa930058d00 con 0x55b331452ed0 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- 172.21.15.164:0/2701235239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 msgr2=0x55b3315d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2701235239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa930025a60 tx=0x7fa930051000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- 172.21.15.164:0/2701235239 shutdown_connections 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2701235239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d1a40 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- 172.21.15.164:0/2701235239 >> 172.21.15.164:0/2701235239 conn(0x55b3314d9fa0 msgr2=0x55b3315cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- 172.21.15.164:0/2701235239 shutdown_connections 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- 172.21.15.164:0/2701235239 wait complete. 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.856+0000 7fa941d2e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b3314e8df0 con 0x55b331452ed0 2024-09-14T10:56:22.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa93dadd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa93dadd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52834/0 (socket says 172.21.15.164:52834) 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa93dadd640 1 -- 172.21.15.164:0/3913481043 learned_addr learned my addr 172.21.15.164:0/3913481043 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa93dadd640 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3315d9920 con 0x55b331452ed0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa93dadd640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa930025a60 tx=0x7fa930003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa82a604640 1 -- 172.21.15.164:0/3913481043 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa930063650 con 0x55b331452ed0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa82a604640 1 -- 172.21.15.164:0/3913481043 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9300637f0 con 0x55b331452ed0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3315d9bb0 con 0x55b331452ed0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa82a604640 1 -- 172.21.15.164:0/3913481043 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa930063b10 con 0x55b331452ed0 2024-09-14T10:56:22.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.857+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3315da5b0 con 0x55b331452ed0 2024-09-14T10:56:22.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.858+0000 7fa82a604640 1 -- 172.21.15.164:0/3913481043 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa930075020 con 0x55b331452ed0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.858+0000 7fa82a604640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 0x7fa82403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa82a604640 1 -- 172.21.15.164:0/3913481043 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa9300987f0 con 0x55b331452ed0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 0x7fa82403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 0x55b3315e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3315db1a0 con 0x55b3314e4e10 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa93e2de640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 0x55b3315e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 0x7fa82403f2d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa928001d70 tx=0x7fa9280012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa93e2de640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 0x55b3315e0a10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa93e2de640 1 -- 172.21.15.164:0/3913481043 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b3314e4e10 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.859+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3315e1490 con 0x55b3314e4e10 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa93e2de640 1 -- 172.21.15.164:0/3913481043 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9380083e0 con 0x55b3314e4e10 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 0x55b3315e5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3315e59d0 con 0x55b3315e2da0 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa93dadd640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 0x55b3315e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa93dadd640 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 0x55b3315e5240 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa93dadd640 1 -- 172.21.15.164:0/3913481043 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa930077d10 con 0x55b3315e2da0 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.860+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3315e1ce0 con 0x55b3314e4e10 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa93e2de640 1 -- 172.21.15.164:0/3913481043 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9380083e0 con 0x55b3314e4e10 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3315e20c0 con 0x55b3314e4e10 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa93e2de640 1 -- 172.21.15.164:0/3913481043 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9380083e0 con 0x55b3314e4e10 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa941d2e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.861+0000 7fa941d2e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b3313d64a0 con 0x55b3315f4410 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52836/0 (socket says 172.21.15.164:52836) 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa93e2de640 1 -- 172.21.15.164:0/2910542811 learned_addr learned my addr 172.21.15.164:0/2910542811 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa93e2de640 1 -- 172.21.15.164:0/2910542811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3315f4e70 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa93e2de640 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55b3315da9b0 tx=0x7fa93800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa8237fe640 1 -- 172.21.15.164:0/2910542811 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa938007d60 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa8237fe640 1 -- 172.21.15.164:0/2910542811 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93801e020 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3315f56a0 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa8237fe640 1 -- 172.21.15.164:0/2910542811 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa938019590 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.862+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3315f5c40 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.863+0000 7fa8237fe640 1 -- 172.21.15.164:0/2910542811 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa938016040 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.863+0000 7fa8237fe640 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 0x7fa81803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.863+0000 7fa8237fe640 1 -- 172.21.15.164:0/2910542811 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa93801f030 con 0x55b3315f4410 2024-09-14T10:56:22.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93dadd640 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 0x7fa81803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93dadd640 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 0x7fa81803f2d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b3315dab90 tx=0x7fa930098040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa941d2e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa941d2e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b3315d23a0 con 0x55b331600e50 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52852/0 (socket says 172.21.15.164:52852) 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93e2de640 1 -- 172.21.15.164:0/3854326862 learned_addr learned my addr 172.21.15.164:0/3854326862 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.864+0000 7fa93e2de640 1 -- 172.21.15.164:0/3854326862 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b331601840 con 0x55b331600e50 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa93e2de640 1 --2- 172.21.15.164:0/3854326862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa938054440 tx=0x7fa938045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb6c34712c4d7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa8217fa640 1 -- 172.21.15.164:0/3854326862 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa93801d040 con 0x55b331600e50 2024-09-14T10:56:22.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa8217fa640 1 -- 172.21.15.164:0/3854326862 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa938051070 con 0x55b331600e50 2024-09-14T10:56:22.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa8217fa640 1 -- 172.21.15.164:0/3854326862 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9380184e0 con 0x55b331600e50 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 -- 172.21.15.164:0/3854326862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 msgr2=0x55b331601250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3854326862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa938054440 tx=0x7fa938045490 comp rx=0 tx=0).stop 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 -- 172.21.15.164:0/3854326862 shutdown_connections 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3854326862 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331601250 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 -- 172.21.15.164:0/3854326862 >> 172.21.15.164:0/3854326862 conn(0x55b3315fd250 msgr2=0x55b3315fb490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 -- 172.21.15.164:0/3854326862 shutdown_connections 2024-09-14T10:56:22.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 -- 172.21.15.164:0/3854326862 wait complete. 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.865+0000 7fa941d2e800 1 Processor -- start 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa941d2e800 1 -- start start 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa941d2e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa941d2e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b331601e60 con 0x55b331600e50 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa93e2de640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52860/0 (socket says 172.21.15.164:52860) 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 learned_addr learned my addr 172.21.15.164:0/299929172 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b331608970 con 0x55b331600e50 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa93e2de640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa938008fd0 tx=0x7fa9380543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa80f7fe640 1 -- 172.21.15.164:0/299929172 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa93801d030 con 0x55b331600e50 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa80f7fe640 1 -- 172.21.15.164:0/299929172 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa938014dd0 con 0x55b331600e50 2024-09-14T10:56:22.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b331608c00 con 0x55b331600e50 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.866+0000 7fa80f7fe640 1 -- 172.21.15.164:0/299929172 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa938016460 con 0x55b331600e50 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.867+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b331609580 con 0x55b331600e50 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.867+0000 7fa80f7fe640 1 -- 172.21.15.164:0/299929172 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa938016600 con 0x55b331600e50 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa80f7fe640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa80803ce10 0x7fa80803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa80f7fe640 1 -- 172.21.15.164:0/299929172 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa938033030 con 0x55b331600e50 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa93dadd640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa80803ce10 0x7fa80803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b331613f90 0x55b331616450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b331616ba0 con 0x55b331613f90 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b331613f90 0x55b331616450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa93dadd640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa80803ce10 0x7fa80803f2d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa93005a290 tx=0x7fa930090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.868+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b331613f90 0x55b331616450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa928009050 con 0x55b331613f90 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 realm 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b3316132e0 con 0x55b331613f90 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa928009050 con 0x55b331613f90 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b331617680 con 0x55b331613f90 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa928009050 con 0x55b331613f90 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b331617f50 con 0x55b331613f90 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa928009050 con 0x55b331613f90 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b331618890 0x55b33161ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.869+0000 7fa93e2de640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b331618890 0x55b33161ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93e2de640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b331618890 0x55b33161ac80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa941d2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa941d2e800 20 searching for the correct realm 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161cd50 con 0x55b331618890 2024-09-14T10:56:22.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93e2de640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa938019040 0x7fa938023a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.870+0000 7fa93dadd640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa938019040 0x7fa938023a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.871+0000 7fa93dadd640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa938019040 0x7fa938023a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.871+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.871+0000 7fa93dadd640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa93004f870 0x7fa930096280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.871+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.871+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa93004f870 0x7fa930096280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa93004f870 0x7fa930096280 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928009050 con 0x7fa93004f870 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928009050 con 0x55b331613f90 2024-09-14T10:56:22.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.872+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.873+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.874+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.875+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.876+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.877+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x55b331613f90 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.878+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331618890 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa93004f870 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa928029040 con 0x7fa93004f870 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.879+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x55b331613f90 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b33161b3c0 con 0x7fa938019040 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161be40 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161ba80 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.880+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161c760 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 zone default found 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 4 Realm: () 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 zonegroup default 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161d200 con 0x7fa93004f870 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161ecf0 con 0x55b331618890 2024-09-14T10:56:22.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33161f1c0 con 0x55b331618890 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 started sync module instance, tier type = 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:22.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.881+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161e090 con 0x7fa938019040 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.883+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.883+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228116003808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161f620 con 0x7fa938019040 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.883+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161fe70 con 0x55b331613f90 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.884+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.884+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94228116003808] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.884+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228116011728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161e580 con 0x55b331613f90 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.884+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331620ba0 con 0x55b331618890 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.885+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94228116011728] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.885+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.885+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228116014736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331620f90 con 0x55b331618890 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.885+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b3316219d0 con 0x7fa938019040 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.886+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94228116014736] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.887+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.887+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228116018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331621dc0 con 0x7fa938019040 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.887+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331622800 con 0x55b331613f90 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.888+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.888+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94228116018336] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.888+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228116021968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b3316230a0 con 0x55b331613f90 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.888+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161ffb0 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.889+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94228116021968] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.889+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.889+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228116024096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331623690 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.889+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331624050 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.890+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94228116024096] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.891+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.891+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228116025152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331624050 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.891+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331624a10 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94228116025152] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228116030816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331624e30 con 0x7fa93004f870 2024-09-14T10:56:22.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=0 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=1 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=2 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=3 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=4 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=5 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.892+0000 7fa941d2e800 20 add_watcher() i=6 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94228116030816] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa941d2e800 20 add_watcher() i=7 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa941d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b331627e60 con 0x55b331613f90 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.893+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228116031872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b3316252c0 con 0x55b331613f90 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.894+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94228116031872] v37'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.894+0000 7fa7effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.894+0000 7fa941d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.894+0000 7fa941d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.894+0000 7fa941d2e800 5 note: GC not initialized 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa7eeffd640 20 reqs_thread_entry: start 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 20 Filter name: none 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa7ecff9640 20 reqs_thread_entry: start 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 20 rados->read ofs=0 len=0 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33165abc0 con 0x55b331613f90 2024-09-14T10:56:22.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.895+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b33165bfb0 con 0x7fa93004f870 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.896+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.897+0000 7fa7effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.897+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228116031872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331659240 con 0x55b331613f90 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.898+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94228116031872] v37'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.898+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228116003808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331624980 con 0x7fa938019040 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.899+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94228116003808] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.899+0000 7fa941d2e800 20 remove_watcher() i=0 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.899+0000 7fa941d2e800 2 removed watcher, disabling cache 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.899+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228116011728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161dbe0 con 0x55b331613f90 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.900+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94228116011728] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.900+0000 7fa941d2e800 20 remove_watcher() i=1 2024-09-14T10:56:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.900+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228116014736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b33161fad0 con 0x55b331618890 2024-09-14T10:56:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.901+0000 7fa93e2de640 1 -- 172.21.15.164:0/299929172 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94228116014736] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9380083e0 con 0x55b331618890 2024-09-14T10:56:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.901+0000 7fa941d2e800 20 remove_watcher() i=2 2024-09-14T10:56:22.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.901+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228116018336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331620690 con 0x7fa938019040 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.902+0000 7fa93dadd640 1 -- 172.21.15.164:0/299929172 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94228116018336] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa930077d10 con 0x7fa938019040 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.903+0000 7fa941d2e800 20 remove_watcher() i=3 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.903+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228116021968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b3316214a0 con 0x55b331613f90 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.904+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94228116021968] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x55b331613f90 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.904+0000 7fa941d2e800 20 remove_watcher() i=4 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.904+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228116024096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b3316214a0 con 0x7fa93004f870 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.905+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94228116024096] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.905+0000 7fa941d2e800 20 remove_watcher() i=5 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.905+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228116025152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331622b20 con 0x7fa93004f870 2024-09-14T10:56:22.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.906+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94228116025152] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.906+0000 7fa941d2e800 20 remove_watcher() i=6 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.906+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228116030816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b331620690 con 0x7fa93004f870 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94228116030816] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa928039040 con 0x7fa93004f870 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 20 remove_watcher() i=7 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa93004f870 msgr2=0x7fa930096280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fa93004f870 0x7fa930096280 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b331613f90 msgr2=0x55b331616450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b331613f90 0x55b331616450 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa938019040 msgr2=0x7fa938023a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fa938019040 0x7fa938023a30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b331618890 msgr2=0x55b33161ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b331618890 0x55b33161ac80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa80803ce10 msgr2=0x7fa80803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa80803ce10 0x7fa80803f2d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa93005a290 tx=0x7fa930090000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 msgr2=0x55b331608410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa93d2dc640 1 -- 172.21.15.164:0/299929172 reap_dead start 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa938008fd0 tx=0x7fa9380543d0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 shutdown_connections 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 --2- 172.21.15.164:0/299929172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331600e50 0x55b331608410 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 >> 172.21.15.164:0/299929172 conn(0x55b3315fd250 msgr2=0x55b3315fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 shutdown_connections 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.907+0000 7fa941d2e800 1 -- 172.21.15.164:0/299929172 wait complete. 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 msgr2=0x7fa81803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 0x7fa81803f2d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b3315dab90 tx=0x7fa930098040 comp rx=0 tx=0).stop 2024-09-14T10:56:22.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 msgr2=0x55b3315f4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55b3315da9b0 tx=0x7fa93800af20 comp rx=0 tx=0).stop 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 shutdown_connections 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa81803ce10 0x7fa81803f2d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/2910542811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b3315f4410 0x55b3315f4830 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 >> 172.21.15.164:0/2910542811 conn(0x55b3315e87c0 msgr2=0x55b3315e8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 shutdown_connections 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/2910542811 wait complete. 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 msgr2=0x55b3315e0a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 0x55b3315e0a10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 msgr2=0x55b3315e5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 0x55b3315e5240 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 msgr2=0x7fa82403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 0x7fa82403f2d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa928001d70 tx=0x7fa9280012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 msgr2=0x55b3315d93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa930025a60 tx=0x7fa930003330 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 shutdown_connections 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b3315e2da0 0x55b3315e5240 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b3314e4e10 0x55b3315e0a10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa82403ce10 0x7fa82403f2d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 --2- 172.21.15.164:0/3913481043 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b331452ed0 0x55b3315d93c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 >> 172.21.15.164:0/3913481043 conn(0x55b3314d9fa0 msgr2=0x55b3315d2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 shutdown_connections 2024-09-14T10:56:22.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.908+0000 7fa941d2e800 1 -- 172.21.15.164:0/3913481043 wait complete. 2024-09-14T10:56:22.915 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:22.915 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:22.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-14T10:56:22.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-14T10:56:22.916 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-14T10:56:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:22.962 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.965+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.965+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.965+0000 7f3d86b75800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bc9c917b0 0x555bc9c91bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.965+0000 7f3d86b75800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555bc9c93490 con 0x555bc9c928d0 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.965+0000 7f3d86b75800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555bc9b1d7d0 con 0x555bc9c917b0 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d8465f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bc9c917b0 0x555bc9c91bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d7be5e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x555bc9c928d0 0x555bc9c92d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45424/0 (socket says 172.21.15.164:45424) 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d8465f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bc9c917b0 0x555bc9c91bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52872/0 (socket says 172.21.15.164:52872) 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2280123816 learned_addr learned my addr 172.21.15.164:0/2280123816 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:22.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d8465f640 1 -- 172.21.15.164:0/2280123816 >> v1:172.21.15.116:6789/0 conn(0x555bc9c928d0 legacy=0x555bc9c92d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.966+0000 7f3d8465f640 1 -- 172.21.15.164:0/2280123816 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9c93660 con 0x555bc9c917b0 2024-09-14T10:56:22.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2280123816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9c91bb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400a470 tx=0x7f3d74045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe02b1704d97b2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d83e5e640 1 -- 172.21.15.164:0/2280123816 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d74053570 con 0x555bc9c917b0 2024-09-14T10:56:22.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d83e5e640 1 -- 172.21.15.164:0/2280123816 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74058070 con 0x555bc9c917b0 2024-09-14T10:56:22.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d83e5e640 1 -- 172.21.15.164:0/2280123816 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d74053880 con 0x555bc9c917b0 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 -- 172.21.15.164:0/2280123816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 msgr2=0x555bc9c91bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2280123816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9c91bb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400a470 tx=0x7f3d74045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 -- 172.21.15.164:0/2280123816 shutdown_connections 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2280123816 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9c91bb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 -- 172.21.15.164:0/2280123816 >> 172.21.15.164:0/2280123816 conn(0x555bc9c8cfa0 msgr2=0x555bc9c8f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 -- 172.21.15.164:0/2280123816 shutdown_connections 2024-09-14T10:56:22.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.968+0000 7f3d86b75800 1 -- 172.21.15.164:0/2280123816 wait complete. 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d86b75800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d86b75800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bc9b2add0 con 0x555bc9c917b0 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d8465f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d8465f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52880/0 (socket says 172.21.15.164:52880) 2024-09-14T10:56:22.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d8465f640 1 -- 172.21.15.164:0/3604857505 learned_addr learned my addr 172.21.15.164:0/3604857505 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.983+0000 7f3d8465f640 1 -- 172.21.15.164:0/3604857505 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9d81d40 con 0x555bc9c917b0 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3d8465f640 1 --2- 172.21.15.164:0/3604857505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d74025c20 tx=0x7f3d74051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b514b997f69ba server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3c7260c640 1 -- 172.21.15.164:0/3604857505 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7405e2c0 con 0x555bc9c917b0 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3c7260c640 1 -- 172.21.15.164:0/3604857505 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7405e8b0 con 0x555bc9c917b0 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3c7260c640 1 -- 172.21.15.164:0/3604857505 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7405eb90 con 0x555bc9c917b0 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3d86b75800 1 -- 172.21.15.164:0/3604857505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 msgr2=0x555bc9d81750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:22.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.984+0000 7f3d86b75800 1 --2- 172.21.15.164:0/3604857505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3d74025c20 tx=0x7f3d74051000 comp rx=0 tx=0).stop 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- 172.21.15.164:0/3604857505 shutdown_connections 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 --2- 172.21.15.164:0/3604857505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d81750 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- 172.21.15.164:0/3604857505 >> 172.21.15.164:0/3604857505 conn(0x555bc9c8cfa0 msgr2=0x555bc9d7d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- 172.21.15.164:0/3604857505 shutdown_connections 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- 172.21.15.164:0/3604857505 wait complete. 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d86b75800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bc9c98dc0 con 0x555bc9c917b0 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d8465f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d8465f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52884/0 (socket says 172.21.15.164:52884) 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.985+0000 7f3d8465f640 1 -- 172.21.15.164:0/2193650167 learned_addr learned my addr 172.21.15.164:0/2193650167 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3d8465f640 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9d8c9c0 con 0x555bc9c917b0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3d74025c20 tx=0x7f3d74002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3c70e09640 1 -- 172.21.15.164:0/2193650167 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d74075070 con 0x555bc9c917b0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3c70e09640 1 -- 172.21.15.164:0/2193650167 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7405ed50 con 0x555bc9c917b0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bc9d8cc50 con 0x555bc9c917b0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3c70e09640 1 -- 172.21.15.164:0/2193650167 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d740705a0 con 0x555bc9c917b0 2024-09-14T10:56:22.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.986+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc9d8d5d0 con 0x555bc9c917b0 2024-09-14T10:56:22.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3c70e09640 1 -- 172.21.15.164:0/2193650167 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d74078070 con 0x555bc9c917b0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3c70e09640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 0x7f3c6c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3c70e09640 1 -- 172.21.15.164:0/2193650167 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d74064070 con 0x555bc9c917b0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 0x7f3c6c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 0x555bc9d93ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9d93ff0 con 0x555bc9c928d0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.987+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 0x555bc9d93ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 0x7f3c6c03f2d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c001d70 tx=0x7f3d6c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 0x555bc9d93ab0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d84e60640 1 -- 172.21.15.164:0/2193650167 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x555bc9c928d0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9d94390 con 0x555bc9c928d0 2024-09-14T10:56:22.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d84e60640 1 -- 172.21.15.164:0/2193650167 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x555bc9c928d0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 0x555bc9d98310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9d98aa0 con 0x555bc9d95e90 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.988+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 0x555bc9d98310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 0x555bc9d98310 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d8465f640 1 -- 172.21.15.164:0/2193650167 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d74077030 con 0x555bc9d95e90 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9d94be0 con 0x555bc9c928d0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d84e60640 1 -- 172.21.15.164:0/2193650167 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x555bc9c928d0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9d95030 con 0x555bc9c928d0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.989+0000 7f3d84e60640 1 -- 172.21.15.164:0/2193650167 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d7c00a4d0 con 0x555bc9c928d0 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d86b75800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d86b75800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bc9b894a0 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52894/0 (socket says 172.21.15.164:52894) 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.990+0000 7f3d84e60640 1 -- 172.21.15.164:0/1472296571 learned_addr learned my addr 172.21.15.164:0/1472296571 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3d84e60640 1 -- 172.21.15.164:0/1472296571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9da7ee0 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3d84e60640 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00a2a0 tx=0x7f3d7c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3c69ffb640 1 -- 172.21.15.164:0/1472296571 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c014450 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3c69ffb640 1 -- 172.21.15.164:0/1472296571 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0145f0 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bc9da8710 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3c69ffb640 1 -- 172.21.15.164:0/1472296571 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c014910 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.991+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc9da8cb0 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3c69ffb640 1 -- 172.21.15.164:0/1472296571 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d7c011040 con 0x555bc9da7480 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3c69ffb640 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 0x7f3c5c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3c69ffb640 1 -- 172.21.15.164:0/1472296571 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d7c01e070 con 0x555bc9da7480 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3d8465f640 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 0x7f3c5c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3d8465f640 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 0x7f3c5c03f320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555bc9d8e550 tx=0x7f3d740675f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.992+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d86b75800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d86b75800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bc9d820b0 con 0x555bc9db3ee0 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52904/0 (socket says 172.21.15.164:52904) 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d84e60640 1 -- 172.21.15.164:0/732387260 learned_addr learned my addr 172.21.15.164:0/732387260 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:22.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d84e60640 1 -- 172.21.15.164:0/732387260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9db48b0 con 0x555bc9db3ee0 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3d84e60640 1 --2- 172.21.15.164:0/732387260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c016fd0 tx=0x7f3d7c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87a6d3bd94cc64c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3c637fe640 1 -- 172.21.15.164:0/732387260 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c051020 con 0x555bc9db3ee0 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3c637fe640 1 -- 172.21.15.164:0/732387260 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c022de0 con 0x555bc9db3ee0 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.993+0000 7f3c637fe640 1 -- 172.21.15.164:0/732387260 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c028070 con 0x555bc9db3ee0 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- 172.21.15.164:0/732387260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 msgr2=0x555bc9db42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 --2- 172.21.15.164:0/732387260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c016fd0 tx=0x7f3d7c011a80 comp rx=0 tx=0).stop 2024-09-14T10:56:23.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- 172.21.15.164:0/732387260 shutdown_connections 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 --2- 172.21.15.164:0/732387260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9db42c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- 172.21.15.164:0/732387260 >> 172.21.15.164:0/732387260 conn(0x555bc9db02e0 msgr2=0x555bc9dae520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- 172.21.15.164:0/732387260 shutdown_connections 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- 172.21.15.164:0/732387260 wait complete. 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 Processor -- start 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- start start 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d86b75800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bc9db4ef0 con 0x555bc9db3ee0 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d84e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52908/0 (socket says 172.21.15.164:52908) 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.994+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 learned_addr learned my addr 172.21.15.164:0/2212349766 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bc9dbba00 con 0x555bc9db3ee0 2024-09-14T10:56:23.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0014d0 tx=0x7f3d7c054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3c61ffb640 1 -- 172.21.15.164:0/2212349766 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c016440 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3c61ffb640 1 -- 172.21.15.164:0/2212349766 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c032070 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bc9dbbc90 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3c61ffb640 1 -- 172.21.15.164:0/2212349766 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c045260 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.995+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bc9dbc610 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3c61ffb640 1 -- 172.21.15.164:0/2212349766 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3d7c045400 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3c61ffb640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5403ce10 0x7f3c5403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3c61ffb640 1 -- 172.21.15.164:0/2212349766 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3d7c00e040 con 0x555bc9db3ee0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5403ce10 0x7f3c5403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9dc71a0 0x555bc9dc9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dc9db0 con 0x555bc9dc71a0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.996+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9dc71a0 0x555bc9dc9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5403ce10 0x7f3c5403f2d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d74095f40 tx=0x7f3d7408d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9dc71a0 0x555bc9dc9660 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6c009050 con 0x555bc9dc71a0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 realm 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dc64f0 con 0x555bc9dc71a0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6c009050 con 0x555bc9dc71a0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dca890 con 0x555bc9dc71a0 2024-09-14T10:56:23.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6c009050 con 0x555bc9dc71a0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.997+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcb160 con 0x555bc9dc71a0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d6c009050 con 0x555bc9dc71a0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9dcbaa0 0x555bc9dcde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dce5d0 con 0x555bc9dcbaa0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9dcbaa0 0x555bc9dcde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9dcbaa0 0x555bc9dcde90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:23.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 20 searching for the correct realm 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.998+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d84e60640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d7c04dc20 0x7f3d7c02ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d7c04dc20 0x7f3d7c02ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d7c04dc20 0x7f3d7c02ca60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d8465f640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d7407a060 0x7f3d74053440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:22.999+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.000+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d7407a060 0x7f3d74053440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.000+0000 7f3d7be5e640 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d7407a060 0x7f3d74053440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.000+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c009050 con 0x7f3d7407a060 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.000+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.000+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c009050 con 0x555bc9dc71a0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.001+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.002+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.003+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.004+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x555bc9dc71a0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.005+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.006+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dcbaa0 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7407a060 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6c029040 con 0x7f3d7407a060 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.007+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x555bc9dc71a0 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcff60 con 0x7f3d7c04dc20 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:23.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcf050 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcec60 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dcf940 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.008+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 zone default found 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 4 Realm: () 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 zonegroup default 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd0410 con 0x7f3d7407a060 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd22f0 con 0x555bc9dcbaa0 2024-09-14T10:56:23.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd26e0 con 0x555bc9dcbaa0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 started sync module instance, tier type = 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:23.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.009+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd1690 con 0x7f3d7c04dc20 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.011+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.011+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93852717095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd2ff0 con 0x7f3d7c04dc20 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.011+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd3840 con 0x555bc9dc71a0 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.012+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93852717095552] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.012+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.012+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93852717099840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd3920 con 0x555bc9dc71a0 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.012+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd43f0 con 0x555bc9dcbaa0 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.014+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.014+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93852717099840] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.014+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93852717104864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd43b0 con 0x555bc9dcbaa0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.014+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd4e80 con 0x7f3d7c04dc20 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.015+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93852717104864] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.015+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.015+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93852717101968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd5270 con 0x7f3d7c04dc20 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.015+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd5cc0 con 0x555bc9dc71a0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.016+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93852717101968] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.016+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.016+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93852717111216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd5c80 con 0x555bc9dc71a0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.016+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd6750 con 0x7f3d7407a060 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.017+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93852717111216] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.017+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.017+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93852717107584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd6750 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.017+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd7160 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.018+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(56 notify.6 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.018+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93852717116592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd7580 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.018+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd8080 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.018+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93852717107584] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93852717116592] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93852717120368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd70d0 con 0x7f3d7407a060 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=0 2024-09-14T10:56:23.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=1 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=2 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=3 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=4 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=5 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.019+0000 7f3d86b75800 20 add_watcher() i=6 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.020+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93852717120368] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.020+0000 7f3d86b75800 20 add_watcher() i=7 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.020+0000 7f3d86b75800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.020+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9ddb180 con 0x555bc9dc71a0 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.021+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.021+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93852717113936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd8600 con 0x555bc9dc71a0 2024-09-14T10:56:23.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93852717113936] v37'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 5 note: GC not initialized 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3c397e2640 20 reqs_thread_entry: start 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 20 Filter name: none 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3baaffd640 20 reqs_thread_entry: start 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.022+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9e0dd50 con 0x555bc9dc71a0 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.023+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.023+0000 7f3d86b75800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.023+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bc9e0f140 con 0x7f3d7407a060 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.023+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.024+0000 7f3c3a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.024+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93852717113936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9e0d670 con 0x555bc9dc71a0 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.025+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93852717113936] v37'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.025+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93852717095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd6250 con 0x7f3d7c04dc20 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.026+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93852717095552] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.026+0000 7f3d86b75800 20 remove_watcher() i=0 2024-09-14T10:56:23.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.026+0000 7f3d86b75800 2 removed watcher, disabling cache 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.026+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93852717099840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd1a80 con 0x555bc9dc71a0 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.027+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93852717099840] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.027+0000 7f3d86b75800 20 remove_watcher() i=1 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.027+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93852717104864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd1a80 con 0x555bc9dcbaa0 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.029+0000 7f3d84e60640 1 -- 172.21.15.164:0/2212349766 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93852717104864] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c02a070 con 0x555bc9dcbaa0 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.029+0000 7f3d86b75800 20 remove_watcher() i=2 2024-09-14T10:56:23.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.029+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93852717101968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd1a80 con 0x7f3d7c04dc20 2024-09-14T10:56:23.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.030+0000 7f3d8465f640 1 -- 172.21.15.164:0/2212349766 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93852717101968] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d74088040 con 0x7f3d7c04dc20 2024-09-14T10:56:23.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.030+0000 7f3d86b75800 20 remove_watcher() i=3 2024-09-14T10:56:23.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.030+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93852717111216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd3390 con 0x555bc9dc71a0 2024-09-14T10:56:23.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.031+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93852717111216] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x555bc9dc71a0 2024-09-14T10:56:23.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.031+0000 7f3d86b75800 20 remove_watcher() i=4 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.031+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93852717107584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd1a80 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.032+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93852717107584] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.032+0000 7f3d86b75800 20 remove_watcher() i=5 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.032+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93852717116592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd57b0 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.033+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93852717116592] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.033+0000 7f3d86b75800 20 remove_watcher() i=6 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.033+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93852717120368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bc9dd3390 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93852717120368] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d6c039040 con 0x7f3d7407a060 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 20 remove_watcher() i=7 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d7407a060 msgr2=0x7f3d74053440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f3d7407a060 0x7f3d74053440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9dc71a0 msgr2=0x555bc9dc9660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9dc71a0 0x555bc9dc9660 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d7c04dc20 msgr2=0x7f3d7c02ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3d7c04dc20 0x7f3d7c02ca60 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9dcbaa0 msgr2=0x555bc9dcde90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.034+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9dcbaa0 0x555bc9dcde90 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5403ce10 msgr2=0x7f3c5403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5403ce10 0x7f3c5403f2d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d74095f40 tx=0x7f3d7408d000 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d7be5e640 1 -- 172.21.15.164:0/2212349766 reap_dead start 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 msgr2=0x555bc9dbb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0014d0 tx=0x7f3d7c054580 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 shutdown_connections 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2212349766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9db3ee0 0x555bc9dbb4a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 >> 172.21.15.164:0/2212349766 conn(0x555bc9db02e0 msgr2=0x555bc9dae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 shutdown_connections 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/2212349766 wait complete. 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 msgr2=0x7f3c5c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 0x7f3c5c03f320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555bc9d8e550 tx=0x7f3d740675f0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 msgr2=0x555bc9da78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00a2a0 tx=0x7f3d7c018830 comp rx=0 tx=0).stop 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 shutdown_connections 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c5c03ce60 0x7f3c5c03f320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 --2- 172.21.15.164:0/1472296571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9da7480 0x555bc9da78a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 >> 172.21.15.164:0/1472296571 conn(0x555bc9d9b830 msgr2=0x555bc9d9bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 shutdown_connections 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.035+0000 7f3d86b75800 1 -- 172.21.15.164:0/1472296571 wait complete. 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 msgr2=0x555bc9d93ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 0x555bc9d93ab0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 msgr2=0x555bc9d98310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 0x555bc9d98310 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 msgr2=0x7f3c6c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 0x7f3c6c03f2d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c001d70 tx=0x7f3d6c0012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 msgr2=0x555bc9d8c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3d74025c20 tx=0x7f3d74002fb0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 shutdown_connections 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bc9d95e90 0x555bc9d98310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bc9c928d0 0x555bc9d93ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f3c6c03ce10 0x7f3c6c03f2d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 --2- 172.21.15.164:0/2193650167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bc9c917b0 0x555bc9d8c460 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 >> 172.21.15.164:0/2193650167 conn(0x555bc9c8cfa0 msgr2=0x555bc9d7b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 shutdown_connections 2024-09-14T10:56:23.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.036+0000 7f3d86b75800 1 -- 172.21.15.164:0/2193650167 wait complete. 2024-09-14T10:56:23.042 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-14T10:00:00.000000Z","epoch":1726308000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-14T10:56:23.043 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:56:23.043 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-14T10:56:23.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-14T10:56:23.043 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-14T10:56:23.096 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:23.097 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.099+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.099+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce9f24800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5579df844fe0 0x5579df8473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce9f24800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579df8479a0 con 0x5579df7b2750 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce9f24800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5579df6c97d0 con 0x5579df844fe0 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce53d1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5579df844fe0 0x5579df8473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce53d1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5579df844fe0 0x5579df8473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52924/0 (socket says 172.21.15.164:52924) 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce53d1640 1 -- 172.21.15.164:0/1661744383 learned_addr learned my addr 172.21.15.164:0/1661744383 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce5bd2640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5579df7b2750 0x5579df8438c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45426/0 (socket says 172.21.15.164:45426) 2024-09-14T10:56:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce53d1640 1 -- 172.21.15.164:0/1661744383 >> v1:172.21.15.116:6789/0 conn(0x5579df7b2750 legacy=0x5579df8438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.100+0000 7f9ce53d1640 1 -- 172.21.15.164:0/1661744383 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df848b80 con 0x5579df844fe0 2024-09-14T10:56:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.102+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/1661744383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df844fe0 0x5579df8473d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00a520 tx=0x7f9cdc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a754e677507c3c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.102+0000 7f9ce4bd0640 1 -- 172.21.15.164:0/1661744383 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cdc055070 con 0x5579df844fe0 2024-09-14T10:56:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.102+0000 7f9ce4bd0640 1 -- 172.21.15.164:0/1661744383 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0515b0 con 0x5579df844fe0 2024-09-14T10:56:23.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.102+0000 7f9ce4bd0640 1 -- 172.21.15.164:0/1661744383 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cdc0518d0 con 0x5579df844fe0 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1661744383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df844fe0 msgr2=0x5579df8473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1661744383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df844fe0 0x5579df8473d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00a520 tx=0x7f9cdc045ba0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1661744383 shutdown_connections 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1661744383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df844fe0 0x5579df8473d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1661744383 >> 172.21.15.164:0/1661744383 conn(0x5579df838ff0 msgr2=0x5579df83b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1661744383 shutdown_connections 2024-09-14T10:56:23.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.103+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1661744383 wait complete. 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.116+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.116+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce9f24800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce9f24800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5579df6d6dd0 con 0x5579df7b2750 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce5bd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce5bd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52938/0 (socket says 172.21.15.164:52938) 2024-09-14T10:56:23.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/1263626343 learned_addr learned my addr 172.21.15.164:0/1263626343 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/1263626343 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df931080 con 0x5579df7b2750 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.117+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/1263626343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800b260 tx=0x7f9cd800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826242f9f8af9b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9bd3e07640 1 -- 172.21.15.164:0/1263626343 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd800be60 con 0x5579df7b2750 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9bd3e07640 1 -- 172.21.15.164:0/1263626343 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8006070 con 0x5579df7b2750 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9bd3e07640 1 -- 172.21.15.164:0/1263626343 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd800e710 con 0x5579df7b2750 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1263626343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 msgr2=0x5579df930a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1263626343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800b260 tx=0x7f9cd800b660 comp rx=0 tx=0).stop 2024-09-14T10:56:23.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1263626343 shutdown_connections 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1263626343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df930a90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1263626343 >> 172.21.15.164:0/1263626343 conn(0x5579df838ff0 msgr2=0x5579df92c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1263626343 shutdown_connections 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.118+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1263626343 wait complete. 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce9f24800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce9f24800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5579df847e70 con 0x5579df7b2750 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce5bd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce5bd2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52944/0 (socket says 172.21.15.164:52944) 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/3656234240 learned_addr learned my addr 172.21.15.164:0/3656234240 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.119+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df938af0 con 0x5579df7b2750 2024-09-14T10:56:23.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x5579df931a20 tx=0x7f9cd8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9bd2604640 1 -- 172.21.15.164:0/3656234240 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd800f810 con 0x5579df7b2750 2024-09-14T10:56:23.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9bd2604640 1 -- 172.21.15.164:0/3656234240 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd800f9b0 con 0x5579df7b2750 2024-09-14T10:56:23.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579df938d80 con 0x5579df7b2750 2024-09-14T10:56:23.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9bd2604640 1 -- 172.21.15.164:0/3656234240 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9cd800fcd0 con 0x5579df7b2750 2024-09-14T10:56:23.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.120+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579df939780 con 0x5579df7b2750 2024-09-14T10:56:23.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9bd2604640 1 -- 172.21.15.164:0/3656234240 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9cd8017070 con 0x5579df7b2750 2024-09-14T10:56:23.123 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9bd2604640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 0x7f9bcc03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9bd2604640 1 -- 172.21.15.164:0/3656234240 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9cd8015020 con 0x5579df7b2750 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 0x7f9bcc03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 0x5579df93fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df940120 con 0x5579df844fe0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 0x5579df93fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.121+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 0x7f9bcc03f320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc057000 tx=0x7f9cdc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 0x5579df93fbe0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce63d3640 1 -- 172.21.15.164:0/3656234240 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ce000a4d0 con 0x5579df844fe0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9404c0 con 0x5579df844fe0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce63d3640 1 -- 172.21.15.164:0/3656234240 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ce000a4d0 con 0x5579df844fe0 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 0x5579df944440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df944bd0 con 0x5579df941fc0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.122+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 0x5579df944440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 0x5579df944440 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/3656234240 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9cd802e070 con 0x5579df941fc0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df940d10 con 0x5579df844fe0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce63d3640 1 -- 172.21.15.164:0/3656234240 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ce000a4d0 con 0x5579df844fe0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df941130 con 0x5579df844fe0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.123+0000 7f9ce63d3640 1 -- 172.21.15.164:0/3656234240 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ce000a4d0 con 0x5579df844fe0 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce9f24800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce9f24800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5579df7354a0 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52948/0 (socket says 172.21.15.164:52948) 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce63d3640 1 -- 172.21.15.164:0/1291996198 learned_addr learned my addr 172.21.15.164:0/1291996198 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.124+0000 7f9ce63d3640 1 -- 172.21.15.164:0/1291996198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df953ff0 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x5579df93a430 tx=0x7f9ce0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9bcb7fe640 1 -- 172.21.15.164:0/1291996198 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0014450 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9bcb7fe640 1 -- 172.21.15.164:0/1291996198 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce00145f0 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579df954820 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9bcb7fe640 1 -- 172.21.15.164:0/1291996198 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0014910 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.125+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579df954dc0 con 0x5579df953590 2024-09-14T10:56:23.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9bcb7fe640 1 -- 172.21.15.164:0/1291996198 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9ce0011040 con 0x5579df953590 2024-09-14T10:56:23.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9bcb7fe640 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 0x7f9bc003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9bcb7fe640 1 -- 172.21.15.164:0/1291996198 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9ce001e070 con 0x5579df953590 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 0x7f9bc003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.126+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 0x7f9bc003f320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5579df93a680 tx=0x7f9cd80531e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce9f24800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce9f24800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5579df9314b0 con 0x5579df95fff0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52956/0 (socket says 172.21.15.164:52956) 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce63d3640 1 -- 172.21.15.164:0/1999126913 learned_addr learned my addr 172.21.15.164:0/1999126913 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce63d3640 1 -- 172.21.15.164:0/1999126913 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df9609e0 con 0x5579df95fff0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/1999126913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0016620 tx=0x7f9ce0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c560b157892e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9bc97fa640 1 -- 172.21.15.164:0/1999126913 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0051020 con 0x5579df95fff0 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9bc97fa640 1 -- 172.21.15.164:0/1999126913 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce0022de0 con 0x5579df95fff0 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.127+0000 7f9bc97fa640 1 -- 172.21.15.164:0/1999126913 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0028070 con 0x5579df95fff0 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1999126913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 msgr2=0x5579df9603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1999126913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0016620 tx=0x7f9ce0011a80 comp rx=0 tx=0).stop 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1999126913 shutdown_connections 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1999126913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df9603f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1999126913 >> 172.21.15.164:0/1999126913 conn(0x5579df95c3f0 msgr2=0x5579df95a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1999126913 shutdown_connections 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1999126913 wait complete. 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 Processor -- start 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- start start 2024-09-14T10:56:23.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df967610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce9f24800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5579df961000 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df967610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce63d3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df967610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52962/0 (socket says 172.21.15.164:52962) 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.128+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 learned_addr learned my addr 172.21.15.164:0/2017155429 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579df967b70 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df967610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0022f90 tx=0x7f9ce0054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9bb77fe640 1 -- 172.21.15.164:0/2017155429 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0011bc0 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9bb77fe640 1 -- 172.21.15.164:0/2017155429 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce002b350 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579df967e00 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9bb77fe640 1 -- 172.21.15.164:0/2017155429 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ce0001e60 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.129+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579df968780 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.130+0000 7f9bb77fe640 1 -- 172.21.15.164:0/2017155429 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9ce0034030 con 0x5579df95fff0 2024-09-14T10:56:23.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.130+0000 7f9bb77fe640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bb003ce10 0x7f9bb003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.130+0000 7f9bb77fe640 1 -- 172.21.15.164:0/2017155429 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9ce0032070 con 0x5579df95fff0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.130+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bb003ce10 0x7f9bb003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bb003ce10 0x7f9bb003f2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000fb0 tx=0x7f9cd8028000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df9733a0 0x5579df975860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df975fb0 con 0x5579df9733a0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df9733a0 0x5579df975860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df9733a0 0x5579df975860 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 20 realm 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.131+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9763e0 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df976cb0 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df977050 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df977db0 0x5579df97a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97a7b0 con 0x5579df977db0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.132+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df977db0 0x5579df97a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df977db0 0x5579df97a1a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ce002a070 con 0x5579df977db0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce9f24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce9f24800 20 searching for the correct realm 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ce002a070 con 0x5579df977db0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce63d3640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9ce0014070 0x7f9ce0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.133+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9ce0014070 0x7f9ce0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9ce0014070 0x7f9ce0036410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce5bd2640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9cd803d070 0x7f9cd804d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9cd803d070 0x7f9cd804d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.134+0000 7f9ce53d1640 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9cd803d070 0x7f9cd804d660 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.135+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce002a070 con 0x5579df977db0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.136+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce002a070 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.137+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.138+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.139+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x5579df9733a0 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc057030 con 0x7f9cd803d070 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.140+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df977db0 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9cd803d070 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x5579df9733a0 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.141+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c0a0 con 0x7f9ce0014070 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:23.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97b170 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97b9c0 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c520 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.142+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 zone default found 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 4 Realm: () 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 zonegroup default 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97c8c0 con 0x7f9cd803d070 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97e6a0 con 0x5579df977db0 2024-09-14T10:56:23.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df97ebc0 con 0x5579df977db0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 started sync module instance, tier type = 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.143+0000 7f9ce9f24800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.144+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97db40 con 0x7f9ce0014070 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.145+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.145+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981930676016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97d7a0 con 0x7f9ce0014070 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.145+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97faf0 con 0x5579df9733a0 2024-09-14T10:56:23.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.146+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981930676016] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.146+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.146+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981930681920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97ff10 con 0x5579df9733a0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.146+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df980910 con 0x5579df977db0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.147+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981930681920] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.147+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.147+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981930685472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97ff10 con 0x5579df977db0 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.147+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9813a0 con 0x7f9ce0014070 2024-09-14T10:56:23.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.148+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981930685472] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.148+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.148+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981930682976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97fe80 con 0x7f9ce0014070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.148+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df982260 con 0x5579df9733a0 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.149+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981930682976] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.149+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.149+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981930692016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9821d0 con 0x5579df9733a0 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.149+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df983120 con 0x7f9cd803d070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.150+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.150+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981930695792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df983090 con 0x7f9cd803d070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.150+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df984040 con 0x7f9cd803d070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.151+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981930692016] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.151+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981930695792] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.152+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.152+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981930694224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df983b60 con 0x7f9cd803d070 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.152+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df984520 con 0x7f9cd803d070 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981930700912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df984940 con 0x7f9cd803d070 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=0 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=1 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=2 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=3 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=4 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=5 2024-09-14T10:56:23.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981930694224] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.153+0000 7f9ce9f24800 20 add_watcher() i=6 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981930700912] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce9f24800 20 add_watcher() i=7 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce9f24800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9834a0 con 0x5579df9733a0 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.156+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981930701968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9834a0 con 0x5579df9733a0 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981930701968] v37'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9b977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9ce9f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9ce9f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:23.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9ce9f24800 5 note: GC not initialized 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.157+0000 7f9b967fc640 20 reqs_thread_entry: start 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 Filter name: none 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9b07fff640 20 reqs_thread_entry: start 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9bab50 con 0x7f9cd803d070 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T10:56:23.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9b91f0 con 0x5579df9733a0 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.158+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9b9a90 con 0x7f9cd803d070 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v37'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce9f24800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce9f24800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:56:23.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce9f24800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93981930919392 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9be490 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== watch-notify(notify (1) cookie 93981930700912 notify 158913789983 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5579df9b9e30 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9bc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 93981930700912 notifier 4738 bl.length()=556 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9bc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9bc97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(65 notify.7 [notify cookie 93981930919392 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9bc97fa640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f9ba8003ea0 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.160+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== watch-notify(notify_complete (2) cookie 93981930919392 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579df9ba4a0 con 0x7f9cd803d070 2024-09-14T10:56:23.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.161+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9b9590 con 0x5579df9733a0 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce9f24800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce9f24800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce9f24800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93981930919264 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5579df9be490 con 0x7f9cd803d070 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify (1) cookie 93981930695792 notify 158913789984 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5579df9ba4a0 con 0x7f9cd803d070 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9bc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789984 cookie 93981930695792 notifier 4738 bl.length()=177 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9bc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9bc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9bc8ff9640 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f9b10003400 con 0x7f9cd803d070 2024-09-14T10:56:23.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(68 notify.5 [notify cookie 93981930919264 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.162+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== watch-notify(notify_complete (2) cookie 93981930919264 notify 158913789984 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5579df848b80 con 0x7f9cd803d070 2024-09-14T10:56:23.173 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-14T10:56:23.159783Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:56:23.159770Z","tags":[],"group_ids":[]} 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.163+0000 7f9b977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.163+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981930701968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9b8870 con 0x5579df9733a0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.164+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93981930701968] v37'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.164+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981930676016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df9b8870 con 0x7f9ce0014070 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.165+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93981930676016] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.165+0000 7f9ce9f24800 20 remove_watcher() i=0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.165+0000 7f9ce9f24800 2 removed watcher, disabling cache 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.165+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981930681920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97df30 con 0x5579df9733a0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.166+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93981930681920] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.167+0000 7f9ce9f24800 20 remove_watcher() i=1 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.167+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981930685472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97f640 con 0x5579df977db0 2024-09-14T10:56:23.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.168+0000 7f9ce63d3640 1 -- 172.21.15.164:0/2017155429 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93981930685472] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ce0061040 con 0x5579df977db0 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.168+0000 7f9ce9f24800 20 remove_watcher() i=2 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.168+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981930682976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97df30 con 0x7f9ce0014070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.169+0000 7f9ce5bd2640 1 -- 172.21.15.164:0/2017155429 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93981930682976] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cd802e070 con 0x7f9ce0014070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.169+0000 7f9ce9f24800 20 remove_watcher() i=3 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.169+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981930692016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df980420 con 0x5579df9733a0 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.170+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93981930692016] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x5579df9733a0 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.170+0000 7f9ce9f24800 20 remove_watcher() i=4 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.170+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981930695792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df97df30 con 0x7f9cd803d070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.171+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93981930695792] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.171+0000 7f9ce9f24800 20 remove_watcher() i=5 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.171+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981930694224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df981db0 con 0x7f9cd803d070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.172+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93981930694224] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.172+0000 7f9ce9f24800 20 remove_watcher() i=6 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.172+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981930700912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5579df980420 con 0x7f9cd803d070 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93981930700912] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9cdc089040 con 0x7f9cd803d070 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 20 remove_watcher() i=7 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9cd803d070 msgr2=0x7f9cd804d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f9cd803d070 0x7f9cd804d660 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df9733a0 msgr2=0x5579df975860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df9733a0 0x5579df975860 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9ce0014070 msgr2=0x7f9ce0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9ce0014070 0x7f9ce0036410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df977db0 msgr2=0x5579df97a1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.173+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df977db0 0x5579df97a1a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bb003ce10 msgr2=0x7f9bb003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bb003ce10 0x7f9bb003f2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8000fb0 tx=0x7f9cd8028000 comp rx=0 tx=0).stop 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 msgr2=0x5579df967610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/2017155429 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df95fff0 0x5579df967610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0022f90 tx=0x7f9ce0054510 comp rx=0 tx=0).stop 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 reap_dead start 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce53d1640 1 -- 172.21.15.164:0/2017155429 reap_dead start 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 shutdown_connections 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 >> 172.21.15.164:0/2017155429 conn(0x5579df95c3f0 msgr2=0x5579df95a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 shutdown_connections 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/2017155429 wait complete. 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 msgr2=0x7f9bc003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 0x7f9bc003f320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5579df93a680 tx=0x7f9cd80531e0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 msgr2=0x5579df9539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x5579df93a430 tx=0x7f9ce0018830 comp rx=0 tx=0).stop 2024-09-14T10:56:23.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 shutdown_connections 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bc003ce60 0x7f9bc003f320 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/1291996198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df953590 0x5579df9539b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 >> 172.21.15.164:0/1291996198 conn(0x5579df947940 msgr2=0x5579df947d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 shutdown_connections 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/1291996198 wait complete. 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 msgr2=0x5579df93fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 0x5579df93fbe0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 msgr2=0x5579df944440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.174+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 0x5579df944440 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 msgr2=0x7f9bcc03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 0x7f9bcc03f320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc057000 tx=0x7f9cdc052000 comp rx=0 tx=0).stop 2024-09-14T10:56:23.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 msgr2=0x5579df938590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x5579df931a20 tx=0x7f9cd8000ed0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 shutdown_connections 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5579df941fc0 0x5579df944440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5579df844fe0 0x5579df93fbe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f9bcc03ce60 0x7f9bcc03f320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 --2- 172.21.15.164:0/3656234240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5579df7b2750 0x5579df938590 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 >> 172.21.15.164:0/3656234240 conn(0x5579df838ff0 msgr2=0x5579df931f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 shutdown_connections 2024-09-14T10:56:23.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.175+0000 7f9ce9f24800 1 -- 172.21.15.164:0/3656234240 wait complete. 2024-09-14T10:56:23.184 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-14T10:56:23.159783Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:56:23.159770Z', 'tags': [], 'group_ids': []} 2024-09-14T10:56:23.197 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:56:23.202 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-14T10:56:23.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-14T10:56:23.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-14T10:56:23.203 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-14T10:56:23.249 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:23.249 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.252+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.252+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.252+0000 7f81c2220800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ed61fbb6f0 0x55ed6204c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.252+0000 7f81c2220800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed62050930 con 0x55ed6204ce20 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.252+0000 7f81c2220800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55ed61ed27d0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bfd0a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ed61fbb6f0 0x55ed6204c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bfd0a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55ed61fbb6f0 0x55ed6204c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52964/0 (socket says 172.21.15.164:52964) 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bfd0a640 1 -- 172.21.15.164:0/1815685531 learned_addr learned my addr 172.21.15.164:0/1815685531 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bf509640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55ed6204ce20 0x55ed6204f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45438/0 (socket says 172.21.15.164:45438) 2024-09-14T10:56:23.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bfd0a640 1 -- 172.21.15.164:0/1815685531 >> v1:172.21.15.116:6789/0 conn(0x55ed6204ce20 legacy=0x55ed6204f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.253+0000 7f81bfd0a640 1 -- 172.21.15.164:0/1815685531 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed62051b40 con 0x55ed61fbb6f0 2024-09-14T10:56:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/1815685531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed6204c8e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae80366a0ceab8d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81bed08640 1 -- 172.21.15.164:0/1815685531 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b004e600 con 0x55ed61fbb6f0 2024-09-14T10:56:23.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81bed08640 1 -- 172.21.15.164:0/1815685531 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b004e7a0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81bed08640 1 -- 172.21.15.164:0/1815685531 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b004eaa0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81c2220800 1 -- 172.21.15.164:0/1815685531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 msgr2=0x55ed6204c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81c2220800 1 --2- 172.21.15.164:0/1815685531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed6204c8e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0045cf0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81c2220800 1 -- 172.21.15.164:0/1815685531 shutdown_connections 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81c2220800 1 --2- 172.21.15.164:0/1815685531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed6204c8e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.255+0000 7f81c2220800 1 -- 172.21.15.164:0/1815685531 >> 172.21.15.164:0/1815685531 conn(0x55ed62041fd0 msgr2=0x55ed62044410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.256+0000 7f81c2220800 1 -- 172.21.15.164:0/1815685531 shutdown_connections 2024-09-14T10:56:23.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.256+0000 7f81c2220800 1 -- 172.21.15.164:0/1815685531 wait complete. 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.269+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81c2220800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81c2220800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ed61edfdd0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81bfd0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81bfd0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52978/0 (socket says 172.21.15.164:52978) 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2362364674 learned_addr learned my addr 172.21.15.164:0/2362364674 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.270+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2362364674 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed62139f90 con 0x55ed61fbb6f0 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2362364674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374d961c303eb5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f80ade0b640 1 -- 172.21.15.164:0/2362364674 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b004eb40 con 0x55ed61fbb6f0 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f80ade0b640 1 -- 172.21.15.164:0/2362364674 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b0066070 con 0x55ed61fbb6f0 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f80ade0b640 1 -- 172.21.15.164:0/2362364674 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b004ee50 con 0x55ed61fbb6f0 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 -- 172.21.15.164:0/2362364674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 msgr2=0x55ed621399a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 --2- 172.21.15.164:0/2362364674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0050000 comp rx=0 tx=0).stop 2024-09-14T10:56:23.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 -- 172.21.15.164:0/2362364674 shutdown_connections 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 --2- 172.21.15.164:0/2362364674 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed621399a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 -- 172.21.15.164:0/2362364674 >> 172.21.15.164:0/2362364674 conn(0x55ed62041fd0 msgr2=0x55ed62135320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 -- 172.21.15.164:0/2362364674 shutdown_connections 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.271+0000 7f81c2220800 1 -- 172.21.15.164:0/2362364674 wait complete. 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81c2220800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81c2220800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ed62050e00 con 0x55ed61fbb6f0 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81bfd0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81bfd0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:52988/0 (socket says 172.21.15.164:52988) 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.272+0000 7f81bfd0a640 1 -- 172.21.15.164:0/291136904 learned_addr learned my addr 172.21.15.164:0/291136904 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f81bfd0a640 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed621418c0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f80a7fff640 1 -- 172.21.15.164:0/291136904 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b006d420 con 0x55ed61fbb6f0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f80a7fff640 1 -- 172.21.15.164:0/291136904 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b0071030 con 0x55ed61fbb6f0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed62141b50 con 0x55ed61fbb6f0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f80a7fff640 1 -- 172.21.15.164:0/291136904 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b006d6f0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.273+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed62142550 con 0x55ed61fbb6f0 2024-09-14T10:56:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.274+0000 7f80a7fff640 1 -- 172.21.15.164:0/291136904 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81b006d9a0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.274+0000 7f80a7fff640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 0x7f80a803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.274+0000 7f80a7fff640 1 -- 172.21.15.164:0/291136904 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81b0098ca0 con 0x55ed61fbb6f0 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.274+0000 7f81bf509640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 0x7f80a803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 0x55ed621489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62143140 con 0x55ed6204ce20 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c050b640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 0x55ed621489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81bf509640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 0x7f80a803f2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f81a8001e30 tx=0x7f81a8001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c050b640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 0x55ed621489b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c050b640 1 -- 172.21.15.164:0/291136904 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed6204ce20 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.275+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62149430 con 0x55ed6204ce20 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c050b640 1 -- 172.21.15.164:0/291136904 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed6204ce20 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 0x55ed6214d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6214d970 con 0x55ed6214ad40 2024-09-14T10:56:23.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 0x55ed6214d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 0x55ed6214d1e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81bfd0a640 1 -- 172.21.15.164:0/291136904 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81b007d070 con 0x55ed6214ad40 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62149c80 con 0x55ed6204ce20 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c050b640 1 -- 172.21.15.164:0/291136904 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed6204ce20 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.276+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6214a020 con 0x55ed6204ce20 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.277+0000 7f81c050b640 1 -- 172.21.15.164:0/291136904 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed6204ce20 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.277+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.277+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.277+0000 7f81c2220800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.277+0000 7f81c2220800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ed61f3e4a0 con 0x55ed6215c380 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53004/0 (socket says 172.21.15.164:53004) 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c050b640 1 -- 172.21.15.164:0/2945827548 learned_addr learned my addr 172.21.15.164:0/2945827548 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c050b640 1 -- 172.21.15.164:0/2945827548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6215cde0 con 0x55ed6215c380 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c050b640 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55ed62142950 tx=0x7f81b800af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f80a57fa640 1 -- 172.21.15.164:0/2945827548 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8007d60 con 0x55ed6215c380 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f80a57fa640 1 -- 172.21.15.164:0/2945827548 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b801e020 con 0x55ed6215c380 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed6215d610 con 0x55ed6215c380 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f80a57fa640 1 -- 172.21.15.164:0/2945827548 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8019590 con 0x55ed6215c380 2024-09-14T10:56:23.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.278+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed6215dbb0 con 0x55ed6215c380 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.279+0000 7f80a57fa640 1 -- 172.21.15.164:0/2945827548 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81b8016040 con 0x55ed6215c380 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.279+0000 7f80a57fa640 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 0x7f809803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.279+0000 7f80a57fa640 1 -- 172.21.15.164:0/2945827548 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81b801f030 con 0x55ed6215c380 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.279+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 0x7f809803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.279+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 0x7f809803f2d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81b00461a0 tx=0x7f81b006b940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c2220800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c2220800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ed6213a300 con 0x55ed62168dc0 2024-09-14T10:56:23.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53010/0 (socket says 172.21.15.164:53010) 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c050b640 1 -- 172.21.15.164:0/3253702779 learned_addr learned my addr 172.21.15.164:0/3253702779 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c050b640 1 -- 172.21.15.164:0/3253702779 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed621697b0 con 0x55ed62168dc0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f81c050b640 1 --2- 172.21.15.164:0/3253702779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f81b8054440 tx=0x7f81b8045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e2a0f20de11039 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f809effd640 1 -- 172.21.15.164:0/3253702779 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b801d040 con 0x55ed62168dc0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f809effd640 1 -- 172.21.15.164:0/3253702779 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8051070 con 0x55ed62168dc0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.280+0000 7f809effd640 1 -- 172.21.15.164:0/3253702779 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8014340 con 0x55ed62168dc0 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- 172.21.15.164:0/3253702779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 msgr2=0x55ed621691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 --2- 172.21.15.164:0/3253702779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f81b8054440 tx=0x7f81b8045490 comp rx=0 tx=0).stop 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- 172.21.15.164:0/3253702779 shutdown_connections 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 --2- 172.21.15.164:0/3253702779 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed621691c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- 172.21.15.164:0/3253702779 >> 172.21.15.164:0/3253702779 conn(0x55ed621651c0 msgr2=0x55ed62163400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- 172.21.15.164:0/3253702779 shutdown_connections 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- 172.21.15.164:0/3253702779 wait complete. 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 Processor -- start 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- start start 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.281+0000 7f81c2220800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55ed62169dd0 con 0x55ed62168dc0 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c050b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53012/0 (socket says 172.21.15.164:53012) 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 learned_addr learned my addr 172.21.15.164:0/2356040336 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed621708e0 con 0x55ed62168dc0 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c050b640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f81b80454d0 tx=0x7f81b80543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f809d7fa640 1 -- 172.21.15.164:0/2356040336 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b801d030 con 0x55ed62168dc0 2024-09-14T10:56:23.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f809d7fa640 1 -- 172.21.15.164:0/2356040336 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b8016330 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed62170b70 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f809d7fa640 1 -- 172.21.15.164:0/2356040336 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b8016670 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.282+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed621714f0 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.283+0000 7f809d7fa640 1 -- 172.21.15.164:0/2356040336 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81b80169f0 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.283+0000 7f809d7fa640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f808803ce60 0x7f808803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.283+0000 7f809d7fa640 1 -- 172.21.15.164:0/2356040336 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81b8033030 con 0x55ed62168dc0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.283+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f808803ce60 0x7f808803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f808803ce60 0x7f808803f320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f81b006b010 tx=0x7f81b008b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6217bec0 0x55ed6217e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6217ead0 con 0x55ed6217bec0 2024-09-14T10:56:23.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81bf509640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6217bec0 0x55ed6217e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81bf509640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6217bec0 0x55ed6217e380 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a800f610 con 0x55ed6217bec0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 20 realm 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.284+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6217b210 con 0x55ed6217bec0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a800f610 con 0x55ed6217bec0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6217f5c0 con 0x55ed6217bec0 2024-09-14T10:56:23.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a800f610 con 0x55ed6217bec0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6217fe90 con 0x55ed6217bec0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81a800f610 con 0x55ed6217bec0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed621808b0 0x55ed62182ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.285+0000 7f81c050b640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed621808b0 0x55ed62182ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c050b640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed621808b0 0x55ed62182ca0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c2220800 20 searching for the correct realm 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed62184cd0 con 0x55ed621808b0 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c050b640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81b8019040 0x7f81b8046a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.286+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81b8019040 0x7f81b8046a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81b8019040 0x7f81b8046a00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bfd0a640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81b006d040 0x7f81b006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:23.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bf509640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81b006d040 0x7f81b006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.287+0000 7f81bf509640 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81b006d040 0x7f81b006a890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a800f610 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a800f610 con 0x55ed6217bec0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.288+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.289+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.290+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.291+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.292+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x55ed6217bec0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.293+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed621808b0 2024-09-14T10:56:23.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b006d040 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a802b040 con 0x7f81b006d040 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x55ed6217bec0 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.294+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ed621833e0 con 0x7f81b8019040 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:23.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62183ca0 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62184040 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.295+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62184460 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 zone default found 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 4 Realm: () 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 zonegroup default 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62185150 con 0x7f81b006d040 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62186ff0 con 0x55ed621808b0 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed62187390 con 0x55ed621808b0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 started sync module instance, tier type = 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.296+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62186430 con 0x7f81b8019040 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.297+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.297+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94478041374592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621877d0 con 0x7f81b8019040 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.297+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62188020 con 0x55ed6217bec0 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.298+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94478041374592] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.299+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.299+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94478041381744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62188440 con 0x55ed6217bec0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.299+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62188d10 con 0x55ed621808b0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.300+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.300+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94478041384000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621888c0 con 0x55ed621808b0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.300+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62189d00 con 0x7f81b8019040 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.300+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94478041381744] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.301+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94478041384000] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.301+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.301+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94478041387264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed62187f90 con 0x7f81b8019040 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.301+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218a5e0 con 0x55ed6217bec0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.302+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94478041387264] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.302+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.318 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.302+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94478041389008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218a9d0 con 0x55ed6217bec0 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.302+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218b410 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.303+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94478041389008] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.303+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.303+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94478041394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218b3d0 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.303+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218be20 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.304+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94478041394912] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.304+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.304+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94478041391344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218be20 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.304+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218c820 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94478041400112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218cc00 con 0x7f81b006d040 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=0 2024-09-14T10:56:23.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=1 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=2 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=3 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=4 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=5 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94478041391344] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.305+0000 7f81c2220800 20 add_watcher() i=6 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.306+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94478041400112] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.306+0000 7f81c2220800 20 add_watcher() i=7 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.306+0000 7f81c2220800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.306+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218cc00 con 0x55ed6217bec0 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.307+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.307+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94478041401168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed6218cb70 con 0x55ed6217bec0 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94478041401168] v37'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f8075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81c2220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81c2220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81c2220800 5 note: GC not initialized 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f8074fe1640 20 reqs_thread_entry: start 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81c2220800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.308+0000 7f81c2220800 20 Filter name: none 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f7fee7fc640 20 reqs_thread_entry: start 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c2f50 con 0x7f81b006d040 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:56:23.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.309+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c7100 con 0x7f81b8019040 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.310+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v37'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.310+0000 7f81c2220800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.310+0000 7f81c2220800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.310+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.310+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94478041635568 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c7db0 con 0x7f81b006d040 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== watch-notify(notify (1) cookie 94478041394912 notify 158913789985 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f81a8018040 con 0x7f81b006d040 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(64 notify.5 [notify cookie 94478041635568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789985 cookie 94478041394912 notifier 4745 bl.length()=382 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f809effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:56:23.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f809effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x7f81b006d040 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.311+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== watch-notify(notify_complete (2) cookie 94478041635568 notify 158913789985 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81a8009050 con 0x7f81b006d040 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c7cb0 con 0x55ed6217bec0 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 : miss 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 20 rados->read ofs=0 len=0 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 8.17 8:ee723d9c:root::.bucket.meta.myfoo6%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c52e0 con 0x55ed6217bec0 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 20 rados_obj.operate() r=0 bl.length=388 2024-09-14T10:56:23.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.312+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 8.17 8:ee723d9c:root::.bucket.meta.myfoo6%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621ceff0 con 0x55ed6217bec0 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9, ofs0, ns] 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify cookie 94478041633120 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621cdc60 con 0x55ed621808b0 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94478041384000 notify 158913789965 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55ed62170b70 con 0x55ed621808b0 2024-09-14T10:56:23.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789965 cookie 94478041384000 notifier 4745 bl.length()=756 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f809effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f809effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f809effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(69 notify.2 [notify cookie 94478041633120 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x55ed621808b0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== watch-notify(notify_complete (2) cookie 94478041633120 notify 158913789965 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed621708e0 con 0x55ed621808b0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(70 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): orig_sources= new_sources= 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): potential sources added=[] removed=[] 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): orig_dests= new_dests= 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): potential dests added=[] removed=[] 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.314+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621cd7b0 con 0x55ed6217bec0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.315+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(71 bud.buckets [call] v37'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.315+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621cd7b0 con 0x55ed6217bec0 2024-09-14T10:56:23.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.316+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(72 bud.buckets [call] v37'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.316+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621ce7c0 con 0x55ed6217bec0 2024-09-14T10:56:23.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.317+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v37'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.317+0000 7f81c2220800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-14T10:56:23.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.317+0000 7f81c2220800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.317+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.317+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94478041633120 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621ce7c0 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== watch-notify(notify (1) cookie 94478041387264 notify 158913789967 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55ed62142550 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789967 cookie 94478041387264 notifier 4745 bl.length()=316 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f809effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f809effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(74 notify.3 [notify cookie 94478041633120 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== watch-notify(notify_complete (2) cookie 94478041633120 notify 158913789967 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed62141b50 con 0x7f81b8019040 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81c2220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 : hit (requested=0x17, cached=0x17) 2024-09-14T10:56:23.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81c2220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.318+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 8.17 8:ee723d9c:root::.bucket.meta.myfoo6%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c63c0 con 0x55ed6217bec0 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(76 .bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81c2220800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81c2220800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81c2220800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9, ofs0, ns] 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.319+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94478041635280 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c62a0 con 0x55ed621808b0 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== watch-notify(notify (1) cookie 94478041384000 notify 158913789966 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55ed621708e0 con 0x55ed621808b0 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f809e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789966 cookie 94478041384000 notifier 4745 bl.length()=756 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(77 notify.2 [notify cookie 94478041635280 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f809e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f809e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:23.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f809e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f809e7fc640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7ff4003470 con 0x55ed621808b0 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== watch-notify(notify_complete (2) cookie 94478041635280 notify 158913789966 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed621697b0 con 0x55ed621808b0 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): orig_sources= new_sources= 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): potential sources added=[] removed=[] 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): orig_dests= new_dests= 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 20 handle_bi_update(): bucket=:myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]): potential dests added=[] removed=[] 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:79 4.b 4:d2abc621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c5e80 con 0x7f81b8019040 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(79 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.320+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:80 4.0 4:03c4d30e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x55ed621808b0 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(80 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 4.3c 4:3c747564:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x55ed6217bec0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(81 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:82 4.a 4:51a0a079:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x7f81b8019040 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(82 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:83 4.10 4:0848cea7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x55ed621808b0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(83 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.321+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:84 4.2d 4:b5da66e9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x7f81b006d040 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.322+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(84 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.322+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:85 4.32 4:4c8b2d46:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x55ed6217bec0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.322+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(85 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.322+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:86 4.18 4:19272cdf:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x7f81b8019040 2024-09-14T10:56:23.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(86 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:87 4.1 4:82670c60:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c59d0 con 0x7f81b8019040 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(87 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:88 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c5e60 con 0x7f81b8019040 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(88 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [call out=382b] v0'0 uv8 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81c2220800 10 cls_bucket_list_unordered: got thirteen 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 4.30 4:0db66f61:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c5e60 con 0x55ed621808b0 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.323+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 get_obj_state: octx=0x7f81b80159b0 obj=myfoo6:thirteen state=0x55ed621cd998 s->prefetch_data=0 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:90 3.1fs0 3:f8a80501:::4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c5e60 con 0x55ed6217bec0 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(90 4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen [call out=24b,getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 280+0+896 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 10 manifest: total_size = 8 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.11448065645767022403 2024-09-14T10:56:23.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 get_obj_state: octx=0x7f81b80159b0 obj=myfoo6:thirteen state=0x55ed621cd998 s->prefetch_data=0 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 : hit (requested=0x17, cached=0x17) 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.324+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:91 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d26c0 con 0x7f81b8019040 2024-09-14T10:56:23.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.325+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(91 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [stat,call,call] v37'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.325+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:92 3.1fs0 3:f8a80501:::4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d0b50 con 0x55ed6217bec0 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.326+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(92 4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v37'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.326+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d06a0 con 0x7f81b8019040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:1 objects processed in :myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9]). Next marker thirteen 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.327+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d06a0 con 0x7f81b8019040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(93 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [stat,call,call] v37'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f809e7fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v37'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81c2220800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81c2220800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94478041681072 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621cc3f0 con 0x7f81b006d040 2024-09-14T10:56:23.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify (1) cookie 94478041394912 notify 158913789986 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ed621c56d0 con 0x7f81b006d040 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789986 cookie 94478041394912 notifier 4745 bl.length()=556 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(95 notify.5 [notify cookie 94478041681072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f809effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f809effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.328+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x7f81b006d040 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.329+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== watch-notify(notify_complete (2) cookie 94478041681072 notify 158913789986 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed621cc220 con 0x7f81b006d040 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.329+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.329+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d0cb0 con 0x55ed6217bec0 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81c2220800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81c2220800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:56:23.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94478041681072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d06a0 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== watch-notify(notify (1) cookie 94478041394912 notify 158913789987 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ed621cc220 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789987 cookie 94478041394912 notifier 4745 bl.length()=177 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(98 notify.5 [notify cookie 94478041681072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f809effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f809effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.330+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.331+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.331+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== watch-notify(notify_complete (2) cookie 94478041681072 notify 158913789987 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ed621c4ae0 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.331+0000 7f81c2220800 10 removing user index: bar 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.331+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621d0cb0 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(100 bar [delete] v37'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81c2220800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81c2220800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94478041681072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ed621cc3f0 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== watch-notify(notify (1) cookie 94478041400112 notify 158913789988 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ed621c4ae0 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f809effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789988 cookie 94478041400112 notifier 4745 bl.length()=152 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f809effd640 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f8084003ea0 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(101 notify.7 [notify cookie 94478041681072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== watch-notify(notify_complete (2) cookie 94478041681072 notify 158913789988 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81a8009050 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.332+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.344 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-14T10:56:23.159783Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:56:23.159770Z","tags":[],"group_ids":[]} 2024-09-14T10:56:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.333+0000 7f8075fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.333+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94478041401168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x55ed6217bec0 2024-09-14T10:56:23.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.334+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94478041401168] v37'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.334+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94478041374592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x7f81b8019040 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.335+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94478041374592] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.335+0000 7f81c2220800 20 remove_watcher() i=0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.335+0000 7f81c2220800 2 removed watcher, disabling cache 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.335+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94478041381744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x55ed6217bec0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.336+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94478041381744] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.337+0000 7f81c2220800 20 remove_watcher() i=1 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.337+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94478041384000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x55ed621808b0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.338+0000 7f81c050b640 1 -- 172.21.15.164:0/2356040336 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94478041384000] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b80083e0 con 0x55ed621808b0 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.338+0000 7f81c2220800 20 remove_watcher() i=2 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.338+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94478041387264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x7f81b8019040 2024-09-14T10:56:23.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.339+0000 7f81bfd0a640 1 -- 172.21.15.164:0/2356040336 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94478041387264] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81b0089030 con 0x7f81b8019040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.339+0000 7f81c2220800 20 remove_watcher() i=3 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.339+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94478041389008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x55ed6217bec0 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.340+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94478041389008] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x55ed6217bec0 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.340+0000 7f81c2220800 20 remove_watcher() i=4 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.340+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94478041394912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x7f81b006d040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.341+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94478041394912] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.341+0000 7f81c2220800 20 remove_watcher() i=5 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.341+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94478041391344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x7f81b006d040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.342+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94478041391344] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.342+0000 7f81c2220800 20 remove_watcher() i=6 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.342+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94478041400112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ed621c0d00 con 0x7f81b006d040 2024-09-14T10:56:23.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94478041400112] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a803b040 con 0x7f81b006d040 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 20 remove_watcher() i=7 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81b006d040 msgr2=0x7f81b006a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81b006d040 0x7f81b006a890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6217bec0 msgr2=0x55ed6217e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6217bec0 0x55ed6217e380 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81b8019040 msgr2=0x7f81b8046a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81b8019040 0x7f81b8046a00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed621808b0 msgr2=0x55ed62182ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed621808b0 0x55ed62182ca0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f808803ce60 msgr2=0x7f808803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f808803ce60 0x7f808803f320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f81b006b010 tx=0x7f81b008b000 comp rx=0 tx=0).stop 2024-09-14T10:56:23.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 msgr2=0x55ed62170380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81bf509640 1 -- 172.21.15.164:0/2356040336 reap_dead start 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f81b80454d0 tx=0x7f81b80543d0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 shutdown_connections 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 --2- 172.21.15.164:0/2356040336 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed62168dc0 0x55ed62170380 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 >> 172.21.15.164:0/2356040336 conn(0x55ed621651c0 msgr2=0x55ed621633d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 shutdown_connections 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.343+0000 7f81c2220800 1 -- 172.21.15.164:0/2356040336 wait complete. 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 msgr2=0x7f809803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 0x7f809803f2d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81b00461a0 tx=0x7f81b006b940 comp rx=0 tx=0).stop 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 msgr2=0x55ed6215c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55ed62142950 tx=0x7f81b800af20 comp rx=0 tx=0).stop 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 shutdown_connections 2024-09-14T10:56:23.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f809803ce10 0x7f809803f2d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/2945827548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed6215c380 0x55ed6215c7a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 >> 172.21.15.164:0/2945827548 conn(0x55ed62150730 msgr2=0x55ed62150b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 shutdown_connections 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/2945827548 wait complete. 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 msgr2=0x55ed621489b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 0x55ed621489b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 msgr2=0x55ed6214d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 0x55ed6214d1e0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 msgr2=0x7f80a803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 0x7f80a803f2d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f81a8001e30 tx=0x7f81a8001390 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 msgr2=0x55ed62141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f81b0005fd0 tx=0x7f81b0003330 comp rx=0 tx=0).stop 2024-09-14T10:56:23.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 shutdown_connections 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55ed6214ad40 0x55ed6214d1e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55ed6204ce20 0x55ed621489b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80a803ce10 0x7f80a803f2d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 --2- 172.21.15.164:0/291136904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ed61fbb6f0 0x55ed62141360 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 >> 172.21.15.164:0/291136904 conn(0x55ed62041fd0 msgr2=0x55ed6213ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 shutdown_connections 2024-09-14T10:56:23.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:23.344+0000 7f81c2220800 1 -- 172.21.15.164:0/291136904 wait complete. 2024-09-14T10:56:23.356 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-14T10:56:23.159783Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:56:23.159770Z', 'tags': [], 'group_ids': []} 2024-09-14T10:56:28.364 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:56:28.364 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:56:28.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-14T10:56:28.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-14T10:56:28.365 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-14T10:56:28.426 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:28.426 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:28.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.429+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f635a923800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a5d90b1870 0x55a5d9140420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f635a923800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5d9144720 con 0x55a5d9140a20 2024-09-14T10:56:28.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f635a923800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55a5d8fc87d0 con 0x55a5d90b1870 2024-09-14T10:56:28.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f635660c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55a5d90b1870 0x55a5d9140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f6355e0b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55a5d9140a20 0x55a5d9142ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45446/0 (socket says 172.21.15.164:45446) 2024-09-14T10:56:28.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.430+0000 7f6355e0b640 1 -- 172.21.15.164:0/4066475171 learned_addr learned my addr 172.21.15.164:0/4066475171 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:28.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.431+0000 7f635660c640 1 -- 172.21.15.164:0/4066475171 >> v1:172.21.15.116:6789/0 conn(0x55a5d9140a20 legacy=0x55a5d9142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.431+0000 7f635660c640 1 -- 172.21.15.164:0/4066475171 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d9145950 con 0x55a5d90b1870 2024-09-14T10:56:28.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635660c640 1 --2- 172.21.15.164:0/4066475171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9140420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6348005fd0 tx=0x7f6348045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fa9d95f118b73c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635560a640 1 -- 172.21.15.164:0/4066475171 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6348058530 con 0x55a5d90b1870 2024-09-14T10:56:28.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635560a640 1 -- 172.21.15.164:0/4066475171 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63480586d0 con 0x55a5d90b1870 2024-09-14T10:56:28.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635560a640 1 -- 172.21.15.164:0/4066475171 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63480589d0 con 0x55a5d90b1870 2024-09-14T10:56:28.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 -- 172.21.15.164:0/4066475171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 msgr2=0x55a5d9140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 --2- 172.21.15.164:0/4066475171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9140420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6348005fd0 tx=0x7f6348045c30 comp rx=0 tx=0).stop 2024-09-14T10:56:28.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 -- 172.21.15.164:0/4066475171 shutdown_connections 2024-09-14T10:56:28.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 --2- 172.21.15.164:0/4066475171 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9140420 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 -- 172.21.15.164:0/4066475171 >> 172.21.15.164:0/4066475171 conn(0x55a5d9137ff0 msgr2=0x55a5d913a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 -- 172.21.15.164:0/4066475171 shutdown_connections 2024-09-14T10:56:28.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.433+0000 7f635a923800 1 -- 172.21.15.164:0/4066475171 wait complete. 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635a923800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635a923800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a5d8fd5dd0 con 0x55a5d90b1870 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635660c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635660c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53040/0 (socket says 172.21.15.164:53040) 2024-09-14T10:56:28.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635660c640 1 -- 172.21.15.164:0/3204734061 learned_addr learned my addr 172.21.15.164:0/3204734061 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.449+0000 7f635660c640 1 -- 172.21.15.164:0/3204734061 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d922ded0 con 0x55a5d90b1870 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.450+0000 7f635660c640 1 --2- 172.21.15.164:0/3204734061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6348025a60 tx=0x7f6348051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c265ef6b5afe4dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.450+0000 7f6244608640 1 -- 172.21.15.164:0/3204734061 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63480589b0 con 0x55a5d90b1870 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.450+0000 7f6244608640 1 -- 172.21.15.164:0/3204734061 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6348068070 con 0x55a5d90b1870 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.450+0000 7f6244608640 1 -- 172.21.15.164:0/3204734061 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6348058c80 con 0x55a5d90b1870 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- 172.21.15.164:0/3204734061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 msgr2=0x55a5d922d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 --2- 172.21.15.164:0/3204734061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6348025a60 tx=0x7f6348051000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- 172.21.15.164:0/3204734061 shutdown_connections 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 --2- 172.21.15.164:0/3204734061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d922d8e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- 172.21.15.164:0/3204734061 >> 172.21.15.164:0/3204734061 conn(0x55a5d9137ff0 msgr2=0x55a5d9229260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- 172.21.15.164:0/3204734061 shutdown_connections 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- 172.21.15.164:0/3204734061 wait complete. 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635a923800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a5d9144bf0 con 0x55a5d90b1870 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635660c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635660c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53056/0 (socket says 172.21.15.164:53056) 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.451+0000 7f635660c640 1 -- 172.21.15.164:0/1848792025 learned_addr learned my addr 172.21.15.164:0/1848792025 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f635660c640 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d9235890 con 0x55a5d90b1870 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f635660c640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6348025a60 tx=0x7f6348003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f6242e05640 1 -- 172.21.15.164:0/1848792025 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6348063650 con 0x55a5d90b1870 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f6242e05640 1 -- 172.21.15.164:0/1848792025 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63480637f0 con 0x55a5d90b1870 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d9235b20 con 0x55a5d90b1870 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f6242e05640 1 -- 172.21.15.164:0/1848792025 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6348063af0 con 0x55a5d90b1870 2024-09-14T10:56:28.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.452+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d9236730 con 0x55a5d90b1870 2024-09-14T10:56:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.453+0000 7f6242e05640 1 -- 172.21.15.164:0/1848792025 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f6348063c90 con 0x55a5d90b1870 2024-09-14T10:56:28.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.453+0000 7f6242e05640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 0x7f623c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.453+0000 7f6242e05640 1 -- 172.21.15.164:0/1848792025 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6348098650 con 0x55a5d90b1870 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.453+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 0x7f623c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 0x55a5d923c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d923cec0 con 0x55a5d9140a20 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 0x55a5d923c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 0x7f623c03f2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6340001d70 tx=0x7f63400012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 0x55a5d923c980 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f6356e0d640 1 -- 172.21.15.164:0/1848792025 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9140a20 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.454+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d923d260 con 0x55a5d9140a20 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f6356e0d640 1 -- 172.21.15.164:0/1848792025 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9140a20 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 0x55a5d9241210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92419a0 con 0x55a5d923eda0 2024-09-14T10:56:28.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635660c640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 0x55a5d9241210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635660c640 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 0x55a5d9241210 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635660c640 1 -- 172.21.15.164:0/1848792025 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f63480743e0 con 0x55a5d923eda0 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.455+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d923dab0 con 0x55a5d9140a20 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.456+0000 7f6356e0d640 1 -- 172.21.15.164:0/1848792025 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9140a20 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.456+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d923df50 con 0x55a5d9140a20 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.456+0000 7f6356e0d640 1 -- 172.21.15.164:0/1848792025 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9140a20 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.456+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.456+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f635a923800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f635a923800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a5d90344a0 con 0x55a5d913db90 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53072/0 (socket says 172.21.15.164:53072) 2024-09-14T10:56:28.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f6356e0d640 1 -- 172.21.15.164:0/976926739 learned_addr learned my addr 172.21.15.164:0/976926739 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f6356e0d640 1 -- 172.21.15.164:0/976926739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d913e0b0 con 0x55a5d913db90 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f6356e0d640 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55a5d9237270 tx=0x7f635000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f623bfff640 1 -- 172.21.15.164:0/976926739 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6350007d60 con 0x55a5d913db90 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f623bfff640 1 -- 172.21.15.164:0/976926739 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635001e020 con 0x55a5d913db90 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d913c940 con 0x55a5d913db90 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.457+0000 7f623bfff640 1 -- 172.21.15.164:0/976926739 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6350019590 con 0x55a5d913db90 2024-09-14T10:56:28.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.458+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d913cee0 con 0x55a5d913db90 2024-09-14T10:56:28.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.458+0000 7f623bfff640 1 -- 172.21.15.164:0/976926739 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f6350016040 con 0x55a5d913db90 2024-09-14T10:56:28.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f623bfff640 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 0x7f623003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f623bfff640 1 -- 172.21.15.164:0/976926739 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f635001f030 con 0x55a5d913db90 2024-09-14T10:56:28.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635660c640 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 0x7f623003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635660c640 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 0x7f623003f2d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55a5d9237450 tx=0x7f634807e5e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635a923800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f635a923800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a5d922e240 con 0x55a5d925f040 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.459+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53080/0 (socket says 172.21.15.164:53080) 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6356e0d640 1 -- 172.21.15.164:0/1775936581 learned_addr learned my addr 172.21.15.164:0/1775936581 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6356e0d640 1 -- 172.21.15.164:0/1775936581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d925fa30 con 0x55a5d925f040 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1775936581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6350054440 tx=0x7f6350045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ba2c532e81ab0a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6239ffb640 1 -- 172.21.15.164:0/1775936581 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f635001d040 con 0x55a5d925f040 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6239ffb640 1 -- 172.21.15.164:0/1775936581 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6350051070 con 0x55a5d925f040 2024-09-14T10:56:28.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.460+0000 7f6239ffb640 1 -- 172.21.15.164:0/1775936581 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6350014340 con 0x55a5d925f040 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- 172.21.15.164:0/1775936581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 msgr2=0x55a5d925f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 --2- 172.21.15.164:0/1775936581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6350054440 tx=0x7f6350045490 comp rx=0 tx=0).stop 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- 172.21.15.164:0/1775936581 shutdown_connections 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 --2- 172.21.15.164:0/1775936581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d925f440 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- 172.21.15.164:0/1775936581 >> 172.21.15.164:0/1775936581 conn(0x55a5d925b440 msgr2=0x55a5d9259680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- 172.21.15.164:0/1775936581 shutdown_connections 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- 172.21.15.164:0/1775936581 wait complete. 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 Processor -- start 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- start start 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f635a923800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55a5d9260050 con 0x55a5d925f040 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.468 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f6356e0d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53088/0 (socket says 172.21.15.164:53088) 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.461+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 learned_addr learned my addr 172.21.15.164:0/1468884883 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5d9266b70 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6350054440 tx=0x7f63500543d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f6227fff640 1 -- 172.21.15.164:0/1468884883 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f635001d030 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f6227fff640 1 -- 172.21.15.164:0/1468884883 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6350016330 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5d9266e00 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f6227fff640 1 -- 172.21.15.164:0/1468884883 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6350016610 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.462+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5d9267780 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.463+0000 7f6227fff640 1 -- 172.21.15.164:0/1468884883 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f63500169f0 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.463+0000 7f6227fff640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f622003ce10 0x7f622003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.463+0000 7f6227fff640 1 -- 172.21.15.164:0/1468884883 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6350033030 con 0x55a5d925f040 2024-09-14T10:56:28.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.463+0000 7f635660c640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f622003ce10 0x7f622003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f635660c640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f622003ce10 0x7f622003f2d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f634804fc80 tx=0x7f6348083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9272220 0x55a5d92746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9274e30 con 0x55a5d9272220 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9272220 0x55a5d92746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.464+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9272220 0x55a5d92746e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6340009050 con 0x55a5d9272220 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 realm 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9271570 con 0x55a5d9272220 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6340009050 con 0x55a5d9272220 2024-09-14T10:56:28.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9275920 con 0x55a5d9272220 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6340009050 con 0x55a5d9272220 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92761f0 con 0x55a5d9272220 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6340009050 con 0x55a5d9272220 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d9276c10 0x55a5d9279000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.465+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9279740 con 0x55a5d9276c10 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d9276c10 0x55a5d9279000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d9276c10 0x55a5d9279000 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f635a923800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f635a923800 20 searching for the correct realm 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x55a5d9276c10 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f635005c040 0x7f6350046a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.466+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f635005c040 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f635660c640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f635005c040 0x7f6350046a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f635660c640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f635005c040 0x7f6350046a00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f635660c640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f63480951d0 0x7f634808f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f63480951d0 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.467+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f63480951d0 0x7f634808f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.468+0000 7f6355e0b640 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f63480951d0 0x7f634808f170 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.468+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340009050 con 0x7f63480951d0 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.468+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x55a5d9272220 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.468+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340009050 con 0x55a5d9272220 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.468+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x55a5d9272220 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f63480951d0 2024-09-14T10:56:28.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f63480951d0 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f635005c040 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.469+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x55a5d9276c10 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x55a5d9272220 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b030 con 0x7f635005c040 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9272220 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.470+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f635005c040 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f63480951d0 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.471+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9272220 2024-09-14T10:56:28.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9272220 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.472+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f63480951d0 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f635005c040 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9272220 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x55a5d9272220 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.473+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f63480951d0 2024-09-14T10:56:28.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f63480951d0 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.474+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f635005c040 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9276c10 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f63480951d0 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6340029040 con 0x7f63480951d0 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.475+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x55a5d9272220 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f63480a5040 con 0x7f635005c040 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:28.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927a100 con 0x55a5d9272220 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927a950 con 0x55a5d9272220 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.476+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b4b0 con 0x55a5d9272220 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 zone default found 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 4 Realm: () 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 zonegroup default 2024-09-14T10:56:28.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927b850 con 0x7f63480951d0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927d6f0 con 0x55a5d9276c10 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.477+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927da90 con 0x55a5d9276c10 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.478+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.478+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.478+0000 7f635a923800 20 started sync module instance, tier type = 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.478+0000 7f635a923800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.478+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927cb30 con 0x7f635005c040 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.479+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.479+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94170801227392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927ded0 con 0x7f635005c040 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.479+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927e720 con 0x55a5d9272220 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.480+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94170801227392] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.480+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.480+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94170801234544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927eb40 con 0x55a5d9272220 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.480+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927f390 con 0x55a5d9276c10 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.482+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94170801234544] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.482+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.482+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94170801236080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927f2a0 con 0x55a5d9276c10 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.482+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927fdc0 con 0x7f635005c040 2024-09-14T10:56:28.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.483+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94170801236080] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.483+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.483+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94170801240208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927fd80 con 0x7f635005c040 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.483+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9280840 con 0x55a5d9272220 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.485+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94170801240208] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.485+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.485+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94170801242960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9280840 con 0x55a5d9272220 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.485+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92812f0 con 0x7f63480951d0 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.486+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.486+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94170801242960] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.486+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94170801245648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92812f0 con 0x7f63480951d0 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.486+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d927ed10 con 0x7f63480951d0 2024-09-14T10:56:28.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.487+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94170801245648] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.487+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.487+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94170801237264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9281d30 con 0x7f63480951d0 2024-09-14T10:56:28.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.487+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92826f0 con 0x7f63480951d0 2024-09-14T10:56:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94170801237264] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94170801247776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92826f0 con 0x7f63480951d0 2024-09-14T10:56:28.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=0 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=1 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=2 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=3 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=4 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=5 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.488+0000 7f635a923800 20 add_watcher() i=6 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.489+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94170801247776] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.489+0000 7f635a923800 20 add_watcher() i=7 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.489+0000 7f635a923800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:28.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.489+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9285a50 con 0x55a5d9272220 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.490+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.490+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94170801251248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d9282c80 con 0x55a5d9272220 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94170801251248] v37'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f620cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f635a923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f635a923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f635a923800 5 note: GC not initialized 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f61877fe640 20 reqs_thread_entry: start 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f635a923800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f635a923800 20 Filter name: none 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.491+0000 7f61857fa640 20 reqs_thread_entry: start 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:56:28.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b8e80 con 0x7f63480951d0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b7520 con 0x7f63480951d0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:56:28.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.492+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b7df0 con 0x7f63480951d0 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v37'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f635a923800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f635a923800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f635a923800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94170801469760 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92bc7c0 con 0x7f63480951d0 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== watch-notify(notify (1) cookie 94170801245648 notify 158913789989 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55a5d92b8190 con 0x7f63480951d0 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6239ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789989 cookie 94170801245648 notifier 4752 bl.length()=556 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6239ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6239ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:56:28.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6239ffb640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f621c003ea0 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(65 notify.5 [notify cookie 94170801469760 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== watch-notify(notify_complete (2) cookie 94170801469760 notify 158913789989 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a5d92b87d0 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.494+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92ba2f0 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v37'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f635a923800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f635a923800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f635a923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94170801469632 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92bc7c0 con 0x55a5d9276c10 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94170801236080 notify 158913789967 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a5d9266e00 con 0x55a5d9276c10 2024-09-14T10:56:28.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f62397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789967 cookie 94170801236080 notifier 4752 bl.length()=177 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f62397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f62397fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 notify.2 [notify cookie 94170801469632 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f62397fa640 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f618c003400 con 0x55a5d9276c10 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.496+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.497+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== watch-notify(notify_complete (2) cookie 94170801469632 notify 158913789967 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6350073040 con 0x55a5d9276c10 2024-09-14T10:56:28.507 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-14T10:56:28.493711Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:56:28.493701Z","tags":[],"group_ids":[]} 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.497+0000 7f620cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.497+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94170801251248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x55a5d9272220 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.498+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94170801251248] v37'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.498+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94170801227392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x7f635005c040 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.499+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94170801227392] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.500+0000 7f635a923800 20 remove_watcher() i=0 2024-09-14T10:56:28.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.500+0000 7f635a923800 2 removed watcher, disabling cache 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.500+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94170801234544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x55a5d9272220 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.501+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94170801234544] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.501+0000 7f635a923800 20 remove_watcher() i=1 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.501+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94170801236080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x55a5d9276c10 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.502+0000 7f6356e0d640 1 -- 172.21.15.164:0/1468884883 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94170801236080] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63500083e0 con 0x55a5d9276c10 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.502+0000 7f635a923800 20 remove_watcher() i=2 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.502+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94170801240208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x7f635005c040 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.503+0000 7f635660c640 1 -- 172.21.15.164:0/1468884883 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94170801240208] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63480743e0 con 0x7f635005c040 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.503+0000 7f635a923800 20 remove_watcher() i=3 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.503+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94170801242960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x55a5d9272220 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.504+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94170801242960] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x55a5d9272220 2024-09-14T10:56:28.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.504+0000 7f635a923800 20 remove_watcher() i=4 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.504+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94170801245648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.505+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94170801245648] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.505+0000 7f635a923800 20 remove_watcher() i=5 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.505+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94170801237264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.506+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94170801237264] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.506+0000 7f635a923800 20 remove_watcher() i=6 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.506+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94170801247776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a5d92b6ba0 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94170801247776] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6340039040 con 0x7f63480951d0 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 20 remove_watcher() i=7 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f63480951d0 msgr2=0x7f634808f170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f63480951d0 0x7f634808f170 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9272220 msgr2=0x55a5d92746e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9272220 0x55a5d92746e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f635005c040 msgr2=0x7f6350046a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f635005c040 0x7f6350046a00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d9276c10 msgr2=0x55a5d9279000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d9276c10 0x55a5d9279000 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f622003ce10 msgr2=0x7f622003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f622003ce10 0x7f622003f2d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f634804fc80 tx=0x7f6348083000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 msgr2=0x55a5d9266610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f6355e0b640 1 -- 172.21.15.164:0/1468884883 reap_dead start 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6350054440 tx=0x7f63500543d0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 shutdown_connections 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 --2- 172.21.15.164:0/1468884883 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d925f040 0x55a5d9266610 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 >> 172.21.15.164:0/1468884883 conn(0x55a5d925b440 msgr2=0x55a5d9259650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 shutdown_connections 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.507+0000 7f635a923800 1 -- 172.21.15.164:0/1468884883 wait complete. 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 msgr2=0x7f623003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 0x7f623003f2d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55a5d9237450 tx=0x7f634807e5e0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 msgr2=0x55a5d913c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x55a5d9237270 tx=0x7f635000af20 comp rx=0 tx=0).stop 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 shutdown_connections 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623003ce10 0x7f623003f2d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/976926739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d913db90 0x55a5d913c400 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 >> 172.21.15.164:0/976926739 conn(0x55a5d9244790 msgr2=0x55a5d9244b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 shutdown_connections 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/976926739 wait complete. 2024-09-14T10:56:28.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 msgr2=0x55a5d923c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 0x55a5d923c980 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 msgr2=0x55a5d9241210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 0x55a5d9241210 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 msgr2=0x7f623c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 0x7f623c03f2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6340001d70 tx=0x7f63400012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 msgr2=0x55a5d9235330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6348025a60 tx=0x7f6348003330 comp rx=0 tx=0).stop 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 shutdown_connections 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55a5d923eda0 0x55a5d9241210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55a5d9140a20 0x55a5d923c980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f623c03ce10 0x7f623c03f2d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 --2- 172.21.15.164:0/1848792025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a5d90b1870 0x55a5d9235330 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 >> 172.21.15.164:0/1848792025 conn(0x55a5d9137ff0 msgr2=0x55a5d9227a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 shutdown_connections 2024-09-14T10:56:28.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.508+0000 7f635a923800 1 -- 172.21.15.164:0/1848792025 wait complete. 2024-09-14T10:56:28.519 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-14T10:56:28.493711Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:56:28.493701Z', 'tags': [], 'group_ids': []} 2024-09-14T10:56:28.536 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:56:28.543 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-14T10:56:28.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-14T10:56:28.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-14T10:56:28.543 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-14T10:56:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:28.590 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:28.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.593+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.593+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.593+0000 7f5a1302f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x563e0d3f9bc0 0x563e0d3fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.593+0000 7f5a1302f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e0d3fc730 con 0x563e0d368fb0 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.593+0000 7f5a1302f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x563e0d2807d0 con 0x563e0d3f9bc0 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.594+0000 7f5a0bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x563e0d3f9bc0 0x563e0d3fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.594+0000 7f5a10b19640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x563e0d368fb0 0x563e0d3f8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45454/0 (socket says 172.21.15.164:45454) 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.594+0000 7f5a10b19640 1 -- 172.21.15.164:0/2957112647 learned_addr learned my addr 172.21.15.164:0/2957112647 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.594+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2957112647 >> v1:172.21.15.116:6789/0 conn(0x563e0d368fb0 legacy=0x563e0d3f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.594+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2957112647 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d3fd960 con 0x563e0d3f9bc0 2024-09-14T10:56:28.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/2957112647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d3f9bc0 0x563e0d3fc080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00a470 tx=0x7f59fc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ca8a67c95f8df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a0b7fe640 1 -- 172.21.15.164:0/2957112647 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc053570 con 0x563e0d3f9bc0 2024-09-14T10:56:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a0b7fe640 1 -- 172.21.15.164:0/2957112647 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59fc058070 con 0x563e0d3f9bc0 2024-09-14T10:56:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a0b7fe640 1 -- 172.21.15.164:0/2957112647 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59fc053880 con 0x563e0d3f9bc0 2024-09-14T10:56:28.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 -- 172.21.15.164:0/2957112647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d3f9bc0 msgr2=0x563e0d3fc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2957112647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d3f9bc0 0x563e0d3fc080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00a470 tx=0x7f59fc045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 -- 172.21.15.164:0/2957112647 shutdown_connections 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2957112647 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d3f9bc0 0x563e0d3fc080 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 -- 172.21.15.164:0/2957112647 >> 172.21.15.164:0/2957112647 conn(0x563e0d3effa0 msgr2=0x563e0d3f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 -- 172.21.15.164:0/2957112647 shutdown_connections 2024-09-14T10:56:28.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.596+0000 7f5a1302f800 1 -- 172.21.15.164:0/2957112647 wait complete. 2024-09-14T10:56:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.610+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.610+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.610+0000 7f5a1302f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.610+0000 7f5a1302f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e0d28ddd0 con 0x563e0d368fb0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f5a10b19640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f5a10b19640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53096/0 (socket says 172.21.15.164:53096) 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f5a10b19640 1 -- 172.21.15.164:0/2392737666 learned_addr learned my addr 172.21.15.164:0/2392737666 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f5a10b19640 1 -- 172.21.15.164:0/2392737666 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d3f61c0 con 0x563e0d368fb0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2392737666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5a04001df0 tx=0x7f5a0400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b4a433a2403470 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f58fee05640 1 -- 172.21.15.164:0/2392737666 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a04012020 con 0x563e0d368fb0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f58fee05640 1 -- 172.21.15.164:0/2392737666 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0400e470 con 0x563e0d368fb0 2024-09-14T10:56:28.610 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.611+0000 7f58fee05640 1 -- 172.21.15.164:0/2392737666 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0400e7f0 con 0x563e0d368fb0 2024-09-14T10:56:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- 172.21.15.164:0/2392737666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 msgr2=0x563e0d3f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2392737666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5a04001df0 tx=0x7f5a0400b6c0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- 172.21.15.164:0/2392737666 shutdown_connections 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2392737666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d3f5bd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- 172.21.15.164:0/2392737666 >> 172.21.15.164:0/2392737666 conn(0x563e0d3effa0 msgr2=0x563e0d4e1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- 172.21.15.164:0/2392737666 shutdown_connections 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- 172.21.15.164:0/2392737666 wait complete. 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.612+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a1302f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a1302f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e0d3fcc00 con 0x563e0d368fb0 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a10b19640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a10b19640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53098/0 (socket says 172.21.15.164:53098) 2024-09-14T10:56:28.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a10b19640 1 -- 172.21.15.164:0/3296196610 learned_addr learned my addr 172.21.15.164:0/3296196610 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a10b19640 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d4efa40 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a10b19640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x563e0d3f5700 tx=0x7f5a04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f58fd602640 1 -- 172.21.15.164:0/3296196610 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a04012030 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f58fd602640 1 -- 172.21.15.164:0/3296196610 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a04001450 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f58fd602640 1 -- 172.21.15.164:0/3296196610 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0401a7a0 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e0d4efd30 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.613+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0d4f08e0 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.614+0000 7f58fd602640 1 -- 172.21.15.164:0/3296196610 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5a04015020 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.614+0000 7f58fd602640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 0x7f58f803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f58fd602640 1 -- 172.21.15.164:0/3296196610 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5a04020030 con 0x563e0d368fb0 2024-09-14T10:56:28.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 0x7f58f803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 0x563e0d4f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d4f7070 con 0x563e0d3f9bc0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1131a640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 0x563e0d4f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 0x7f58f803f2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59fc057000 tx=0x7f59fc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1131a640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 0x563e0d4f6b30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1131a640 1 -- 172.21.15.164:0/3296196610 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a0c00a4d0 con 0x563e0d3f9bc0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.615+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d4f7410 con 0x563e0d3f9bc0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a1131a640 1 -- 172.21.15.164:0/3296196610 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a0c00a4d0 con 0x563e0d3f9bc0 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 0x563e0d4fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d4fbbd0 con 0x563e0d4f9180 2024-09-14T10:56:28.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a10b19640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 0x563e0d4fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a10b19640 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 0x563e0d4fb570 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a10b19640 1 -- 172.21.15.164:0/3296196610 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a0401ab20 con 0x563e0d4f9180 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.616+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d4f8020 con 0x563e0d3f9bc0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1131a640 1 -- 172.21.15.164:0/3296196610 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a0c00a4d0 con 0x563e0d3f9bc0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d4f8500 con 0x563e0d3f9bc0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1131a640 1 -- 172.21.15.164:0/3296196610 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a0c00a4d0 con 0x563e0d3f9bc0 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1302f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.617+0000 7f5a1302f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e0d2ec4a0 con 0x563e0d50a5f0 2024-09-14T10:56:28.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.618+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.618+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53104/0 (socket says 172.21.15.164:53104) 2024-09-14T10:56:28.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.618+0000 7f5a1131a640 1 -- 172.21.15.164:0/2160402145 learned_addr learned my addr 172.21.15.164:0/2160402145 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.618+0000 7f5a1131a640 1 -- 172.21.15.164:0/2160402145 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d50b050 con 0x563e0d50a5f0 2024-09-14T10:56:28.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.618+0000 7f5a1131a640 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x563e0d4f0b00 tx=0x7f5a0c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f58f67fc640 1 -- 172.21.15.164:0/2160402145 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c014450 con 0x563e0d50a5f0 2024-09-14T10:56:28.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f58f67fc640 1 -- 172.21.15.164:0/2160402145 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c014610 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e0d50b880 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f58f67fc640 1 -- 172.21.15.164:0/2160402145 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c014930 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0d50be20 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.619+0000 7f58f67fc640 1 -- 172.21.15.164:0/2160402145 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5a0c011040 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f58f67fc640 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 0x7f58e803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f58f67fc640 1 -- 172.21.15.164:0/2160402145 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5a0c01e070 con 0x563e0d50a5f0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 0x7f58e803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 0x7f58e803f320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x563e0d4f0bd0 tx=0x7f5a04018f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1302f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1302f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e0d3f4610 con 0x563e0d517050 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53108/0 (socket says 172.21.15.164:53108) 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.620+0000 7f5a1131a640 1 -- 172.21.15.164:0/69220514 learned_addr learned my addr 172.21.15.164:0/69220514 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1131a640 1 -- 172.21.15.164:0/69220514 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d517a40 con 0x563e0d517050 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1131a640 1 --2- 172.21.15.164:0/69220514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c018430 tx=0x7f5a0c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827949b847cac890 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f58e7fff640 1 -- 172.21.15.164:0/69220514 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c04b070 con 0x563e0d517050 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f58e7fff640 1 -- 172.21.15.164:0/69220514 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c051070 con 0x563e0d517050 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f58e7fff640 1 -- 172.21.15.164:0/69220514 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c011da0 con 0x563e0d517050 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 -- 172.21.15.164:0/69220514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 msgr2=0x563e0d517450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 --2- 172.21.15.164:0/69220514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c018430 tx=0x7f5a0c014ea0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 -- 172.21.15.164:0/69220514 shutdown_connections 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 --2- 172.21.15.164:0/69220514 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d517450 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 -- 172.21.15.164:0/69220514 >> 172.21.15.164:0/69220514 conn(0x563e0d513450 msgr2=0x563e0d511690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.621+0000 7f5a1302f800 1 -- 172.21.15.164:0/69220514 shutdown_connections 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1302f800 1 -- 172.21.15.164:0/69220514 wait complete. 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1302f800 1 Processor -- start 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1302f800 1 -- start start 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1302f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d51e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1302f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x563e0d518060 con 0x563e0d517050 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d51e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1131a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d51e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53124/0 (socket says 172.21.15.164:53124) 2024-09-14T10:56:28.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 learned_addr learned my addr 172.21.15.164:0/2622346501 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.622+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d51ec20 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f5a1131a640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d51e6c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c053420 tx=0x7f5a0c0544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f58e67fc640 1 -- 172.21.15.164:0/2622346501 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c04b040 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f58e67fc640 1 -- 172.21.15.164:0/2622346501 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0c031030 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e0d51eeb0 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f58e67fc640 1 -- 172.21.15.164:0/2622346501 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a0c056070 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0d51f830 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.623+0000 7f58e67fc640 1 -- 172.21.15.164:0/2622346501 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5a0c011330 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f58e67fc640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58dc03cdc0 0x7f58dc03f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f58e67fc640 1 -- 172.21.15.164:0/2622346501 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5a0c00e040 con 0x563e0d517050 2024-09-14T10:56:28.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58dc03cdc0 0x7f58dc03f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58dc03cdc0 0x7f58dc03f280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401a6a0 tx=0x7f5a04054000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d52a3f0 0x563e0d52c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.624+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d52d000 con 0x563e0d52a3f0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d52a3f0 0x563e0d52c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d52a3f0 0x563e0d52c8b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 20 realm 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d52d430 con 0x563e0d52a3f0 2024-09-14T10:56:28.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d52dd00 con 0x563e0d52a3f0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.625+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d52e0a0 con 0x563e0d52a3f0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d52ee00 0x563e0d5311f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d531800 con 0x563e0d52ee00 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1131a640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d52ee00 0x563e0d5311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1131a640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d52ee00 0x563e0d5311f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 20 searching for the correct realm 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.626+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5330f0 con 0x563e0d52ee00 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a1131a640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5a0c014070 0x7f5a0c036990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5a0c014070 0x7f5a0c036990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5a0c014070 0x7f5a0c036990 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a10b19640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5a04017050 0x7f5a040163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.627+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5a04017050 0x7f5a040163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5a04017050 0x7f5a040163b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.628+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.629+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.630+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.631+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.632+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.633+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.634+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52ee00 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a04017050 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x563e0d52a3f0 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.635+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f5a0c057080 con 0x7f5a0c014070 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:28.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5321c0 con 0x563e0d52a3f0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d532a10 con 0x563e0d52a3f0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d533570 con 0x563e0d52a3f0 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 zone default found 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 4 Realm: () 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 zonegroup default 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.636+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d533910 con 0x7f5a04017050 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5356f0 con 0x563e0d52ee00 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d535c30 con 0x563e0d52ee00 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 started sync module instance, tier type = 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.637+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d534b90 con 0x7f5a0c014070 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.639+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.639+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94824511522528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d536090 con 0x7f5a0c014070 2024-09-14T10:56:28.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.639+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5368e0 con 0x563e0d52a3f0 2024-09-14T10:56:28.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.640+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94824511522528] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.640+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.640+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94824511524736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5369e0 con 0x563e0d52a3f0 2024-09-14T10:56:28.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.640+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d537500 con 0x563e0d52ee00 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.641+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.641+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94824511533008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d537500 con 0x563e0d52ee00 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.641+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94824511524736] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.641+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d536490 con 0x7f5a0c014070 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.642+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.642+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94824511537088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d538890 con 0x7f5a0c014070 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.642+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d539350 con 0x563e0d52a3f0 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.642+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94824511533008] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.643+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.643+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94824511540768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d539740 con 0x563e0d52a3f0 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.643+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53a160 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.643+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94824511537088] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.644+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94824511540768] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.645+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.645+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94824511535344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53a120 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.645+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53aa00 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.646+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94824511535344] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.646+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.646+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94824511544400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53a5d0 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.646+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53afd0 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94824511544400] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94824511545632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53b170 con 0x7f5a04017050 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=0 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=1 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=2 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=3 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=4 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=5 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.647+0000 7f5a1302f800 20 add_watcher() i=6 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.648+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94824511545632] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.648+0000 7f5a1302f800 20 add_watcher() i=7 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.648+0000 7f5a1302f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.648+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53e360 con 0x563e0d52a3f0 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.648+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.667 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.649+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94824511548704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d53b5f0 con 0x563e0d52a3f0 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.649+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94824511548704] v37'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f58c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 5 note: GC not initialized 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f58c5fe3640 20 reqs_thread_entry: start 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 20 Filter name: none 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f58377fe640 20 reqs_thread_entry: start 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.650+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563e0d5716e0 con 0x7f5a0c014070 2024-09-14T10:56:28.668 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a1302f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a1302f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a1302f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a1302f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.651+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d575d30 con 0x7f5a04017050 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.652+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v37'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.653+0000 7f58c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.653+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94824511548704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x563e0d52a3f0 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.654+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94824511548704] v37'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.654+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94824511522528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x7f5a0c014070 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.655+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94824511522528] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.655+0000 7f5a1302f800 20 remove_watcher() i=0 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.655+0000 7f5a1302f800 2 removed watcher, disabling cache 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.655+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94824511524736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x563e0d52a3f0 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.656+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94824511524736] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.656+0000 7f5a1302f800 20 remove_watcher() i=1 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.656+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94824511533008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x563e0d52ee00 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.657+0000 7f5a1131a640 1 -- 172.21.15.164:0/2622346501 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94824511533008] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0c03e070 con 0x563e0d52ee00 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.657+0000 7f5a1302f800 20 remove_watcher() i=2 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.657+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94824511537088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x7f5a0c014070 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.658+0000 7f5a10b19640 1 -- 172.21.15.164:0/2622346501 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94824511537088] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a0401ab20 con 0x7f5a0c014070 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.658+0000 7f5a1302f800 20 remove_watcher() i=3 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.658+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94824511540768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x563e0d52a3f0 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.659+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94824511540768] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x563e0d52a3f0 2024-09-14T10:56:28.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.659+0000 7f5a1302f800 20 remove_watcher() i=4 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.659+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94824511535344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.660+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94824511535344] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.660+0000 7f5a1302f800 20 remove_watcher() i=5 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.660+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94824511544400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.662+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94824511544400] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.662+0000 7f5a1302f800 20 remove_watcher() i=6 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.662+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94824511545632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563e0d56f4b0 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94824511545632] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59fc051070 con 0x7f5a04017050 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 20 remove_watcher() i=7 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5a04017050 msgr2=0x7f5a040163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f5a04017050 0x7f5a040163b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d52a3f0 msgr2=0x563e0d52c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d52a3f0 0x563e0d52c8b0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5a0c014070 msgr2=0x7f5a0c036990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f5a0c014070 0x7f5a0c036990 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d52ee00 msgr2=0x563e0d5311f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d52ee00 0x563e0d5311f0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58dc03cdc0 msgr2=0x7f58dc03f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58dc03cdc0 0x7f58dc03f280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5a0401a6a0 tx=0x7f5a04054000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 msgr2=0x563e0d51e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2622346501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d517050 0x563e0d51e6c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c053420 tx=0x7f5a0c0544e0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a0bfff640 1 -- 172.21.15.164:0/2622346501 reap_dead start 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 shutdown_connections 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 >> 172.21.15.164:0/2622346501 conn(0x563e0d513450 msgr2=0x563e0d511660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 shutdown_connections 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2622346501 wait complete. 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 msgr2=0x7f58e803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 0x7f58e803f320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x563e0d4f0bd0 tx=0x7f5a04018f00 comp rx=0 tx=0).stop 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 msgr2=0x563e0d50aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x563e0d4f0b00 tx=0x7f5a0c018830 comp rx=0 tx=0).stop 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 shutdown_connections 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58e803ce60 0x7f58e803f320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 --2- 172.21.15.164:0/2160402145 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d50a5f0 0x563e0d50aa10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 >> 172.21.15.164:0/2160402145 conn(0x563e0d4fe9a0 msgr2=0x563e0d4fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 shutdown_connections 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.663+0000 7f5a1302f800 1 -- 172.21.15.164:0/2160402145 wait complete. 2024-09-14T10:56:28.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 msgr2=0x563e0d4f6b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 0x563e0d4f6b30 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 msgr2=0x563e0d4fb570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 0x563e0d4fb570 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 msgr2=0x7f58f803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 0x7f58f803f2d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59fc057000 tx=0x7f59fc052000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 msgr2=0x563e0d4ef4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x563e0d3f5700 tx=0x7f5a04000bc0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 shutdown_connections 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x563e0d4f9180 0x563e0d4fb570 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x563e0d3f9bc0 0x563e0d4f6b30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f58f803ce10 0x7f58f803f2d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 --2- 172.21.15.164:0/3296196610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563e0d368fb0 0x563e0d4ef4e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 >> 172.21.15.164:0/3296196610 conn(0x563e0d3effa0 msgr2=0x563e0d4e0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 shutdown_connections 2024-09-14T10:56:28.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.664+0000 7f5a1302f800 1 -- 172.21.15.164:0/3296196610 wait complete. 2024-09-14T10:56:28.675 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-14T10:56:28.721 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:56:28.721 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:56:28.725 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-14T10:56:28.725 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-14T10:56:28.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-14T10:56:28.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-14T10:56:28.726 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-14T10:56:28.771 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:28.772 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.774+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.774+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e8f40800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c122b4b7c0 0x55c122b4bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e8f40800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c122b4d4a0 con 0x55c122b4c8e0 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e8f40800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55c1229d77d0 con 0x55c122b4b7c0 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e4c86640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c122b4b7c0 0x55c122b4bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6dc485640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55c122b4c8e0 0x55c122b4cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45462/0 (socket says 172.21.15.164:45462) 2024-09-14T10:56:28.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6dc485640 1 -- 172.21.15.164:0/3768591678 learned_addr learned my addr 172.21.15.164:0/3768591678 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:28.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e4c86640 1 -- 172.21.15.164:0/3768591678 >> v1:172.21.15.116:6789/0 conn(0x55c122b4c8e0 legacy=0x55c122b4cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.775+0000 7fc6e4c86640 1 -- 172.21.15.164:0/3768591678 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122b4d670 con 0x55c122b4b7c0 2024-09-14T10:56:28.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.777+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/3768591678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122b4bbc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400a470 tx=0x7fc6d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6ffa3d3b6e3943 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.777+0000 7fc6dffff640 1 -- 172.21.15.164:0/3768591678 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4053570 con 0x55c122b4b7c0 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.777+0000 7fc6dffff640 1 -- 172.21.15.164:0/3768591678 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4058070 con 0x55c122b4b7c0 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.777+0000 7fc6dffff640 1 -- 172.21.15.164:0/3768591678 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4053880 con 0x55c122b4b7c0 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3768591678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 msgr2=0x55c122b4bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/3768591678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122b4bbc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400a470 tx=0x7fc6d4045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3768591678 shutdown_connections 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/3768591678 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122b4bbc0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3768591678 >> 172.21.15.164:0/3768591678 conn(0x55c122b46fd0 msgr2=0x55c122b49410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3768591678 shutdown_connections 2024-09-14T10:56:28.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.778+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3768591678 wait complete. 2024-09-14T10:56:28.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.791+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.791+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e8f40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e8f40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c1229e4dd0 con 0x55c122b4b7c0 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e4c86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e4c86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53138/0 (socket says 172.21.15.164:53138) 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e4c86640 1 -- 172.21.15.164:0/20287384 learned_addr learned my addr 172.21.15.164:0/20287384 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e4c86640 1 -- 172.21.15.164:0/20287384 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122ac0a60 con 0x55c122b4b7c0 2024-09-14T10:56:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/20287384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4025c20 tx=0x7fc6d4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8490e78078b645 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc5d2e0d640 1 -- 172.21.15.164:0/20287384 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4053570 con 0x55c122b4b7c0 2024-09-14T10:56:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc5d2e0d640 1 -- 172.21.15.164:0/20287384 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4063070 con 0x55c122b4b7c0 2024-09-14T10:56:28.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.792+0000 7fc5d2e0d640 1 -- 172.21.15.164:0/20287384 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4053840 con 0x55c122b4b7c0 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 -- 172.21.15.164:0/20287384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 msgr2=0x55c122ac0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/20287384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4025c20 tx=0x7fc6d4051000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 -- 172.21.15.164:0/20287384 shutdown_connections 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/20287384 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122ac0520 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 -- 172.21.15.164:0/20287384 >> 172.21.15.164:0/20287384 conn(0x55c122b46fd0 msgr2=0x55c122c37020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 -- 172.21.15.164:0/20287384 shutdown_connections 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 -- 172.21.15.164:0/20287384 wait complete. 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.793+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e8f40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e8f40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c122b52dd0 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e4c86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e4c86640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53154/0 (socket says 172.21.15.164:53154) 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1696903855 learned_addr learned my addr 172.21.15.164:0/1696903855 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.794+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122c468f0 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4053d60 tx=0x7fc6d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc5d160a640 1 -- 172.21.15.164:0/1696903855 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d4068470 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc5d160a640 1 -- 172.21.15.164:0/1696903855 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4068610 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc5d160a640 1 -- 172.21.15.164:0/1696903855 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6d40688f0 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c122c46b80 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.795+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c122c47580 con 0x55c122b4b7c0 2024-09-14T10:56:28.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc5d160a640 1 -- 172.21.15.164:0/1696903855 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc6d4068a90 con 0x55c122b4b7c0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc5d160a640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 0x7fc5cc03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc5d160a640 1 -- 172.21.15.164:0/1696903855 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc6d4098870 con 0x55c122b4b7c0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 0x7fc5cc03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 0x55c122c4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c48170 con 0x55c122b4c8e0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 0x55c122c4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 0x7fc5cc03f320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc001d70 tx=0x7fc6cc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.796+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 0x55c122c4d9e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e5487640 1 -- 172.21.15.164:0/1696903855 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6e000a4d0 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c4e400 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e5487640 1 -- 172.21.15.164:0/1696903855 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6e000a4d0 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 0x55c122c521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c52940 con 0x55c122c4fd10 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 0x55c122c521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.797+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 0x55c122c521b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.798+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1696903855 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6d4079020 con 0x55c122c4fd10 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.798+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c4ec50 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.798+0000 7fc6e5487640 1 -- 172.21.15.164:0/1696903855 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6e000a4d0 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.798+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c4f070 con 0x55c122b4c8e0 2024-09-14T10:56:28.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.798+0000 7fc6e5487640 1 -- 172.21.15.164:0/1696903855 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc6e000a4d0 con 0x55c122b4c8e0 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e8f40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e8f40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c122a434a0 con 0x55c122c61270 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53162/0 (socket says 172.21.15.164:53162) 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e5487640 1 -- 172.21.15.164:0/2747772411 learned_addr learned my addr 172.21.15.164:0/2747772411 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e5487640 1 -- 172.21.15.164:0/2747772411 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122c61cd0 con 0x55c122c61270 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.799+0000 7fc6e5487640 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c122c4df20 tx=0x7fc6e0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc5ca7fc640 1 -- 172.21.15.164:0/2747772411 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0014450 con 0x55c122c61270 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc5ca7fc640 1 -- 172.21.15.164:0/2747772411 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e00145f0 con 0x55c122c61270 2024-09-14T10:56:28.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c122c62500 con 0x55c122c61270 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc5ca7fc640 1 -- 172.21.15.164:0/2747772411 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0014910 con 0x55c122c61270 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c122c62aa0 con 0x55c122c61270 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.800+0000 7fc5ca7fc640 1 -- 172.21.15.164:0/2747772411 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc6e0011040 con 0x55c122c61270 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc5ca7fc640 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 0x7fc5bc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc5ca7fc640 1 -- 172.21.15.164:0/2747772411 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc6e001e070 con 0x55c122c61270 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 0x7fc5bc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 0x7fc5bc03f2d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55c122c47ba0 tx=0x7fc6d40529a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e8f40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e8f40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c122c41810 con 0x55c122c6dd10 2024-09-14T10:56:28.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53164/0 (socket says 172.21.15.164:53164) 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.801+0000 7fc6e5487640 1 -- 172.21.15.164:0/3003570124 learned_addr learned my addr 172.21.15.164:0/3003570124 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e5487640 1 -- 172.21.15.164:0/3003570124 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122c6e700 con 0x55c122c6dd10 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e5487640 1 --2- 172.21.15.164:0/3003570124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0016fd0 tx=0x7fc6e0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf679b7ab8b2428 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc5bbfff640 1 -- 172.21.15.164:0/3003570124 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e004b070 con 0x55c122c6dd10 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc5bbfff640 1 -- 172.21.15.164:0/3003570124 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e0051070 con 0x55c122c6dd10 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc5bbfff640 1 -- 172.21.15.164:0/3003570124 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0022db0 con 0x55c122c6dd10 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3003570124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 msgr2=0x55c122c6e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/3003570124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0016fd0 tx=0x7fc6e0011a80 comp rx=0 tx=0).stop 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3003570124 shutdown_connections 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/3003570124 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c6e110 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3003570124 >> 172.21.15.164:0/3003570124 conn(0x55c122c6a110 msgr2=0x55c122c68350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3003570124 shutdown_connections 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.802+0000 7fc6e8f40800 1 -- 172.21.15.164:0/3003570124 wait complete. 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e8f40800 1 Processor -- start 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e8f40800 1 -- start start 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e8f40800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c75330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e8f40800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c122c6ed20 con 0x55c122c6dd10 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c75330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e5487640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c75330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53166/0 (socket says 172.21.15.164:53166) 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 learned_addr learned my addr 172.21.15.164:0/1586786054 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c122c75890 con 0x55c122c6dd10 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.803+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c75330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0053400 tx=0x7fc6e0054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc5ba7fc640 1 -- 172.21.15.164:0/1586786054 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e004b030 con 0x55c122c6dd10 2024-09-14T10:56:28.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc5ba7fc640 1 -- 172.21.15.164:0/1586786054 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031070 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c122c75b20 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc5ba7fc640 1 -- 172.21.15.164:0/1586786054 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6e0011330 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c122c766b0 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.804+0000 7fc5ba7fc640 1 -- 172.21.15.164:0/1586786054 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc6e0001770 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc5ba7fc640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5b003ce10 0x7fc5b003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc5ba7fc640 1 -- 172.21.15.164:0/1586786054 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc6e004c070 con 0x55c122c6dd10 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5b003ce10 0x7fc5b003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5b003ce10 0x7fc5b003f2d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40933f0 tx=0x7fc6d4089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122c81090 0x55c122c83550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c83ca0 con 0x55c122c81090 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.805+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122c81090 0x55c122c83550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122c81090 0x55c122c83550 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc009050 con 0x55c122c81090 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 realm 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c803e0 con 0x55c122c81090 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc009050 con 0x55c122c81090 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c84790 con 0x55c122c81090 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc009050 con 0x55c122c81090 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.806+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c85060 con 0x55c122c81090 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6cc009050 con 0x55c122c81090 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c85a80 0x55c122c87e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c885b0 con 0x55c122c85a80 2024-09-14T10:56:28.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c85a80 0x55c122c87e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c85a80 0x55c122c87e70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 20 searching for the correct realm 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.807+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e5487640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc6e0014070 0x7fc6e00451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc6e0014070 0x7fc6e00451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc6e0014070 0x7fc6e00451b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e4c86640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc6d40a5040 0x7fc6d408f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.808+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc6d40a5040 0x7fc6d408f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.809+0000 7fc6dc485640 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc6d40a5040 0x7fc6d408f990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.809+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc009050 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.809+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.809+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc009050 con 0x55c122c81090 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.809+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.810+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.811+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.812+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.813+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x55c122c81090 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.814+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c85a80 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6d40a5040 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6cc029040 con 0x7fc6d40a5040 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.815+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x55c122c81090 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c122c89ea0 con 0x7fc6e0014070 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c88f70 con 0x55c122c81090 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c897c0 con 0x55c122c81090 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.816+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8a320 con 0x55c122c81090 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 zone default found 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 4 Realm: () 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 zonegroup default 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8a6c0 con 0x7fc6d40a5040 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8c4d0 con 0x55c122c85a80 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8c9d0 con 0x55c122c85a80 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.817+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.818+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.818+0000 7fc6e8f40800 20 started sync module instance, tier type = 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.818+0000 7fc6e8f40800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:28.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.818+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8b970 con 0x7fc6e0014070 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.819+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.819+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94288000627904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8ce30 con 0x7fc6e0014070 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.819+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8d680 con 0x55c122c81090 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.820+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94288000627904] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.820+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.820+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94288000630112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8d780 con 0x55c122c81090 2024-09-14T10:56:28.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.820+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8e280 con 0x55c122c85a80 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.821+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94288000630112] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.821+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.821+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94288000638320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8e240 con 0x55c122c85a80 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.821+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8ed00 con 0x7fc6e0014070 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.822+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.822+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94288000638320] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.822+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94288000635344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8ecc0 con 0x7fc6e0014070 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.822+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8f7e0 con 0x55c122c81090 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.823+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94288000635344] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.823+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.823+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94288000643760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c8ecc0 con 0x55c122c81090 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.823+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c90300 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.824+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94288000643760] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.825+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.825+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94288000646640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c902c0 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.825+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c90ce0 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.826+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94288000646640] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.826+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.826+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94288000649168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c90ca0 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.826+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c916d0 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94288000649168] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94288000641040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c91690 con 0x7fc6d40a5040 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=0 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=1 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=2 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=3 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=4 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=5 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.827+0000 7fc6e8f40800 20 add_watcher() i=6 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94288000641040] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6e8f40800 20 add_watcher() i=7 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6e8f40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:28.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122c94be0 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.828+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94288000652416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c91fa0 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.829+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94288000652416] v37'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.829+0000 7fc59b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.829+0000 7fc6e8f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.829+0000 7fc6e8f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.829+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9d4d0 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.831+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.831+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9db20 con 0x7fc6d40a5040 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.832+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.832+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9e090 con 0x55c122c85a80 2024-09-14T10:56:28.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.833+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.833+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9e090 con 0x55c122c81090 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.834+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.834+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9e600 con 0x7fc6e0014070 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.835+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.835+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eab0 con 0x55c122c85a80 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.836+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.836+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eab0 con 0x55c122c81090 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.837+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.837+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9e8b0 con 0x7fc6d40a5040 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.838+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.838+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ea50 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.839+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.839+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ee70 con 0x55c122c85a80 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.840+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.840+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ee30 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.841+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.841+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ed00 con 0x7fc6d40a5040 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.843+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.843+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ee30 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.843+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.844+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eec0 con 0x7fc6d40a5040 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.845+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.845+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eec0 con 0x55c122c81090 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.846+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.846+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eec0 con 0x55c122c85a80 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.847+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'62 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.847+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ef50 con 0x7fc6e0014070 2024-09-14T10:56:28.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.848+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.848+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ef50 con 0x55c122c85a80 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.849+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.849+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ef50 con 0x55c122c81090 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.850+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.850+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ef50 con 0x55c122c81090 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.851+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.851+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9ef50 con 0x55c122c85a80 2024-09-14T10:56:28.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.852+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'63 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.852+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eff0 con 0x7fc6e0014070 2024-09-14T10:56:28.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.853+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.853+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9eff0 con 0x55c122c85a80 2024-09-14T10:56:28.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.854+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.854+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f010 con 0x55c122c85a80 2024-09-14T10:56:28.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.855+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.855+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f050 con 0x55c122c85a80 2024-09-14T10:56:28.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.856+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.856+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f050 con 0x55c122c85a80 2024-09-14T10:56:28.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.857+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.857+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f090 con 0x7fc6d40a5040 2024-09-14T10:56:28.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.859+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.859+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f0d0 con 0x55c122c85a80 2024-09-14T10:56:28.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.859+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.859+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f0d0 con 0x7fc6d40a5040 2024-09-14T10:56:28.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.861+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.861+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f0d0 con 0x55c122c85a80 2024-09-14T10:56:28.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.862+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'64 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.862+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f0d0 con 0x7fc6d40a5040 2024-09-14T10:56:28.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.863+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.863+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122c9f110 con 0x7fc6e0014070 2024-09-14T10:56:28.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.864+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.864+0000 7fc59a7e4640 20 reqs_thread_entry: start 2024-09-14T10:56:28.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:28.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 20 Filter name: none 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc5937fe640 20 reqs_thread_entry: start 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cc9ff0 con 0x7fc6e0014070 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ccc900 con 0x55c122c81090 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.865+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 : miss 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 8.17 8:ee723d9c:root::.bucket.meta.myfoo6%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ccc730 con 0x55c122c81090 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(96 .bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=388 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x17 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:28.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:97 4.b 4:d2abc621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49cf0 con 0x7fc6e0014070 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(97 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.866+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 4.0 4:03c4d30e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x55c122c85a80 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 4.3c 4:3c747564:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x55c122c81090 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(99 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:100 4.a 4:51a0a079:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d70 con 0x7fc6e0014070 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(100 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.867+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:101 4.10 4:0848cea7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d70 con 0x55c122c85a80 2024-09-14T10:56:28.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.868+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(101 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.868+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 4.2d 4:b5da66e9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d70 con 0x7fc6d40a5040 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.868+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(102 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.868+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 4.32 4:4c8b2d46:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d70 con 0x55c122c81090 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(103 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 4.18 4:19272cdf:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x7fc6e0014070 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(104 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:105 4.1 4:82670c60:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x7fc6e0014070 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(105 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x7fc6e0014070 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(106 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [call out=349b] v0'0 uv10 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e8f40800 10 cls_bucket_list_unordered: got thirteen 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.869+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:107 4.30 4:0db66f61:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49d30 con 0x55c122c85a80 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(107 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 20 get_obj_state: octx=0x7fc6e003f970 obj=myfoo6:thirteen state=0x55c122d47d78 s->prefetch_data=0 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 3.1fs0 3:f8a80501:::4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d49700 con 0x55c122c81090 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(108 4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen [call out=24b,getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 280+0+860 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 10 manifest: total_size = 8 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 20 get_obj_state: setting s->obj_tag to _7xSQVFibPKD1LL8n9TWR-pXmVdp53Gm 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 20 get_obj_state: octx=0x7fc6e003f970 obj=myfoo6:thirteen state=0x55c122d47d78 s->prefetch_data=0 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 20 prepare_atomic_modification: state is not atomic. state=0x55c122d47d78 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 2024-09-14T10:56:28.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.870+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:109 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0a60 con 0x7fc6e0014070 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.871+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(109 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [stat,call,call] v37'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.871+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:110 3.1fs0 3:f8a80501:::4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0a60 con 0x55c122c81090 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(110 4d2cef0f-8511-4251-8070-7385f93096af.4241.9_thirteen [call] v37'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:111 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd14f0 con 0x7fc6e0014070 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 20 list_objects_ordered: starting attempt 1 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:112 4.b 4:d2abc621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd14f0 con 0x7fc6e0014070 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:113 4.0 4:03c4d30e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd14f0 con 0x55c122c85a80 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.873+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 4.3c 4:3c747564:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd7cb0 con 0x55c122c81090 2024-09-14T10:56:28.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:115 4.a 4:51a0a079:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cda750 con 0x7fc6e0014070 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:116 4.10 4:0848cea7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cda750 con 0x55c122c85a80 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:117 4.2d 4:b5da66e9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd14f0 con 0x7fc6d40a5040 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:118 4.32 4:4c8b2d46:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce2450 con 0x55c122c81090 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:119 4.18 4:19272cdf:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce50e0 con 0x7fc6e0014070 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(112 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:120 4.1 4:82670c60:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce2450 con 0x7fc6e0014070 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(117 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x7fc6d40a5040 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:121 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd2e60 con 0x7fc6e0014070 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(113 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(114 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(116 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e002a070 con 0x55c122c85a80 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(118 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc039040 con 0x55c122c81090 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:122 4.30 4:0db66f61:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce50e0 con 0x55c122c85a80 2024-09-14T10:56:28.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(115 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(119 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.874+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(122 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(120 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(111 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [stat,call,call] v37'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc5bb7fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(121 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [call out=128b] v0'0 uv12 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:56:28.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[4d2cef0f-8511-4251-8070-7385f93096af.4241.9])"; uploads.size()=0; is_truncated=0 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:123 4.b 4:d2abc621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce23d0 con 0x7fc6e0014070 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:124 4.0 4:03c4d30e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1000 con 0x55c122c85a80 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:125 4.3c 4:3c747564:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd2e60 con 0x55c122c81090 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:126 4.a 4:51a0a079:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce23d0 con 0x7fc6e0014070 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:127 4.10 4:0848cea7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d482b0 con 0x55c122c85a80 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:128 4.2d 4:b5da66e9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1000 con 0x7fc6d40a5040 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:129 4.32 4:4c8b2d46:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce23d0 con 0x55c122c81090 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:130 4.18 4:19272cdf:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x7fc6e0014070 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(124 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(125 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(127 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(123 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.875+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(128 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:131 4.1 4:82670c60:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1000 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(126 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:132 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:133 4.30 4:0db66f61:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd2e60 con 0x55c122c85a80 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(130 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(129 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(133 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(131 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(132 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [call out=128b] v0'0 uv12 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.876+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x55c122c81090 2024-09-14T10:56:28.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.877+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(134 bud.buckets [call] v37'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.877+0000 7fc6e8f40800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.877+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.877+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x55c122c81090 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6e8f40800 20 rados_obj.operate() r=0 bl.length=166 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6e8f40800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6e8f40800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-14T10:56:28.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x55c122c81090 2024-09-14T10:56:28.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.878+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(136 myfoo6 [call,call,delete] v37'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e8f40800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e8f40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94288000914480 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0fa0 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== watch-notify(notify (1) cookie 94288000635344 notify 158913789969 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55c122c9ce60 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789969 cookie 94288000635344 notifier 4765 bl.length()=150 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(137 notify.3 [notify cookie 94288000914480 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc5bb7fe640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc50c0032c0 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== watch-notify(notify_complete (2) cookie 94288000914480 notify 158913789969 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc6d408e040 con 0x7fc6e0014070 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.879+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:139 8.17 8:ee723d9c:root::.bucket.meta.myfoo6%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd1430 con 0x55c122c81090 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.880+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(139 .bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [call,call,delete] v37'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.880+0000 7fc6e8f40800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9 from cache 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.880+0000 7fc6e8f40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:4d2cef0f-8511-4251-8070-7385f93096af.4241.9, ofs0, ns] 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.880+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94288000914480 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0fa0 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== watch-notify(notify (1) cookie 94288000638320 notify 158913789968 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55c122c9e090 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc5bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789968 cookie 94288000638320 notifier 4765 bl.length()=207 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(140 notify.2 [notify cookie 94288000914480 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc5bbfff640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc5a8003d60 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== watch-notify(notify_complete (2) cookie 94288000914480 notify 158913789968 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c122c75b20 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:142 4.b 4:d2abc621:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0fa0 con 0x7fc6e0014070 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:143 4.0 4:03c4d30e:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce1e60 con 0x55c122c85a80 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:144 4.3c 4:3c747564:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:145 4.a 4:51a0a079:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0fa0 con 0x7fc6e0014070 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 4.10 4:0848cea7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce1e60 con 0x55c122c85a80 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:147 4.2d 4:b5da66e9:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:148 4.32 4:4c8b2d46:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cd0fa0 con 0x55c122c81090 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:149 4.18 4:19272cdf:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122ce1e60 con 0x7fc6e0014070 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:150 4.1 4:82670c60:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122ccb400 con 0x7fc6e0014070 2024-09-14T10:56:28.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:151 4.1 4:8008043f:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cdd5c0 con 0x7fc6e0014070 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.881+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:152 4.30 4:0db66f61:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122cdf9c0 con 0x55c122c85a80 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(144 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.2 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(142 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.0 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(143 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.1 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(146 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.4 [delete] v37'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 42 ==== osd_op_reply(149 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.7 [delete] v37'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 43 ==== osd_op_reply(145 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.3 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.883+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(147 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.5 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(152 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.10 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 44 ==== osd_op_reply(150 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.8 [delete] v37'13 uv13 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(148 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.6 [delete] v37'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 45 ==== osd_op_reply(151 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.9.9 [delete] v37'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/4d2cef0f-8511-4251-8070-7385f93096af.4241.9 : miss 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 20 rados->read ofs=0 len=0 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:153 6.f 6:f613312e:::pubsub..bucket.myfoo6%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 46 ==== osd_op_reply(153 pubsub..bucket.myfoo6/4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/4d2cef0f-8511-4251-8070-7385f93096af.4241.9 info.flags=0x0 2024-09-14T10:56:28.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 10 adding default.rgw.log++pubsub..bucket.myfoo6/4d2cef0f-8511-4251-8070-7385f93096af.4241.9 to cache LRU end 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.884+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:154 6.f 6:f613312e:::pubsub..bucket.myfoo6%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6e0014070 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.885+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 47 ==== osd_op_reply(154 pubsub..bucket.myfoo6/4d2cef0f-8511-4251-8070-7385f93096af.4241.9 [delete] v37'35 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.885+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.886+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(155 bud.buckets [call] v37'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.886+0000 7fc6e8f40800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.886+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.887+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v37'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.887+0000 7fc6e8f40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.887+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94288001400000 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== watch-notify(notify (1) cookie 94288000646640 notify 158913789991 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c122ccbc70 con 0x7fc6d40a5040 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc5bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789991 cookie 94288000646640 notifier 4765 bl.length()=170 2024-09-14T10:56:28.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(157 notify.5 [notify cookie 94288001400000 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc5bbfff640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc5a8003d60 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== watch-notify(notify_complete (2) cookie 94288001400000 notify 158913789991 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c122c766b0 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6e8f40800 10 removing email index: 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6e8f40800 10 removing user buckets index 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.888+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(159 bud.buckets [delete] v37'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc6e8f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94288001400000 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== watch-notify(notify (1) cookie 94288000649168 notify 158913789992 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c122c766b0 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc5bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789992 cookie 94288000649168 notifier 4765 bl.length()=160 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc5bbfff640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc5a8003d60 con 0x7fc6d40a5040 2024-09-14T10:56:28.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.889+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(160 notify.6 [notify cookie 94288001400000 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.890+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== watch-notify(notify_complete (2) cookie 94288001400000 notify 158913789992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c122c9dec0 con 0x7fc6d40a5040 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.890+0000 7fc6e8f40800 10 removing user index: bud 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.890+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.890+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6e0014070 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 48 ==== osd_op_reply(162 bud [call,call,delete] v37'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6e8f40800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6e8f40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94288001400000 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== watch-notify(notify (1) cookie 94288000646640 notify 158913789993 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c122c9dec0 con 0x7fc6d40a5040 2024-09-14T10:56:28.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789993 cookie 94288000646640 notifier 4765 bl.length()=152 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(163 notify.5 [notify cookie 94288001400000 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc5bb7fe640 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc50c0032c0 con 0x7fc6d40a5040 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.891+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.892+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== watch-notify(notify_complete (2) cookie 94288001400000 notify 158913789993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c122c9d490 con 0x7fc6d40a5040 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.892+0000 7fc59b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.892+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94288000652416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.893+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94288000652416] v37'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.893+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94288000627904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6e0014070 2024-09-14T10:56:28.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.894+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 49 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94288000627904] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.894+0000 7fc6e8f40800 20 remove_watcher() i=0 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.894+0000 7fc6e8f40800 2 removed watcher, disabling cache 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.894+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94288000630112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.896+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94288000630112] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.896+0000 7fc6e8f40800 20 remove_watcher() i=1 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.896+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94288000638320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c85a80 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.897+0000 7fc6e5487640 1 -- 172.21.15.164:0/1586786054 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94288000638320] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6e006f070 con 0x55c122c85a80 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.897+0000 7fc6e8f40800 20 remove_watcher() i=2 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.897+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94288000635344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6e0014070 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.898+0000 7fc6e4c86640 1 -- 172.21.15.164:0/1586786054 <== osd.2 v2:172.21.15.164:6800/813620551 50 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94288000635344] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6d40a2040 con 0x7fc6e0014070 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.898+0000 7fc6e8f40800 20 remove_watcher() i=3 2024-09-14T10:56:28.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.898+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94288000643760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x55c122c81090 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.899+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.1 v2:172.21.15.164:6802/3845281611 49 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94288000643760] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x55c122c81090 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.899+0000 7fc6e8f40800 20 remove_watcher() i=4 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.899+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94288000646640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.900+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94288000646640] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.900+0000 7fc6e8f40800 20 remove_watcher() i=5 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.900+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94288000649168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.901+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94288000649168] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.901+0000 7fc6e8f40800 20 remove_watcher() i=6 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.901+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94288000641040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c122d478e0 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94288000641040] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc6cc048070 con 0x7fc6d40a5040 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 20 remove_watcher() i=7 2024-09-14T10:56:28.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc6d40a5040 msgr2=0x7fc6d408f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc6d40a5040 0x7fc6d408f990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122c81090 msgr2=0x55c122c83550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122c81090 0x55c122c83550 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc6e0014070 msgr2=0x7fc6e00451b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc6e0014070 0x7fc6e00451b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c85a80 msgr2=0x55c122c87e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c85a80 0x55c122c87e70 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5b003ce10 msgr2=0x7fc5b003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5b003ce10 0x7fc5b003f2d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6d40933f0 tx=0x7fc6d4089000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 msgr2=0x55c122c75330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1586786054 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c6dd10 0x55c122c75330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0053400 tx=0x7fc6e0054510 comp rx=0 tx=0).stop 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.902+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 reap_dead start 2024-09-14T10:56:28.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6dc485640 1 -- 172.21.15.164:0/1586786054 reap_dead start 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 shutdown_connections 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 >> 172.21.15.164:0/1586786054 conn(0x55c122c6a110 msgr2=0x55c122c68320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 shutdown_connections 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1586786054 wait complete. 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 msgr2=0x7fc5bc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 0x7fc5bc03f2d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55c122c47ba0 tx=0x7fc6d40529a0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 msgr2=0x55c122c61690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55c122c4df20 tx=0x7fc6e0018830 comp rx=0 tx=0).stop 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 shutdown_connections 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5bc03ce10 0x7fc5bc03f2d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/2747772411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122c61270 0x55c122c61690 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 >> 172.21.15.164:0/2747772411 conn(0x55c122c55620 msgr2=0x55c122c55a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 shutdown_connections 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/2747772411 wait complete. 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 msgr2=0x55c122c4d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 0x55c122c4d9e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 msgr2=0x55c122c521b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 0x55c122c521b0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 msgr2=0x7fc5cc03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 0x7fc5cc03f320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc001d70 tx=0x7fc6cc0012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 msgr2=0x55c122c46390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4053d60 tx=0x7fc6d4002fb0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.903+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 shutdown_connections 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c122c4fd10 0x55c122c521b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c122b4c8e0 0x55c122c4d9e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc5cc03ce60 0x7fc5cc03f320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 --2- 172.21.15.164:0/1696903855 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c122b4b7c0 0x55c122c46390 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 >> 172.21.15.164:0/1696903855 conn(0x55c122b46fd0 msgr2=0x55c122c35810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 shutdown_connections 2024-09-14T10:56:28.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.904+0000 7fc6e8f40800 1 -- 172.21.15.164:0/1696903855 wait complete. 2024-09-14T10:56:28.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-14T10:56:28.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-14T10:56:28.913 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-14T10:56:28.958 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.961+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.961+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:28.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f2e0f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56200828df10 0x56200831f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f2e0f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562008323970 con 0x56200831fdd0 2024-09-14T10:56:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f2e0f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5620081a57d0 con 0x56200828df10 2024-09-14T10:56:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f08f9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x56200828df10 0x56200831f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81ebfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x56200831fdd0 0x5620083221c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:45472/0 (socket says 172.21.15.164:45472) 2024-09-14T10:56:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81ebfff640 1 -- 172.21.15.164:0/73525193 learned_addr learned my addr 172.21.15.164:0/73525193 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:56:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f08f9640 1 -- 172.21.15.164:0/73525193 >> v1:172.21.15.116:6789/0 conn(0x56200831fdd0 legacy=0x5620083221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.962+0000 7f81f08f9640 1 -- 172.21.15.164:0/73525193 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562008324b50 con 0x56200828df10 2024-09-14T10:56:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.964+0000 7f81f08f9640 1 --2- 172.21.15.164:0/73525193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200831f890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f81e400a470 tx=0x7f81e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14670dbd21d20636 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.964+0000 7f81eb7fe640 1 -- 172.21.15.164:0/73525193 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4053570 con 0x56200828df10 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.964+0000 7f81eb7fe640 1 -- 172.21.15.164:0/73525193 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e4058070 con 0x56200828df10 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.964+0000 7f81eb7fe640 1 -- 172.21.15.164:0/73525193 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4053880 con 0x56200828df10 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 -- 172.21.15.164:0/73525193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 msgr2=0x56200831f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/73525193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200831f890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f81e400a470 tx=0x7f81e4045a20 comp rx=0 tx=0).stop 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 -- 172.21.15.164:0/73525193 shutdown_connections 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/73525193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200831f890 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 -- 172.21.15.164:0/73525193 >> 172.21.15.164:0/73525193 conn(0x562008314fa0 msgr2=0x562008317400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 -- 172.21.15.164:0/73525193 shutdown_connections 2024-09-14T10:56:28.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.965+0000 7f81f2e0f800 1 -- 172.21.15.164:0/73525193 wait complete. 2024-09-14T10:56:28.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.978+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.978+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.978+0000 7f81f2e0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f2e0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5620081b2dd0 con 0x56200828df10 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f08f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f08f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53182/0 (socket says 172.21.15.164:53182) 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f08f9640 1 -- 172.21.15.164:0/3414850716 learned_addr learned my addr 172.21.15.164:0/3414850716 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f08f9640 1 -- 172.21.15.164:0/3414850716 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56200840cfe0 con 0x56200828df10 2024-09-14T10:56:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3414850716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81e4025c20 tx=0x7f81e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ebdc121fce1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f80dee05640 1 -- 172.21.15.164:0/3414850716 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4053a20 con 0x56200828df10 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f80dee05640 1 -- 172.21.15.164:0/3414850716 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e4063070 con 0x56200828df10 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.979+0000 7f80dee05640 1 -- 172.21.15.164:0/3414850716 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4053cf0 con 0x56200828df10 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3414850716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 msgr2=0x56200840c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3414850716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f81e4025c20 tx=0x7f81e4051000 comp rx=0 tx=0).stop 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3414850716 shutdown_connections 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3414850716 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x56200840c9f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3414850716 >> 172.21.15.164:0/3414850716 conn(0x562008314fa0 msgr2=0x562008408370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3414850716 shutdown_connections 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3414850716 wait complete. 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.980+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:28.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f2e0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f2e0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562008323e40 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f08f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f08f9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53194/0 (socket says 172.21.15.164:53194) 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f08f9640 1 -- 172.21.15.164:0/524638723 learned_addr learned my addr 172.21.15.164:0/524638723 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f08f9640 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620084149f0 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f08f9640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f81e4025c20 tx=0x7f81e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f80dd602640 1 -- 172.21.15.164:0/524638723 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4068660 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f80dd602640 1 -- 172.21.15.164:0/524638723 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e4068800 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562008414c80 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f80dd602640 1 -- 172.21.15.164:0/524638723 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81e4068ae0 con 0x56200828df10 2024-09-14T10:56:28.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.981+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562008415890 con 0x56200828df10 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f80dd602640 1 -- 172.21.15.164:0/524638723 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81e4068c80 con 0x56200828df10 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f80dd602640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 0x7f80d803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f80dd602640 1 -- 172.21.15.164:0/524638723 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81e4098c60 con 0x56200828df10 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81ebfff640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 0x7f80d803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 0x56200841bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008416250 con 0x56200831fdd0 2024-09-14T10:56:28.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81f10fa640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 0x56200841bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81ebfff640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 0x7f80d803f320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81dc001d70 tx=0x7f81dc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.983+0000 7f81f10fa640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 0x56200841bae0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f10fa640 1 -- 172.21.15.164:0/524638723 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81ec00a4d0 con 0x56200831fdd0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200841c500 con 0x56200831fdd0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f10fa640 1 -- 172.21.15.164:0/524638723 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81ec00a4d0 con 0x56200831fdd0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 0x5620084202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008420a40 con 0x56200841de10 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f08f9640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 0x5620084202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.984+0000 7f81f08f9640 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 0x5620084202b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.985+0000 7f81f08f9640 1 -- 172.21.15.164:0/524638723 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81e4051070 con 0x56200841de10 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.985+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200841cd50 con 0x56200831fdd0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.985+0000 7f81f10fa640 1 -- 172.21.15.164:0/524638723 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81ec00a4d0 con 0x56200831fdd0 2024-09-14T10:56:28.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.985+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200841d130 con 0x56200831fdd0 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.985+0000 7f81f10fa640 1 -- 172.21.15.164:0/524638723 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81ec00a4d0 con 0x56200831fdd0 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f2e0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f2e0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5620082114a0 con 0x56200842f450 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53196/0 (socket says 172.21.15.164:53196) 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f10fa640 1 -- 172.21.15.164:0/3329413940 learned_addr learned my addr 172.21.15.164:0/3329413940 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f10fa640 1 -- 172.21.15.164:0/3329413940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56200842feb0 con 0x56200842f450 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.986+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x562008415490 tx=0x7f81ec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f80d67fc640 1 -- 172.21.15.164:0/3329413940 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec014450 con 0x56200842f450 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f80d67fc640 1 -- 172.21.15.164:0/3329413940 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec014610 con 0x56200842f450 2024-09-14T10:56:28.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620084306e0 con 0x56200842f450 2024-09-14T10:56:28.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f80d67fc640 1 -- 172.21.15.164:0/3329413940 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec014930 con 0x56200842f450 2024-09-14T10:56:28.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562008430c80 con 0x56200842f450 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.987+0000 7f80d67fc640 1 -- 172.21.15.164:0/3329413940 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81ec011040 con 0x56200842f450 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f80d67fc640 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 0x7f80c803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f80d67fc640 1 -- 172.21.15.164:0/3329413940 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81ec01e070 con 0x56200842f450 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 0x7f80c803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 0x7f80c803f320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x562008415d50 tx=0x7f81e405f500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:28.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f2e0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f2e0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56200840d3b0 con 0x56200843beb0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53200/0 (socket says 172.21.15.164:53200) 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.988+0000 7f81f10fa640 1 -- 172.21.15.164:0/3885855449 learned_addr learned my addr 172.21.15.164:0/3885855449 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f10fa640 1 -- 172.21.15.164:0/3885855449 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56200843c8a0 con 0x56200843beb0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3885855449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81ec018430 tx=0x7f81ec014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d19648507c7cf01 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f80c7fff640 1 -- 172.21.15.164:0/3885855449 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec04b070 con 0x56200843beb0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f80c7fff640 1 -- 172.21.15.164:0/3885855449 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec051070 con 0x56200843beb0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f80c7fff640 1 -- 172.21.15.164:0/3885855449 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec011da0 con 0x56200843beb0 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3885855449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 msgr2=0x56200843c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3885855449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f81ec018430 tx=0x7f81ec014ea0 comp rx=0 tx=0).stop 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3885855449 shutdown_connections 2024-09-14T10:56:28.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3885855449 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x56200843c2b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3885855449 >> 172.21.15.164:0/3885855449 conn(0x5620084382d0 msgr2=0x562008436510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3885855449 shutdown_connections 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.989+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3885855449 wait complete. 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f2e0f800 1 Processor -- start 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f2e0f800 1 -- start start 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f2e0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f2e0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x56200843cec0 con 0x56200843beb0 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f10fa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:53204/0 (socket says 172.21.15.164:53204) 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 learned_addr learned my addr 172.21.15.164:0/3221500210 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562008443a20 con 0x56200843beb0 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.990+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81ec053420 tx=0x7f81ec0544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f80c67fc640 1 -- 172.21.15.164:0/3221500210 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec04b040 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f80c67fc640 1 -- 172.21.15.164:0/3221500210 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec031030 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562008443cb0 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f80c67fc640 1 -- 172.21.15.164:0/3221500210 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81ec056070 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562008444630 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f80c67fc640 1 -- 172.21.15.164:0/3221500210 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f81ec011330 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.991+0000 7f80c67fc640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80bc03cdc0 0x7f80bc03f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f80c67fc640 1 -- 172.21.15.164:0/3221500210 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f81ec00e040 con 0x56200843beb0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80bc03cdc0 0x7f80bc03f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80bc03cdc0 0x7f80bc03f280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81e405dac0 tx=0x7f81e4088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200844f280 0x562008451740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008451e90 con 0x56200844f280 2024-09-14T10:56:29.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.992+0000 7f81ebfff640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200844f280 0x562008451740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81ebfff640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200844f280 0x562008451740 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81dc009050 con 0x56200844f280 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 realm 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200844e5d0 con 0x56200844f280 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81dc009050 con 0x56200844f280 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008452980 con 0x56200844f280 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81dc009050 con 0x56200844f280 2024-09-14T10:56:29.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.993+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008453250 con 0x56200844f280 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81dc009050 con 0x56200844f280 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562008453c70 0x562008456060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084567a0 con 0x562008453c70 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562008453c70 0x562008456060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562008453c70 0x562008456060 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 20 searching for the correct realm 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.994+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562008458090 con 0x562008453c70 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f10fa640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81ec014070 0x7f81ec045050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81ec014070 0x7f81ec045050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81ec014070 0x7f81ec045050 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f08f9640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81e405f040 0x7f81e407d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.995+0000 7f81ebfff640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81e405f040 0x7f81e407d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.996+0000 7f81ebfff640 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81e405f040 0x7f81e407d760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.996+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc009050 con 0x7f81e405f040 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.996+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.996+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc009050 con 0x56200844f280 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.996+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.997+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.998+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:28.999+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.000+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x56200844f280 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.001+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.002+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x562008453c70 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81dc029040 con 0x7f81e405f040 2024-09-14T10:56:29.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x56200844f280 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f81ec057080 con 0x7f81ec014070 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.003+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008457160 con 0x56200844f280 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084579b0 con 0x56200844f280 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008458510 con 0x56200844f280 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 zone default found 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 4 Realm: () 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:29.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 zonegroup default 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084588b0 con 0x7f81e405f040 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.004+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200845a690 con 0x562008453c70 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200845ab30 con 0x562008453c70 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 started sync module instance, tier type = 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.005+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008459b30 con 0x7f81ec014070 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.006+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.006+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94695577720448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845af90 con 0x7f81ec014070 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.006+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845b7e0 con 0x56200844f280 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.007+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94695577720448] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.007+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.007+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94695577726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845b860 con 0x56200844f280 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.007+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845c0f0 con 0x562008453c70 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.008+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94695577726864] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.009+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.009+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94695577727920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845c070 con 0x562008453c70 2024-09-14T10:56:29.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.009+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845cb70 con 0x7f81ec014070 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.009+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94695577727920] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.010+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.010+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94695577732704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845cb30 con 0x7f81ec014070 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.010+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845d600 con 0x56200844f280 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.011+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.011+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94695577735472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845d600 con 0x56200844f280 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.011+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845e600 con 0x7f81e405f040 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.011+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94695577732704] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.012+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.012+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94695577735472] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.012+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94695577739504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845e5c0 con 0x7f81e405f040 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.012+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845eb90 con 0x7f81e405f040 2024-09-14T10:56:29.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.013+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94695577739504] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.013+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.013+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94695577729728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845e5c0 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.013+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845f4f0 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94695577729728] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94695577742224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845f460 con 0x7f81e405f040 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=0 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=1 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=2 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=3 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=4 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=5 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.014+0000 7f81f2e0f800 20 add_watcher() i=6 2024-09-14T10:56:29.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.015+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94695577742224] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.015+0000 7f81f2e0f800 20 add_watcher() i=7 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.015+0000 7f81f2e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.015+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008462890 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.016+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.016+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94695577743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845fdb0 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.017+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94695577743744] v37'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.017+0000 7f80a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.017+0000 7f81f2e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.017+0000 7f81f2e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.017+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846b1e0 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.018+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.018+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846b890 con 0x7f81e405f040 2024-09-14T10:56:29.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.019+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.019+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846bcb0 con 0x562008453c70 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.020+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.020+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846c110 con 0x56200844f280 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.021+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.021+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008468f30 con 0x7f81ec014070 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.022+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'72 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.022+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008468f30 con 0x562008453c70 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.023+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.023+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008468f30 con 0x56200844f280 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.025+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.025+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469060 con 0x7f81e405f040 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.026+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.026+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469130 con 0x7f81ec014070 2024-09-14T10:56:29.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.027+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.027+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.028+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.028+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81ec014070 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.029+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'73 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.029+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81e405f040 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.030+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.030+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81ec014070 2024-09-14T10:56:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.031+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.031+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81e405f040 2024-09-14T10:56:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.032+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.032+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x56200844f280 2024-09-14T10:56:29.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.033+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.033+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.034+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'65 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.034+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81ec014070 2024-09-14T10:56:29.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.035+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'74 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.035+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.036+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.036+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x56200844f280 2024-09-14T10:56:29.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.037+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.037+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x56200844f280 2024-09-14T10:56:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.038+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.038+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.040+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.040+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x7f81ec014070 2024-09-14T10:56:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.041+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.041+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.042+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.042+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.043+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.043+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cb90 con 0x562008453c70 2024-09-14T10:56:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.044+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.044+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cbb0 con 0x562008453c70 2024-09-14T10:56:29.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.045+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.045+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc10 con 0x7f81e405f040 2024-09-14T10:56:29.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.046+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.046+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc10 con 0x562008453c70 2024-09-14T10:56:29.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.047+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.047+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc10 con 0x7f81e405f040 2024-09-14T10:56:29.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.048+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.048+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc10 con 0x562008453c70 2024-09-14T10:56:29.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.049+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.049+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc10 con 0x7f81e405f040 2024-09-14T10:56:29.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.050+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.050+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200846cc50 con 0x7f81ec014070 2024-09-14T10:56:29.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.051+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.051+0000 7f80a5fe3640 20 reqs_thread_entry: start 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.051+0000 7f81f2e0f800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 20 Filter name: none 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f80177fe640 20 reqs_thread_entry: start 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008497ba0 con 0x7f81e405f040 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.052+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200849a0a0 con 0x7f81e405f040 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 : miss 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:96 8.a 8:549e4b6d:root::.bucket.meta.myfoo7%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200849a150 con 0x56200844f280 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=390 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 info.flags=0x17 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 to cache LRU end 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.053+0000 7f81f2e0f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81f2e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:97 4.13 4:c916b5d5:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517750 con 0x7f81ec014070 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(97 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 4.12 4:496141d1:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517750 con 0x56200844f280 2024-09-14T10:56:29.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(98 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.054+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:99 4.2b 4:d6cb0a3c:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517750 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(99 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:100 4.27 4:e77e02cd:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517750 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(100 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:101 4.9 4:904ee894:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620085176d0 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(101 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.055+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:102 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620085176d0 con 0x7f81ec014070 2024-09-14T10:56:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(102 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [call out=381b] v0'0 uv5 ondisk = 0) ==== 195+0+381 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f2e0f800 10 cls_bucket_list_unordered: got fourteen 2024-09-14T10:56:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:103 4.5 4:a39f599d:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620085176d0 con 0x562008453c70 2024-09-14T10:56:29.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(103 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:104 4.35 4:acc8a33a:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517710 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(104 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.056+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 4.32 4:4ecb8675:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517710 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.057+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(105 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.057+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:106 4.15 4:aae14e68:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517710 con 0x562008453c70 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.057+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(106 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.057+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:107 4.37 4:ed3ab0f4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517710 con 0x7f81e405f040 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.057+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(107 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10 [call out=89b] v0'0 uv4 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 20 get_obj_state: octx=0x7f81ec0134b0 obj=myfoo7:fourteen state=0x5620085157d8 s->prefetch_data=0 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 3.37s0 3:eca5fa3a:::4d2cef0f-8511-4251-8070-7385f93096af.4241.10_fourteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620085171a0 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(108 4d2cef0f-8511-4251-8070-7385f93096af.4241.10_fourteen [call out=24b,getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 281+0+896 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 10 manifest: total_size = 8 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.4526787091998418465 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 20 get_obj_state: octx=0x7f81ec0134b0 obj=myfoo7:fourteen state=0x5620085157d8 s->prefetch_data=0 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 20 prepare_atomic_modification: state is not atomic. state=0x5620085157d8 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.058+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:109 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200849e520 con 0x7f81ec014070 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.059+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(109 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.059+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:110 3.37s0 3:eca5fa3a:::4d2cef0f-8511-4251-8070-7385f93096af.4241.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200849e520 con 0x56200844f280 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(110 4d2cef0f-8511-4251-8070-7385f93096af.4241.10_fourteen [call] v37'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:111 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200849efb0 con 0x7f81ec014070 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 20 list_objects_ordered: starting attempt 1 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:112 4.13 4:c916b5d5:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200849efb0 con 0x7f81ec014070 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:113 4.12 4:496141d1:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562008517160 con 0x56200844f280 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 4.2b 4:d6cb0a3c:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084a5730 con 0x56200844f280 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:115 4.27 4:e77e02cd:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084a8530 con 0x56200844f280 2024-09-14T10:56:29.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:116 4.9 4:904ee894:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200849efb0 con 0x56200844f280 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:117 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084a8530 con 0x7f81ec014070 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:118 4.5 4:a39f599d:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084af950 con 0x562008453c70 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:119 4.35 4:acc8a33a:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2440 con 0x56200844f280 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.060+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:120 4.32 4:4ecb8675:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b51f0 con 0x56200844f280 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:121 4.15 4:aae14e68:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b7f60 con 0x562008453c70 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:122 4.37 4:ed3ab0f4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ba9d0 con 0x7f81e405f040 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(112 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(113 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(114 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(115 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(116 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(120 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.061+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(119 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(122 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10 [call out=89b] v0'0 uv4 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(118 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(121 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(111 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f80c7fff640 20 handle_completion(): completion ok for obj=fourteen 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(117 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:56:29.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[4d2cef0f-8511-4251-8070-7385f93096af.4241.10])"; uploads.size()=0; is_truncated=0 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:123 4.13 4:c916b5d5:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084a7ee0 con 0x7f81ec014070 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:124 4.12 4:496141d1:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2440 con 0x56200844f280 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.062+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:125 4.2b 4:d6cb0a3c:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b7ee0 con 0x56200844f280 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:126 4.27 4:e77e02cd:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b4ba0 con 0x56200844f280 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:127 4.9 4:904ee894:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2440 con 0x56200844f280 2024-09-14T10:56:29.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:128 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b7ee0 con 0x7f81ec014070 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:129 4.5 4:a39f599d:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b4ba0 con 0x562008453c70 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:130 4.35 4:acc8a33a:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2440 con 0x56200844f280 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:131 4.32 4:4ecb8675:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084a41f0 con 0x56200844f280 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:132 4.15 4:aae14e68:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b4ba0 con 0x562008453c70 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:133 4.37 4:ed3ab0f4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81e405f040 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(123 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(129 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(132 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(128 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(124 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(126 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(125 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(130 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(127 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(131 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8 [call out=89b] v0'0 uv4 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(133 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10 [call out=89b] v0'0 uv4 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.063+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81e405f040 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.064+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(134 fud.buckets [call] v37'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.064+0000 7f81f2e0f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.064+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81ec014070 2024-09-14T10:56:29.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f2e0f800 20 rados_obj.operate() r=0 bl.length=168 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f2e0f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f2e0f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.065+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(136 myfoo7 [call,call,delete] v37'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f2e0f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f2e0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94695578060352 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084b4fc0 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== watch-notify(notify (1) cookie 94695577732704 notify 158913789970 ret 0) ==== 192+0+0 (crc 0 0 0) 0x562008469300 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(137 notify.3 [notify cookie 94695578060352 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f80c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 94695577732704 notifier 4772 bl.length()=150 2024-09-14T10:56:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.066+0000 7f80c77fe640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f80240032c0 con 0x7f81ec014070 2024-09-14T10:56:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.067+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.067+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== watch-notify(notify_complete (2) cookie 94695578060352 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f81e40a0040 con 0x7f81ec014070 2024-09-14T10:56:29.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.067+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:139 8.a 8:549e4b6d:root::.bucket.meta.myfoo7%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x56200844f280 2024-09-14T10:56:29.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 49 ==== osd_op_reply(139 .bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 [call,call,delete] v37'5 uv5 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10 from cache 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:4d2cef0f-8511-4251-8070-7385f93096af.4241.10, ofs0, ns] 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94695577985216 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== watch-notify(notify (1) cookie 94695577742224 notify 158913789994 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5620084995f0 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f80c77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789994 cookie 94695577742224 notifier 4772 bl.length()=208 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(140 notify.7 [notify cookie 94695577985216 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f80c77fe640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f80240032c0 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== watch-notify(notify_complete (2) cookie 94695577985216 notify 158913789994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56200846aaa0 con 0x7f81e405f040 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:142 4.13 4:c916b5d5:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81ec014070 2024-09-14T10:56:29.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:143 4.12 4:496141d1:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084b4fc0 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:144 4.2b 4:d6cb0a3c:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2420 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:145 4.27 4:e77e02cd:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084a60d0 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:146 4.9 4:904ee894:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200849cfe0 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.068+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:147 4.3f 4:fd0f0922:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81ec014070 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.069+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:148 4.5 4:a39f599d:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084b2420 con 0x562008453c70 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.069+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:149 4.35 4:acc8a33a:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084a60d0 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.069+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:150 4.32 4:4ecb8675:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x56200844f280 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.069+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:151 4.15 4:aae14e68:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084a5020 con 0x562008453c70 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.069+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:152 4.37 4:ed3ab0f4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008498870 con 0x7f81e405f040 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.070+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(142 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.0 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.070+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(147 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.5 [delete] v37'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 50 ==== osd_op_reply(149 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.7 [delete] v37'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 51 ==== osd_op_reply(146 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.4 [delete] v37'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(152 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.10 [delete] v37'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(151 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.9 [delete] v37'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 52 ==== osd_op_reply(143 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.1 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 53 ==== osd_op_reply(150 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.8 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(148 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.6 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 54 ==== osd_op_reply(145 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.3 [delete] v37'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 55 ==== osd_op_reply(144 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.10.2 [delete] v37'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81f2e0f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/4d2cef0f-8511-4251-8070-7385f93096af.4241.10 : miss 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81f2e0f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:29.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:153 6.d 6:b0d3113e:::pubsub..bucket.myfoo7%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x56200844f280 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.071+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 56 ==== osd_op_reply(153 pubsub..bucket.myfoo7/4d2cef0f-8511-4251-8070-7385f93096af.4241.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81f2e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81f2e0f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/4d2cef0f-8511-4251-8070-7385f93096af.4241.10 info.flags=0x0 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81f2e0f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/4d2cef0f-8511-4251-8070-7385f93096af.4241.10 to cache LRU end 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:154 6.d 6:b0d3113e:::pubsub..bucket.myfoo7%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x56200844f280 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 57 ==== osd_op_reply(154 pubsub..bucket.myfoo7/4d2cef0f-8511-4251-8070-7385f93096af.4241.10 [delete] v37'36 uv29 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.072+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac640 con 0x7f81e405f040 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.073+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(155 fud.buckets [call] v37'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.073+0000 7f81f2e0f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.073+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac600 con 0x7f81e405f040 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v37'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f2e0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-14T10:56:29.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94695578004064 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac600 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== watch-notify(notify (1) cookie 94695577727920 notify 158913789969 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562008469130 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f80c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789969 cookie 94695577727920 notifier 4772 bl.length()=170 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(157 notify.2 [notify cookie 94695578004064 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f80c7fff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f80b4003d60 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== watch-notify(notify_complete (2) cookie 94695578004064 notify 158913789969 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562008443cb0 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f2e0f800 10 removing email index: 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f2e0f800 10 removing user buckets index 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.075+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac600 con 0x7f81e405f040 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.076+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(159 fud.buckets [delete] v37'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.076+0000 7f81f2e0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.076+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94695577985216 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac600 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== watch-notify(notify (1) cookie 94695577729728 notify 158913789995 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56200846aaa0 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(160 notify.6 [notify cookie 94695577985216 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f80c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789995 cookie 94695577729728 notifier 4772 bl.length()=160 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f80c7fff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f80b4003d60 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== watch-notify(notify_complete (2) cookie 94695577985216 notify 158913789995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56200846b370 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81f2e0f800 10 removing user index: fud 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.077+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5620084ac600 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(162 fud [call,call,delete] v37'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81f2e0f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-14T10:56:29.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81f2e0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94695578060224 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56200849ea60 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== watch-notify(notify (1) cookie 94695577739504 notify 158913789996 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56200846b370 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f80c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789996 cookie 94695577739504 notifier 4772 bl.length()=152 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f80c7fff640 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f80b4003d60 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.078+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(163 notify.5 [notify cookie 94695578060224 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.079+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== watch-notify(notify_complete (2) cookie 94695578060224 notify 158913789996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56200846b1a0 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.079+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.080+0000 7f80a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.080+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94695577743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x56200844f280 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.081+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 58 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94695577743744] v37'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.081+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94695577720448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x7f81ec014070 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.082+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94695577720448] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.082+0000 7f81f2e0f800 20 remove_watcher() i=0 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.082+0000 7f81f2e0f800 2 removed watcher, disabling cache 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.082+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94695577726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x56200844f280 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.083+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 59 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94695577726864] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.083+0000 7f81f2e0f800 20 remove_watcher() i=1 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.083+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94695577727920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x562008453c70 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.084+0000 7f81f10fa640 1 -- 172.21.15.164:0/3221500210 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94695577727920] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81ec03e070 con 0x562008453c70 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.084+0000 7f81f2e0f800 20 remove_watcher() i=2 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.084+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94695577732704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x7f81ec014070 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.085+0000 7f81f08f9640 1 -- 172.21.15.164:0/3221500210 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94695577732704] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81e4051070 con 0x7f81ec014070 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.085+0000 7f81f2e0f800 20 remove_watcher() i=3 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.085+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94695577735472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x56200844f280 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.086+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.1 v2:172.21.15.164:6802/3845281611 60 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94695577735472] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x56200844f280 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.086+0000 7f81f2e0f800 20 remove_watcher() i=4 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.086+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94695577739504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845d130 con 0x7f81e405f040 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.087+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94695577739504] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.087+0000 7f81f2e0f800 20 remove_watcher() i=5 2024-09-14T10:56:29.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.087+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94695577729728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562008469d30 con 0x7f81e405f040 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.088+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94695577729728] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.088+0000 7f81f2e0f800 20 remove_watcher() i=6 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.088+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94695577742224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56200845e0f0 con 0x7f81e405f040 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 <== osd.0 v2:172.21.15.116:6800/1614093354 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94695577742224] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81dc039040 con 0x7f81e405f040 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 20 remove_watcher() i=7 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81e405f040 msgr2=0x7f81e407d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f81e405f040 0x7f81e407d760 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200844f280 msgr2=0x562008451740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200844f280 0x562008451740 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81ec014070 msgr2=0x7f81ec045050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f81ec014070 0x7f81ec045050 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562008453c70 msgr2=0x562008456060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.089+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562008453c70 0x562008456060 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80bc03cdc0 msgr2=0x7f80bc03f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80bc03cdc0 0x7f80bc03f280 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81e405dac0 tx=0x7f81e4088000 comp rx=0 tx=0).stop 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 msgr2=0x5620084434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f81ec053420 tx=0x7f81ec0544e0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81ebfff640 1 -- 172.21.15.164:0/3221500210 reap_dead start 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 shutdown_connections 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3221500210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200843beb0 0x5620084434c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 >> 172.21.15.164:0/3221500210 conn(0x5620084382d0 msgr2=0x5620084364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 shutdown_connections 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3221500210 wait complete. 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 msgr2=0x7f80c803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 0x7f80c803f320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x562008415d50 tx=0x7f81e405f500 comp rx=0 tx=0).stop 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 msgr2=0x56200842f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x562008415490 tx=0x7f81ec018830 comp rx=0 tx=0).stop 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 shutdown_connections 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80c803ce60 0x7f80c803f320 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/3329413940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200842f450 0x56200842f870 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 >> 172.21.15.164:0/3329413940 conn(0x562008423800 msgr2=0x562008423be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 shutdown_connections 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.090+0000 7f81f2e0f800 1 -- 172.21.15.164:0/3329413940 wait complete. 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 msgr2=0x56200841bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 0x56200841bae0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 msgr2=0x5620084202b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 0x5620084202b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 msgr2=0x7f80d803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 0x7f80d803f320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f81dc001d70 tx=0x7f81dc0012d0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 msgr2=0x562008414490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f81e4025c20 tx=0x7f81e4002fb0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 shutdown_connections 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x56200841de10 0x5620084202b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x56200831fdd0 0x56200841bae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f80d803ce60 0x7f80d803f320 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 --2- 172.21.15.164:0/524638723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56200828df10 0x562008414490 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 >> 172.21.15.164:0/524638723 conn(0x562008314fa0 msgr2=0x562008406b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:56:29.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 shutdown_connections 2024-09-14T10:56:29.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:56:29.091+0000 7f81f2e0f800 1 -- 172.21.15.164:0/524638723 wait complete. 2024-09-14T10:57:09.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-14T10:57:09.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-14T10:57:09.103 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-14T10:57:09.156 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.156 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31ec4b7800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562ab77ccb40 0x562ab77cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31ec4b7800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562ab77cf5d0 con 0x562ab77c8790 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31ec4b7800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x562ab76547d0 con 0x562ab77ccb40 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.159+0000 7f31e97a0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562ab77ccb40 0x562ab77cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.160+0000 7f31e9fa1640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x562ab77c8790 0x562ab77c8b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58236/0 (socket says 172.21.15.164:58236) 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.160+0000 7f31e9fa1640 1 -- 172.21.15.164:0/1579451864 learned_addr learned my addr 172.21.15.164:0/1579451864 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.160+0000 7f31e97a0640 1 --2- 172.21.15.164:0/1579451864 >> v2:172.21.15.116:3300/0 conn(0x562ab77ccb40 0x562ab77cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57088/0 (socket says 172.21.15.164:57088) 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.160+0000 7f31e97a0640 1 -- 172.21.15.164:0/1579451864 >> v1:172.21.15.116:6789/0 conn(0x562ab77c8790 legacy=0x562ab77c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.160+0000 7f31e97a0640 1 -- 172.21.15.164:0/1579451864 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab77d0800 con 0x562ab77ccb40 2024-09-14T10:57:09.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.162+0000 7f31e97a0640 1 --2- 172.21.15.164:0/1579451864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab77cef50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f31d400a470 tx=0x7f31d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f1202d232c5afb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.162+0000 7f31e8f9f640 1 -- 172.21.15.164:0/1579451864 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d4053570 con 0x562ab77ccb40 2024-09-14T10:57:09.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.162+0000 7f31e8f9f640 1 -- 172.21.15.164:0/1579451864 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4058070 con 0x562ab77ccb40 2024-09-14T10:57:09.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.162+0000 7f31e8f9f640 1 -- 172.21.15.164:0/1579451864 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31d4053880 con 0x562ab77ccb40 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 -- 172.21.15.164:0/1579451864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 msgr2=0x562ab77cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/1579451864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab77cef50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f31d400a470 tx=0x7f31d4045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 -- 172.21.15.164:0/1579451864 shutdown_connections 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/1579451864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab77cef50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 -- 172.21.15.164:0/1579451864 >> 172.21.15.164:0/1579451864 conn(0x562ab77c3f80 msgr2=0x562ab77c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 -- 172.21.15.164:0/1579451864 shutdown_connections 2024-09-14T10:57:09.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.163+0000 7f31ec4b7800 1 -- 172.21.15.164:0/1579451864 wait complete. 2024-09-14T10:57:09.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31ec4b7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31ec4b7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ab7661dd0 con 0x562ab77c8790 2024-09-14T10:57:09.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31e9fa1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31e9fa1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57094/0 (socket says 172.21.15.164:57094) 2024-09-14T10:57:09.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.179+0000 7f31e9fa1640 1 -- 172.21.15.164:0/692455756 learned_addr learned my addr 172.21.15.164:0/692455756 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.180+0000 7f31e9fa1640 1 -- 172.21.15.164:0/692455756 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab78b8cd0 con 0x562ab77c8790 2024-09-14T10:57:09.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.180+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/692455756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001e40 tx=0x7f31e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5ae6cd6263641 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.180+0000 7f30d7e07640 1 -- 172.21.15.164:0/692455756 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e400b200 con 0x562ab77c8790 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.180+0000 7f30d7e07640 1 -- 172.21.15.164:0/692455756 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4009460 con 0x562ab77c8790 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.180+0000 7f30d7e07640 1 -- 172.21.15.164:0/692455756 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4009760 con 0x562ab77c8790 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- 172.21.15.164:0/692455756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 msgr2=0x562ab78b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/692455756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001e40 tx=0x7f31e4001e70 comp rx=0 tx=0).stop 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- 172.21.15.164:0/692455756 shutdown_connections 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/692455756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77c8790 0x562ab78b86e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- 172.21.15.164:0/692455756 >> 172.21.15.164:0/692455756 conn(0x562ab77c3f80 msgr2=0x562ab78b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- 172.21.15.164:0/692455756 shutdown_connections 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- 172.21.15.164:0/692455756 wait complete. 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.181+0000 7f31ec4b7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ab77cfaa0 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31e9fa1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31e9fa1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57100/0 (socket says 172.21.15.164:57100) 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3059959029 learned_addr learned my addr 172.21.15.164:0/3059959029 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab78bf8c0 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f30d6604640 1 -- 172.21.15.164:0/3059959029 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e400ab60 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f30d6604640 1 -- 172.21.15.164:0/3059959029 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4024070 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab78bfb50 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f30d6604640 1 -- 172.21.15.164:0/3059959029 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e4016430 con 0x562ab77ccb40 2024-09-14T10:57:09.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.182+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab78c0550 con 0x562ab77ccb40 2024-09-14T10:57:09.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.183+0000 7f30d6604640 1 -- 172.21.15.164:0/3059959029 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31e401e070 con 0x562ab77ccb40 2024-09-14T10:57:09.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f30d6604640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 0x7f30d003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f30d6604640 1 -- 172.21.15.164:0/3059959029 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31e401b070 con 0x562ab77ccb40 2024-09-14T10:57:09.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 0x7f30d003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 0x562ab78c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab78c6f30 con 0x562ab78c1050 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 0x562ab78c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 0x7f30d003f2d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31d4057000 tx=0x7f31d4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.184+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 0x562ab78c69b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3059959029 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31dc00a4d0 con 0x562ab78c1050 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab78c0a00 con 0x562ab78c1050 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3059959029 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31dc00a4d0 con 0x562ab78c1050 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 0x562ab78cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab78cbd40 con 0x562ab78c9280 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 0x562ab78cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.185+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 0x562ab78cb670 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.186+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3059959029 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31e40165d0 con 0x562ab78c9280 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.186+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab78c8120 con 0x562ab78c1050 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.186+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3059959029 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31dc00a4d0 con 0x562ab78c1050 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.186+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab78c85c0 con 0x562ab78c1050 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3059959029 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31dc00a4d0 con 0x562ab78c1050 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ec4b7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ec4b7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ab76c04a0 con 0x562ab78deb30 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57114/0 (socket says 172.21.15.164:57114) 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.187+0000 7f31ea7a2640 1 -- 172.21.15.164:0/2123270211 learned_addr learned my addr 172.21.15.164:0/2123270211 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f31ea7a2640 1 -- 172.21.15.164:0/2123270211 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab78df590 con 0x562ab78deb30 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x562ab78c7330 tx=0x7f31dc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f30cf7fe640 1 -- 172.21.15.164:0/2123270211 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc014450 con 0x562ab78deb30 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f30cf7fe640 1 -- 172.21.15.164:0/2123270211 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0145f0 con 0x562ab78deb30 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab78dfdc0 con 0x562ab78deb30 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f30cf7fe640 1 -- 172.21.15.164:0/2123270211 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc014910 con 0x562ab78deb30 2024-09-14T10:57:09.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.188+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab78e0360 con 0x562ab78deb30 2024-09-14T10:57:09.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.189+0000 7f30cf7fe640 1 -- 172.21.15.164:0/2123270211 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31dc011040 con 0x562ab78deb30 2024-09-14T10:57:09.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.189+0000 7f30cf7fe640 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 0x7f30c403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.189+0000 7f30cf7fe640 1 -- 172.21.15.164:0/2123270211 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31dc01e070 con 0x562ab78deb30 2024-09-14T10:57:09.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.189+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 0x7f30c403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 0x7f30c403f320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x562ab78c73d0 tx=0x7f31e4014f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ec4b7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ec4b7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ab78b9100 con 0x562ab78eb570 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57126/0 (socket says 172.21.15.164:57126) 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.190+0000 7f31ea7a2640 1 -- 172.21.15.164:0/2815988172 learned_addr learned my addr 172.21.15.164:0/2815988172 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ea7a2640 1 -- 172.21.15.164:0/2815988172 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab78ebf60 con 0x562ab78eb570 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/2815988172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f31dc016620 tx=0x7f31dc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0951f5b3a5633b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f30cd7fa640 1 -- 172.21.15.164:0/2815988172 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc051020 con 0x562ab78eb570 2024-09-14T10:57:09.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f30cd7fa640 1 -- 172.21.15.164:0/2815988172 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc0560d0 con 0x562ab78eb570 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f30cd7fa640 1 -- 172.21.15.164:0/2815988172 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc028070 con 0x562ab78eb570 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2815988172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 msgr2=0x562ab78eb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2815988172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f31dc016620 tx=0x7f31dc011a80 comp rx=0 tx=0).stop 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2815988172 shutdown_connections 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2815988172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78eb970 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2815988172 >> 172.21.15.164:0/2815988172 conn(0x562ab78e7970 msgr2=0x562ab78e5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2815988172 shutdown_connections 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.191+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2815988172 wait complete. 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ec4b7800 1 Processor -- start 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ec4b7800 1 -- start start 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ec4b7800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ec4b7800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562ab78ec580 con 0x562ab78eb570 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ea7a2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57128/0 (socket says 172.21.15.164:57128) 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 learned_addr learned my addr 172.21.15.164:0/3628826676 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.192+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab78f30b0 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f31dc016620 tx=0x7f31dc054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f30bb7fe640 1 -- 172.21.15.164:0/3628826676 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc031020 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f30bb7fe640 1 -- 172.21.15.164:0/3628826676 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc022de0 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f30bb7fe640 1 -- 172.21.15.164:0/3628826676 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31dc054cd0 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ab78f3340 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.193+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab78f3cc0 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.194+0000 7f30bb7fe640 1 -- 172.21.15.164:0/3628826676 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31dc034020 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.194+0000 7f30bb7fe640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30b403ce10 0x7f30b403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.194+0000 7f30bb7fe640 1 -- 172.21.15.164:0/3628826676 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31dc00e040 con 0x562ab78eb570 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.194+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30b403ce10 0x7f30b403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30b403ce10 0x7f30b403f2d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000ea0 tx=0x7f31e404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78fe930 0x562ab7900df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7901540 con 0x562ab78fe930 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78fe930 0x562ab7900df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.195+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78fe930 0x562ab7900df0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 realm 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7901970 con 0x562ab78fe930 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7902240 con 0x562ab78fe930 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab79025e0 con 0x562ab78fe930 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab7903340 0x562ab7905730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.196+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7905d40 con 0x562ab7903340 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab7903340 0x562ab7905730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab7903340 0x562ab7905730 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ec4b7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ec4b7800 20 searching for the correct realm 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31dc058040 0x7f31dc025080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.197+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31dc058040 0x7f31dc025080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31dc058040 0x7f31dc025080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e9fa1640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31e4042040 0x7f31e40137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.198+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31e4042040 0x7f31e40137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.199+0000 7f31e97a0640 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31e4042040 0x7f31e40137d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.199+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.199+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.199+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.199+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.200+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.201+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.202+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.203+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.204+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.205+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab7903340 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.206+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31e4042040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x562ab78fe930 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907630 con 0x7f31dc058040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7906730 con 0x562ab78fe930 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.207+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7906f80 con 0x562ab78fe930 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907ab0 con 0x562ab78fe930 2024-09-14T10:57:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 zone default found 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 4 Realm: () 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 zonegroup default 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7907e50 con 0x7f31e4042040 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.208+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7909c30 con 0x562ab7903340 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab790a170 con 0x562ab7903340 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 20 started sync module instance, tier type = 2024-09-14T10:57:09.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.209+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab79090d0 con 0x7f31dc058040 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.210+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.210+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94741468320960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790aa80 con 0x7f31dc058040 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.210+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790b2d0 con 0x562ab78fe930 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.211+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94741468320960] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.212+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.212+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94741468325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790b2d0 con 0x562ab78fe930 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.212+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790bda0 con 0x562ab7903340 2024-09-14T10:57:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.213+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94741468325328] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.213+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.213+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94741468330128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790b2d0 con 0x562ab7903340 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.213+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790c850 con 0x7f31dc058040 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.214+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94741468330128] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.215+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.215+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94741468327456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790b240 con 0x7f31dc058040 2024-09-14T10:57:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.215+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790d710 con 0x562ab78fe930 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.216+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94741468327456] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.216+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.216+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94741468335168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790d710 con 0x562ab78fe930 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.216+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790e1a0 con 0x7f31e4042040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.217+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.217+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94741468339312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790e160 con 0x7f31e4042040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.217+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790f110 con 0x7f31e4042040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.217+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94741468335168] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.218+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94741468339312] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.218+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.218+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94741468343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790e3c0 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.218+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790f5c0 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94741468343360] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94741468344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790f530 con 0x7f31e4042040 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=0 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=1 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=2 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=3 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=4 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=5 2024-09-14T10:57:09.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.219+0000 7f31ec4b7800 20 add_watcher() i=6 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.220+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94741468344592] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.220+0000 7f31ec4b7800 20 add_watcher() i=7 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.220+0000 7f31ec4b7800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.220+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7912990 con 0x562ab78fe930 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.221+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.221+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94741468336736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790feb0 con 0x562ab78fe930 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94741468336736] v37'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f309b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f31ec4b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f31ec4b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f31ec4b7800 5 note: GC not initialized 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.222+0000 7f309a7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:09.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 20 Filter name: none 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f300bfff640 20 reqs_thread_entry: start 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945bb0 con 0x562ab78fe930 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.223+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab79484e0 con 0x7f31e4042040 2024-09-14T10:57:09.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.224+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call] v37'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.224+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab79484e0 con 0x7f31e4042040 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.225+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(64 usage.10 [call] v37'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.226+0000 7f309b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.226+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94741468336736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab78fb6a0 con 0x562ab78fe930 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.227+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94741468336736] v37'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.227+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94741468320960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab790d260 con 0x7f31dc058040 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.228+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94741468320960] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.228+0000 7f31ec4b7800 20 remove_watcher() i=0 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.228+0000 7f31ec4b7800 2 removed watcher, disabling cache 2024-09-14T10:57:09.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.228+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94741468325328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x562ab78fe930 2024-09-14T10:57:09.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.230+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94741468325328] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.230+0000 7f31ec4b7800 20 remove_watcher() i=1 2024-09-14T10:57:09.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.230+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94741468330128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x562ab7903340 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.231+0000 7f31ea7a2640 1 -- 172.21.15.164:0/3628826676 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94741468330128] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31dc02a070 con 0x562ab7903340 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.231+0000 7f31ec4b7800 20 remove_watcher() i=2 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.231+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94741468327456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x7f31dc058040 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.232+0000 7f31e9fa1640 1 -- 172.21.15.164:0/3628826676 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94741468327456] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e40165d0 con 0x7f31dc058040 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.232+0000 7f31ec4b7800 20 remove_watcher() i=3 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.232+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94741468335168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x562ab78fe930 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.233+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94741468335168] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x562ab78fe930 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.233+0000 7f31ec4b7800 20 remove_watcher() i=4 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.233+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94741468339312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x7f31e4042040 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.234+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94741468339312] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.234+0000 7f31ec4b7800 20 remove_watcher() i=5 2024-09-14T10:57:09.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.234+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94741468343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x7f31e4042040 2024-09-14T10:57:09.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.235+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94741468343360] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.235+0000 7f31ec4b7800 20 remove_watcher() i=6 2024-09-14T10:57:09.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.235+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94741468344592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562ab7945650 con 0x7f31e4042040 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.236+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94741468344592] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31d4051070 con 0x7f31e4042040 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 20 remove_watcher() i=7 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31e4042040 msgr2=0x7f31e40137d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31e4042040 0x7f31e40137d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78fe930 msgr2=0x562ab7900df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78fe930 0x562ab7900df0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31dc058040 msgr2=0x7f31dc025080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31dc058040 0x7f31dc025080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab7903340 msgr2=0x562ab7905730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab7903340 0x562ab7905730 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30b403ce10 msgr2=0x7f30b403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30b403ce10 0x7f30b403f2d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000ea0 tx=0x7f31e404f000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 msgr2=0x562ab78f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31e97a0640 1 -- 172.21.15.164:0/3628826676 reap_dead start 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f31dc016620 tx=0x7f31dc054510 comp rx=0 tx=0).stop 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 shutdown_connections 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3628826676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78eb570 0x562ab78f2b50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 >> 172.21.15.164:0/3628826676 conn(0x562ab78e7970 msgr2=0x562ab78e5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 shutdown_connections 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3628826676 wait complete. 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 msgr2=0x7f30c403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 0x7f30c403f320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x562ab78c73d0 tx=0x7f31e4014f30 comp rx=0 tx=0).stop 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 msgr2=0x562ab78def50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x562ab78c7330 tx=0x7f31dc018830 comp rx=0 tx=0).stop 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 shutdown_connections 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c403ce60 0x7f30c403f320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/2123270211 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab78deb30 0x562ab78def50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 >> 172.21.15.164:0/2123270211 conn(0x562ab78cead0 msgr2=0x562ab78ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 shutdown_connections 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.237+0000 7f31ec4b7800 1 -- 172.21.15.164:0/2123270211 wait complete. 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 msgr2=0x562ab78c69b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 0x562ab78c69b0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 msgr2=0x562ab78cb670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 0x562ab78cb670 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 msgr2=0x7f30d003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 0x7f30d003f2d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31d4057000 tx=0x7f31d4052000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 msgr2=0x562ab78bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 shutdown_connections 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562ab78c9280 0x562ab78cb670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562ab78c1050 0x562ab78c69b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d003ce10 0x7f30d003f2d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 --2- 172.21.15.164:0/3059959029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562ab77ccb40 0x562ab78bf360 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 >> 172.21.15.164:0/3059959029 conn(0x562ab77c3f80 msgr2=0x562ab78b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 shutdown_connections 2024-09-14T10:57:09.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.238+0000 7f31ec4b7800 1 -- 172.21.15.164:0/3059959029 wait complete. 2024-09-14T10:57:09.245 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-14T10:57:09.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-14T10:57:09.245 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-14T10:57:09.289 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.290 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.292+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.292+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f8400612800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55eb68ad9790 0x55eb68ad9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f8400612800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb68adb470 con 0x55eb68ada8b0 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f8400612800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55eb689657d0 con 0x55eb68ad9790 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f83fbde0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55eb68ad9790 0x55eb68ad9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f83f35df640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55eb68ada8b0 0x55eb68adad60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58242/0 (socket says 172.21.15.164:58242) 2024-09-14T10:57:09.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f83f35df640 1 -- 172.21.15.164:0/3578408240 learned_addr learned my addr 172.21.15.164:0/3578408240 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:09.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f83fbde0640 1 -- 172.21.15.164:0/3578408240 >> v1:172.21.15.116:6789/0 conn(0x55eb68ada8b0 legacy=0x55eb68adad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.293+0000 7f83fbde0640 1 -- 172.21.15.164:0/3578408240 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68adb640 con 0x55eb68ad9790 2024-09-14T10:57:09.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.295+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3578408240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68ad9b90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00a470 tx=0x7f83ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260d5f71d7b555a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.295+0000 7f83fb5df640 1 -- 172.21.15.164:0/3578408240 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec053570 con 0x55eb68ad9790 2024-09-14T10:57:09.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.295+0000 7f83fb5df640 1 -- 172.21.15.164:0/3578408240 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec058070 con 0x55eb68ad9790 2024-09-14T10:57:09.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.295+0000 7f83fb5df640 1 -- 172.21.15.164:0/3578408240 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec053880 con 0x55eb68ad9790 2024-09-14T10:57:09.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 -- 172.21.15.164:0/3578408240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 msgr2=0x55eb68ad9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 --2- 172.21.15.164:0/3578408240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68ad9b90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00a470 tx=0x7f83ec045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 -- 172.21.15.164:0/3578408240 shutdown_connections 2024-09-14T10:57:09.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 --2- 172.21.15.164:0/3578408240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68ad9b90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 -- 172.21.15.164:0/3578408240 >> 172.21.15.164:0/3578408240 conn(0x55eb68ad4f80 msgr2=0x55eb68ad73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 -- 172.21.15.164:0/3578408240 shutdown_connections 2024-09-14T10:57:09.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.296+0000 7f8400612800 1 -- 172.21.15.164:0/3578408240 wait complete. 2024-09-14T10:57:09.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f8400612800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f8400612800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb68972dd0 con 0x55eb68ad9790 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f83fbde0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f83fbde0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57148/0 (socket says 172.21.15.164:57148) 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f83fbde0640 1 -- 172.21.15.164:0/2283414900 learned_addr learned my addr 172.21.15.164:0/2283414900 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.310+0000 7f83fbde0640 1 -- 172.21.15.164:0/2283414900 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68bccff0 con 0x55eb68ad9790 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f83fbde0640 1 --2- 172.21.15.164:0/2283414900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f83ec025c20 tx=0x7f83ec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8be08fa85898230 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f82e9e0b640 1 -- 172.21.15.164:0/2283414900 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec053a20 con 0x55eb68ad9790 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f82e9e0b640 1 -- 172.21.15.164:0/2283414900 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec063070 con 0x55eb68ad9790 2024-09-14T10:57:09.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f82e9e0b640 1 -- 172.21.15.164:0/2283414900 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec053cf0 con 0x55eb68ad9790 2024-09-14T10:57:09.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f8400612800 1 -- 172.21.15.164:0/2283414900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 msgr2=0x55eb68bcca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f8400612800 1 --2- 172.21.15.164:0/2283414900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f83ec025c20 tx=0x7f83ec051000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f8400612800 1 -- 172.21.15.164:0/2283414900 shutdown_connections 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f8400612800 1 --2- 172.21.15.164:0/2283414900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bcca00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.311+0000 7f8400612800 1 -- 172.21.15.164:0/2283414900 >> 172.21.15.164:0/2283414900 conn(0x55eb68ad4f80 msgr2=0x55eb68a4dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 -- 172.21.15.164:0/2283414900 shutdown_connections 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 -- 172.21.15.164:0/2283414900 wait complete. 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f8400612800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb68ae0da0 con 0x55eb68ad9790 2024-09-14T10:57:09.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f83fbde0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f83fbde0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57164/0 (socket says 172.21.15.164:57164) 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f83fbde0640 1 -- 172.21.15.164:0/2045743631 learned_addr learned my addr 172.21.15.164:0/2045743631 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.312+0000 7f83fbde0640 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68bd4920 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f83fbde0640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f83ec025c20 tx=0x7f83ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f82e3fff640 1 -- 172.21.15.164:0/2045743631 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec06c030 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f82e3fff640 1 -- 172.21.15.164:0/2045743631 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec068660 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb68bd4bb0 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f82e3fff640 1 -- 172.21.15.164:0/2045743631 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec068940 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.313+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb68bd55b0 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f82e3fff640 1 -- 172.21.15.164:0/2045743631 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f83ec068ae0 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f82e3fff640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 0x7f82e403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f82e3fff640 1 -- 172.21.15.164:0/2045743631 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f83ec098900 con 0x55eb68ad9790 2024-09-14T10:57:09.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f83f35df640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 0x7f82e403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 0x55eb68bdba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68bd61a0 con 0x55eb68ada8b0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 0x55eb68bdba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.314+0000 7f83f35df640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 0x7f82e403f320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83e4001d70 tx=0x7f83e40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 0x55eb68bdba10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f83fc5e1640 1 -- 172.21.15.164:0/2045743631 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f400a4d0 con 0x55eb68ada8b0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68bdc470 con 0x55eb68ada8b0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f83fc5e1640 1 -- 172.21.15.164:0/2045743631 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83f400a4d0 con 0x55eb68ada8b0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 0x55eb68be0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68be09b0 con 0x55eb68bddd80 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f83fbde0640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 0x55eb68be0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.315+0000 7f83fbde0640 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 0x55eb68be0220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.316+0000 7f83fbde0640 1 -- 172.21.15.164:0/2045743631 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83ec051070 con 0x55eb68bddd80 2024-09-14T10:57:09.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.316+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68bdccc0 con 0x55eb68ada8b0 2024-09-14T10:57:09.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.316+0000 7f83fc5e1640 1 -- 172.21.15.164:0/2045743631 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83f400a4d0 con 0x55eb68ada8b0 2024-09-14T10:57:09.317 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.316+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68bdd060 con 0x55eb68ada8b0 2024-09-14T10:57:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.316+0000 7f83fc5e1640 1 -- 172.21.15.164:0/2045743631 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83f400a4d0 con 0x55eb68ada8b0 2024-09-14T10:57:09.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f8400612800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f8400612800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb689d14a0 con 0x55eb68bef3a0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57172/0 (socket says 172.21.15.164:57172) 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f83fc5e1640 1 -- 172.21.15.164:0/4072832089 learned_addr learned my addr 172.21.15.164:0/4072832089 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.317+0000 7f83fc5e1640 1 -- 172.21.15.164:0/4072832089 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68befe00 con 0x55eb68bef3a0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55eb68bd53c0 tx=0x7f83f4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f82e17fa640 1 -- 172.21.15.164:0/4072832089 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4014450 con 0x55eb68bef3a0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f82e17fa640 1 -- 172.21.15.164:0/4072832089 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4014610 con 0x55eb68bef3a0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb68bf0630 con 0x55eb68bef3a0 2024-09-14T10:57:09.330 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f82e17fa640 1 -- 172.21.15.164:0/4072832089 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4014930 con 0x55eb68bef3a0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.318+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb68bf0bd0 con 0x55eb68bef3a0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f82e17fa640 1 -- 172.21.15.164:0/4072832089 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f83f4011040 con 0x55eb68bef3a0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f82e17fa640 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 0x7f82d403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f82e17fa640 1 -- 172.21.15.164:0/4072832089 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f83f401e070 con 0x55eb68bef3a0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f83fbde0640 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 0x7f82d403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f83fbde0640 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 0x7f82d403f320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83ec07cfd0 tx=0x7f83ec054d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f8400612800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.319+0000 7f8400612800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb68bcd3c0 con 0x55eb68bfbde0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57182/0 (socket says 172.21.15.164:57182) 2024-09-14T10:57:09.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3362697377 learned_addr learned my addr 172.21.15.164:0/3362697377 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3362697377 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68bfc7d0 con 0x55eb68bfbde0 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/3362697377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f83f4054580 tx=0x7f83f402b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94721ba74d2518bb server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f82daffd640 1 -- 172.21.15.164:0/3362697377 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f404b070 con 0x55eb68bfbde0 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f82daffd640 1 -- 172.21.15.164:0/3362697377 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4051070 con 0x55eb68bfbde0 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.320+0000 7f82daffd640 1 -- 172.21.15.164:0/3362697377 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f40167c0 con 0x55eb68bfbde0 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- 172.21.15.164:0/3362697377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 msgr2=0x55eb68bfc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 --2- 172.21.15.164:0/3362697377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f83f4054580 tx=0x7f83f402b4c0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- 172.21.15.164:0/3362697377 shutdown_connections 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 --2- 172.21.15.164:0/3362697377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68bfc1e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- 172.21.15.164:0/3362697377 >> 172.21.15.164:0/3362697377 conn(0x55eb68bf8200 msgr2=0x55eb68bf6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- 172.21.15.164:0/3362697377 shutdown_connections 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- 172.21.15.164:0/3362697377 wait complete. 2024-09-14T10:57:09.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 Processor -- start 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- start start 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f8400612800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55eb68bfcdf0 con 0x55eb68bfbde0 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f83fc5e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57194/0 (socket says 172.21.15.164:57194) 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 learned_addr learned my addr 172.21.15.164:0/3705831259 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.321+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb68c03950 con 0x55eb68bfbde0 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f83f4049040 tx=0x7f83f40544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f82d97fa640 1 -- 172.21.15.164:0/3705831259 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f404b040 con 0x55eb68bfbde0 2024-09-14T10:57:09.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f82d97fa640 1 -- 172.21.15.164:0/3705831259 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4031030 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb68c03be0 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f82d97fa640 1 -- 172.21.15.164:0/3705831259 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f40168f0 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.322+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb68c04560 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f82d97fa640 1 -- 172.21.15.164:0/3705831259 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f83f4045720 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f82d97fa640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82c403cdc0 0x7f82c403f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f82d97fa640 1 -- 172.21.15.164:0/3705831259 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f83f400e040 con 0x55eb68bfbde0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82c403cdc0 0x7f82c403f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68c0f120 0x55eb68c115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c11d30 con 0x55eb68c0f120 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f83f35df640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68c0f120 0x55eb68c115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.323+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82c403cdc0 0x7f82c403f280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83ec054e60 tx=0x7f83ec088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f83f35df640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68c0f120 0x55eb68c115e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e4009050 con 0x55eb68c0f120 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 realm 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c0e470 con 0x55eb68c0f120 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e4009050 con 0x55eb68c0f120 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c12810 con 0x55eb68c0f120 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e4009050 con 0x55eb68c0f120 2024-09-14T10:57:09.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.324+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c130e0 con 0x55eb68c0f120 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83e4009050 con 0x55eb68c0f120 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68c13a20 0x55eb68c15e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c16550 con 0x55eb68c13a20 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68c13a20 0x55eb68c15e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68c13a20 0x55eb68c15e10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83f403e070 con 0x55eb68c13a20 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:09.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 20 searching for the correct realm 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.325+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83f403e070 con 0x55eb68c13a20 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fc5e1640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f83f4059040 0x7f83f40450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f83f4059040 0x7f83f40450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f83f4059040 0x7f83f40450c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec051070 con 0x7f83f4059040 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fbde0640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f83ec05f040 0x7f83ec05f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.326+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f83ec05f040 0x7f83ec05f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f83ec05f040 0x7f83ec05f420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4009050 con 0x7f83ec05f040 2024-09-14T10:57:09.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4009050 con 0x55eb68c0f120 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.327+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.328+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f403e070 con 0x55eb68c13a20 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.329+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f403e070 con 0x55eb68c13a20 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.330+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.331+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.340 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x55eb68c0f120 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.332+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.333+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c13a20 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83ec05f040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4029040 con 0x7f83ec05f040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x55eb68c0f120 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17ee0 con 0x7f83f4059040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:09.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.334+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c16fd0 con 0x55eb68c0f120 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17870 con 0x55eb68c0f120 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c16c10 con 0x55eb68c0f120 2024-09-14T10:57:09.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 zone default found 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 4 Realm: () 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 zonegroup default 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.335+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c17450 con 0x7f83ec05f040 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1a260 con 0x55eb68c13a20 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1a870 con 0x55eb68c13a20 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 started sync module instance, tier type = 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.336+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c196c0 con 0x7f83f4059040 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.337+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.337+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94469563191824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1acd0 con 0x7f83f4059040 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.337+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1b690 con 0x55eb68c0f120 2024-09-14T10:57:09.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.338+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94469563191824] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.339+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.339+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94469563194256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1b690 con 0x55eb68c0f120 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.339+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1c0e0 con 0x55eb68c13a20 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.340+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.340+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94469563194256] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.340+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94469563202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1c5a0 con 0x55eb68c13a20 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.340+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1b1e0 con 0x7f83f4059040 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.341+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94469563202544] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.341+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.341+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94469563203600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1c560 con 0x7f83f4059040 2024-09-14T10:57:09.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.341+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1d660 con 0x55eb68c0f120 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.342+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94469563203600] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.342+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.342+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94469563206544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1d660 con 0x55eb68c0f120 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.342+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1e0a0 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.343+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.343+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94469563210608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1e060 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.343+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f080 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.343+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94469563206544] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.344+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94469563210608] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.344+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.344+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94469563212944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1d1b0 con 0x7f83ec05f040 2024-09-14T10:57:09.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.344+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f530 con 0x7f83ec05f040 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94469563212944] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94469563216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f950 con 0x7f83ec05f040 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=0 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=1 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=2 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=3 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=4 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=5 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.345+0000 7f8400612800 20 add_watcher() i=6 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.346+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94469563216000] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.346+0000 7f8400612800 20 add_watcher() i=7 2024-09-14T10:57:09.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.346+0000 7f8400612800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.346+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f950 con 0x55eb68c0f120 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.347+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.347+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94469563217056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c20220 con 0x55eb68c0f120 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94469563217056] v37'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f82b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 5 note: GC not initialized 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f82b0fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 20 Filter name: none 2024-09-14T10:57:09.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f822a7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.348+0000 7f8400612800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.349+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c556f0 con 0x55eb68c0f120 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.349+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.349+0000 7f8400612800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.349+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c56ae0 con 0x7f83ec05f040 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.349+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.350+0000 7f82b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.350+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94469563217056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c0c740 con 0x55eb68c0f120 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.351+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94469563217056] v37'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.351+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94469563191824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f4a0 con 0x7f83f4059040 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.352+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94469563191824] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.352+0000 7f8400612800 20 remove_watcher() i=0 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.352+0000 7f8400612800 2 removed watcher, disabling cache 2024-09-14T10:57:09.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.352+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94469563194256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f4a0 con 0x55eb68c0f120 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.353+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94469563194256] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.353+0000 7f8400612800 20 remove_watcher() i=1 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.353+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94469563202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f4a0 con 0x55eb68c13a20 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.354+0000 7f83fc5e1640 1 -- 172.21.15.164:0/3705831259 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94469563202544] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f4066040 con 0x55eb68c13a20 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.354+0000 7f8400612800 20 remove_watcher() i=2 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.354+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94469563203600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1bbf0 con 0x7f83f4059040 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.355+0000 7f83fbde0640 1 -- 172.21.15.164:0/3705831259 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94469563203600] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec0a5040 con 0x7f83f4059040 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.355+0000 7f8400612800 20 remove_watcher() i=3 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.355+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94469563206544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f4a0 con 0x55eb68c0f120 2024-09-14T10:57:09.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.356+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94469563206544] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x55eb68c0f120 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.356+0000 7f8400612800 20 remove_watcher() i=4 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.356+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94469563210608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1cb90 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.357+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94469563210608] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.357+0000 7f8400612800 20 remove_watcher() i=5 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.357+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94469563212944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1f4a0 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.358+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94469563212944] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.358+0000 7f8400612800 20 remove_watcher() i=6 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.358+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94469563216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55eb68c1db70 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.359+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94469563216000] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4039040 con 0x7f83ec05f040 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.359+0000 7f8400612800 20 remove_watcher() i=7 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f83ec05f040 msgr2=0x7f83ec05f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f83ec05f040 0x7f83ec05f420 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68c0f120 msgr2=0x55eb68c115e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68c0f120 0x55eb68c115e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f83f4059040 msgr2=0x7f83f40450c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f83f4059040 0x7f83f40450c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68c13a20 msgr2=0x55eb68c15e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68c13a20 0x55eb68c15e10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82c403cdc0 msgr2=0x7f82c403f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82c403cdc0 0x7f82c403f280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83ec054e60 tx=0x7f83ec088000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 msgr2=0x55eb68c033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f83f4049040 tx=0x7f83f40544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f83f35df640 1 -- 172.21.15.164:0/3705831259 reap_dead start 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 shutdown_connections 2024-09-14T10:57:09.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/3705831259 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bfbde0 0x55eb68c033f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 >> 172.21.15.164:0/3705831259 conn(0x55eb68bf8200 msgr2=0x55eb68bf6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 shutdown_connections 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/3705831259 wait complete. 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 msgr2=0x7f82d403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 0x7f82d403f320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f83ec07cfd0 tx=0x7f83ec054d30 comp rx=0 tx=0).stop 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 msgr2=0x55eb68bef7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x55eb68bd53c0 tx=0x7f83f4018830 comp rx=0 tx=0).stop 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 shutdown_connections 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82d403ce60 0x7f82d403f320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 --2- 172.21.15.164:0/4072832089 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68bef3a0 0x55eb68bef7c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 >> 172.21.15.164:0/4072832089 conn(0x55eb68be3750 msgr2=0x55eb68be3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 shutdown_connections 2024-09-14T10:57:09.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.360+0000 7f8400612800 1 -- 172.21.15.164:0/4072832089 wait complete. 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 msgr2=0x55eb68bdba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 0x55eb68bdba10 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 msgr2=0x55eb68be0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 0x55eb68be0220 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 msgr2=0x7f82e403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 0x7f82e403f320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83e4001d70 tx=0x7f83e40012d0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 msgr2=0x55eb68bd43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f83ec025c20 tx=0x7f83ec002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 shutdown_connections 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55eb68bddd80 0x55eb68be0220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55eb68ada8b0 0x55eb68bdba10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f82e403ce60 0x7f82e403f320 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 --2- 172.21.15.164:0/2045743631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55eb68ad9790 0x55eb68bd43c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 >> 172.21.15.164:0/2045743631 conn(0x55eb68ad4f80 msgr2=0x55eb68bc3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 shutdown_connections 2024-09-14T10:57:09.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.361+0000 7f8400612800 1 -- 172.21.15.164:0/2045743631 wait complete. 2024-09-14T10:57:09.370 INFO:teuthology.orchestra.run.smithi164.stdout:{"entries":[],"summary":[]} 2024-09-14T10:57:09.370 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-14T10:57:09.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-14T10:57:09.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-14T10:57:09.370 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-14T10:57:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.416 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f3201326800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558ccd2e0730 0x558ccd3718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f3201326800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ccd375980 con 0x558ccd371de0 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f3201326800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x558ccd1f77d0 con 0x558ccd2e0730 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f31fcf5d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558ccd2e0730 0x558ccd3718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f31fc75c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x558ccd371de0 0x558ccd3741d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58250/0 (socket says 172.21.15.164:58250) 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f31fc75c640 1 -- 172.21.15.164:0/3891702890 learned_addr learned my addr 172.21.15.164:0/3891702890 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3891702890 >> v1:172.21.15.116:6789/0 conn(0x558ccd371de0 legacy=0x558ccd3741d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.419+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3891702890 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd376b60 con 0x558ccd2e0730 2024-09-14T10:57:09.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.421+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/3891702890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd3718a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00a470 tx=0x7f31ec045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4ddffc0824254f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.421+0000 7f31fbf5b640 1 -- 172.21.15.164:0/3891702890 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec053570 con 0x558ccd2e0730 2024-09-14T10:57:09.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.421+0000 7f31fbf5b640 1 -- 172.21.15.164:0/3891702890 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec058070 con 0x558ccd2e0730 2024-09-14T10:57:09.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.421+0000 7f31fbf5b640 1 -- 172.21.15.164:0/3891702890 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec053880 con 0x558ccd2e0730 2024-09-14T10:57:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 -- 172.21.15.164:0/3891702890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 msgr2=0x558ccd3718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 --2- 172.21.15.164:0/3891702890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd3718a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00a470 tx=0x7f31ec045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 -- 172.21.15.164:0/3891702890 shutdown_connections 2024-09-14T10:57:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 --2- 172.21.15.164:0/3891702890 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd3718a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 -- 172.21.15.164:0/3891702890 >> 172.21.15.164:0/3891702890 conn(0x558ccd366fd0 msgr2=0x558ccd369410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 -- 172.21.15.164:0/3891702890 shutdown_connections 2024-09-14T10:57:09.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.422+0000 7f3201326800 1 -- 172.21.15.164:0/3891702890 wait complete. 2024-09-14T10:57:09.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f3201326800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f3201326800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ccd204dd0 con 0x558ccd2e0730 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f31fcf5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f31fcf5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57206/0 (socket says 172.21.15.164:57206) 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3858071844 learned_addr learned my addr 172.21.15.164:0/3858071844 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3858071844 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd45ef90 con 0x558ccd2e0730 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.436+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/3858071844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f31ec025c20 tx=0x7f31ec051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e97d10407d819d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f30eae0d640 1 -- 172.21.15.164:0/3858071844 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec053a20 con 0x558ccd2e0730 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f30eae0d640 1 -- 172.21.15.164:0/3858071844 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec063070 con 0x558ccd2e0730 2024-09-14T10:57:09.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f30eae0d640 1 -- 172.21.15.164:0/3858071844 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec053cf0 con 0x558ccd2e0730 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 -- 172.21.15.164:0/3858071844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 msgr2=0x558ccd45e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 --2- 172.21.15.164:0/3858071844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f31ec025c20 tx=0x7f31ec051000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 -- 172.21.15.164:0/3858071844 shutdown_connections 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 --2- 172.21.15.164:0/3858071844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd45e9a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 -- 172.21.15.164:0/3858071844 >> 172.21.15.164:0/3858071844 conn(0x558ccd366fd0 msgr2=0x558ccd45a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 -- 172.21.15.164:0/3858071844 shutdown_connections 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.437+0000 7f3201326800 1 -- 172.21.15.164:0/3858071844 wait complete. 2024-09-14T10:57:09.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f3201326800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f3201326800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ccd375e50 con 0x558ccd2e0730 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f31fcf5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f31fcf5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57210/0 (socket says 172.21.15.164:57210) 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3634322723 learned_addr learned my addr 172.21.15.164:0/3634322723 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.438+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd466a20 con 0x558ccd2e0730 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f31ec025c20 tx=0x7f31ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f30e960a640 1 -- 172.21.15.164:0/3634322723 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec068660 con 0x558ccd2e0730 2024-09-14T10:57:09.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f30e960a640 1 -- 172.21.15.164:0/3634322723 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31ec068800 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ccd466cb0 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f30e960a640 1 -- 172.21.15.164:0/3634322723 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31ec068ae0 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.439+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ccd4678c0 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f30e960a640 1 -- 172.21.15.164:0/3634322723 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31ec068c80 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f30e960a640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 0x7f30e403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f30e960a640 1 -- 172.21.15.164:0/3634322723 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31ec098c60 con 0x558ccd2e0730 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f31fc75c640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 0x7f30e403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 0x558ccd46db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd468280 con 0x558ccd371de0 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f31fd75e640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 0x558ccd46db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f31fc75c640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 0x7f30e403f320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001d70 tx=0x7f31e40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.440+0000 7f31fd75e640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 0x558ccd46db10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f31fd75e640 1 -- 172.21.15.164:0/3634322723 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31f400a4d0 con 0x558ccd371de0 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd46e530 con 0x558ccd371de0 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f31fd75e640 1 -- 172.21.15.164:0/3634322723 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31f400a4d0 con 0x558ccd371de0 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 0x558ccd4722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd472a70 con 0x558ccd46fe40 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 0x558ccd4722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.441+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 0x558ccd4722e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.442+0000 7f31fcf5d640 1 -- 172.21.15.164:0/3634322723 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31ec051070 con 0x558ccd46fe40 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.442+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd46ed80 con 0x558ccd371de0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.442+0000 7f31fd75e640 1 -- 172.21.15.164:0/3634322723 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31f400a4d0 con 0x558ccd371de0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.442+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd46f160 con 0x558ccd371de0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.442+0000 7f31fd75e640 1 -- 172.21.15.164:0/3634322723 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31f400a4d0 con 0x558ccd371de0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f3201326800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f3201326800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ccd2634a0 con 0x558ccd481410 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57226/0 (socket says 172.21.15.164:57226) 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f31fd75e640 1 -- 172.21.15.164:0/12630715 learned_addr learned my addr 172.21.15.164:0/12630715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.443+0000 7f31fd75e640 1 -- 172.21.15.164:0/12630715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd481e70 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f31fd75e640 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x558ccd4674c0 tx=0x7f31f4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f30e27fc640 1 -- 172.21.15.164:0/12630715 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4014450 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f30e27fc640 1 -- 172.21.15.164:0/12630715 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4014610 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ccd4826a0 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f30e27fc640 1 -- 172.21.15.164:0/12630715 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4014930 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.444+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ccd482c40 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f30e27fc640 1 -- 172.21.15.164:0/12630715 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31f4011040 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f30e27fc640 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 0x7f30d403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f30e27fc640 1 -- 172.21.15.164:0/12630715 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31f401e070 con 0x558ccd481410 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 0x7f30d403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 0x7f30d403f320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558ccd467d80 tx=0x7f31ec05f500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f3201326800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.445+0000 7f3201326800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ccd45f360 con 0x558ccd48de90 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57232/0 (socket says 172.21.15.164:57232) 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f31fd75e640 1 -- 172.21.15.164:0/1405011476 learned_addr learned my addr 172.21.15.164:0/1405011476 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f31fd75e640 1 -- 172.21.15.164:0/1405011476 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd48e860 con 0x558ccd48de90 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f31fd75e640 1 --2- 172.21.15.164:0/1405011476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f31f4018430 tx=0x7f31f4014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37967c2893095986 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f30d3fff640 1 -- 172.21.15.164:0/1405011476 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f404b070 con 0x558ccd48de90 2024-09-14T10:57:09.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f30d3fff640 1 -- 172.21.15.164:0/1405011476 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4051070 con 0x558ccd48de90 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.446+0000 7f30d3fff640 1 -- 172.21.15.164:0/1405011476 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f4011da0 con 0x558ccd48de90 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- 172.21.15.164:0/1405011476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 msgr2=0x558ccd48e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 --2- 172.21.15.164:0/1405011476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f31f4018430 tx=0x7f31f4014ea0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- 172.21.15.164:0/1405011476 shutdown_connections 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 --2- 172.21.15.164:0/1405011476 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd48e270 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- 172.21.15.164:0/1405011476 >> 172.21.15.164:0/1405011476 conn(0x558ccd48a290 msgr2=0x558ccd4884d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- 172.21.15.164:0/1405011476 shutdown_connections 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- 172.21.15.164:0/1405011476 wait complete. 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 Processor -- start 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- start start 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd495480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f3201326800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558ccd48eea0 con 0x558ccd48de90 2024-09-14T10:57:09.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd495480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f31fd75e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd495480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57242/0 (socket says 172.21.15.164:57242) 2024-09-14T10:57:09.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.447+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 learned_addr learned my addr 172.21.15.164:0/2647144217 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ccd4959e0 con 0x558ccd48de90 2024-09-14T10:57:09.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f31fd75e640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd495480 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f31f4053420 tx=0x7f31f40544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f30d27fc640 1 -- 172.21.15.164:0/2647144217 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f404b040 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f30d27fc640 1 -- 172.21.15.164:0/2647144217 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4031030 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ccd495c70 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f30d27fc640 1 -- 172.21.15.164:0/2647144217 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f40168f0 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.448+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ccd4965f0 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f30d27fc640 1 -- 172.21.15.164:0/2647144217 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f31f4011330 con 0x558ccd48de90 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f30d27fc640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c803cdc0 0x7f30c803f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f30d27fc640 1 -- 172.21.15.164:0/2647144217 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f31f400e040 con 0x558ccd48de90 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c803cdc0 0x7f30c803f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c803cdc0 0x7f30c803f280 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f31ec05dac0 tx=0x7f31ec088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.449+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd4a1240 0x558ccd4a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a3e50 con 0x558ccd4a1240 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f31fc75c640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd4a1240 0x558ccd4a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f31fc75c640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd4a1240 0x558ccd4a3700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e4009050 con 0x558ccd4a1240 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 20 realm 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a0590 con 0x558ccd4a1240 2024-09-14T10:57:09.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e4009050 con 0x558ccd4a1240 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.450+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a4940 con 0x558ccd4a1240 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e4009050 con 0x558ccd4a1240 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a5210 con 0x558ccd4a1240 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31e4009050 con 0x558ccd4a1240 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd4a5c30 0x558ccd4a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a8760 con 0x558ccd4a5c30 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f31fd75e640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd4a5c30 0x558ccd4a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f31fd75e640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd4a5c30 0x558ccd4a8020 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f31f403e070 con 0x558ccd4a5c30 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.451+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f3201326800 20 searching for the correct realm 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f31f403e070 con 0x558ccd4a5c30 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fd75e640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31f4059040 0x7f31f4001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31f4059040 0x7f31f4001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31f4059040 0x7f31f4001770 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.452+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fcf5d640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31ec05f040 0x7f31ec07d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fc75c640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31ec05f040 0x7f31ec07d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fc75c640 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31ec05f040 0x7f31ec07d760 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4009050 con 0x7f31ec05f040 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.453+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4009050 con 0x558ccd4a1240 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.454+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f403e070 con 0x558ccd4a5c30 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.455+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f403e070 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f403e070 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.456+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.457+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x558ccd4a1240 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.458+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.459+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a5c30 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31ec05f040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31e4029040 con 0x7f31ec05f040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x558ccd4a1240 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.460+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa050 con 0x7f31f4059040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:09.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a9120 con 0x558ccd4a1240 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4a9970 con 0x558ccd4a1240 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa4d0 con 0x558ccd4a1240 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 zone default found 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 4 Realm: () 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 zonegroup default 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.461+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4aa870 con 0x7f31ec05f040 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ac650 con 0x558ccd4a5c30 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4acbf0 con 0x558ccd4a5c30 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 started sync module instance, tier type = 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.462+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4abaf0 con 0x7f31f4059040 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.463+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.463+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063228010208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ab750 con 0x7f31f4059040 2024-09-14T10:57:09.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.463+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ada30 con 0x558ccd4a1240 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.464+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063228010208] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.465+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.465+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063228014672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ad9f0 con 0x558ccd4a1240 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.465+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ae4e0 con 0x558ccd4a5c30 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.466+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.466+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063228018576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ae4a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.466+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4af4c0 con 0x7f31f4059040 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.466+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063228014672] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.467+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063228018576] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.467+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.467+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063228020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4af4c0 con 0x7f31f4059040 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.467+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4afd60 con 0x558ccd4a1240 2024-09-14T10:57:09.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.468+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063228020944] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.468+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.468+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063228022736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4af4c0 con 0x558ccd4a1240 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.468+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b04b0 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.469+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.469+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063228026752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b0470 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.469+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b1410 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.469+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063228022736] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.470+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063228026752] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.470+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.470+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063228030752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b0650 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.470+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b1cb0 con 0x7f31ec05f040 2024-09-14T10:57:09.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063228030752] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063228025008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b1a10 con 0x7f31ec05f040 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=0 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=1 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=2 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=3 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=4 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=5 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.471+0000 7f3201326800 20 add_watcher() i=6 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.472+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063228025008] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.472+0000 7f3201326800 20 add_watcher() i=7 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.472+0000 7f3201326800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.472+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b4c10 con 0x558ccd4a1240 2024-09-14T10:57:09.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.473+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.473+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063228032448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b1e90 con 0x558ccd4a1240 2024-09-14T10:57:09.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.474+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063228032448] v37'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.474+0000 7f30b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.474+0000 7f3201326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.474+0000 7f3201326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.474+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bd5d0 con 0x558ccd4a1240 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.475+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.475+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bdc00 con 0x7f31ec05f040 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.476+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.476+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4be080 con 0x558ccd4a5c30 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.477+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.477+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4be4a0 con 0x558ccd4a1240 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.478+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.478+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bb3b0 con 0x7f31f4059040 2024-09-14T10:57:09.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.479+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'75 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.479+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bb3b0 con 0x558ccd4a5c30 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.480+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.480+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bb4c0 con 0x558ccd4a1240 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.482+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.482+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bb4c0 con 0x7f31ec05f040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.483+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.483+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4befe0 con 0x7f31f4059040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.484+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.484+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4befe0 con 0x558ccd4a5c30 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.485+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.485+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4befe0 con 0x7f31f4059040 2024-09-14T10:57:09.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.486+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'76 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.486+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf070 con 0x7f31ec05f040 2024-09-14T10:57:09.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.487+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.487+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf070 con 0x7f31f4059040 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.488+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.488+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf070 con 0x7f31ec05f040 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.489+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.489+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf070 con 0x558ccd4a1240 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.490+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.490+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf070 con 0x558ccd4a5c30 2024-09-14T10:57:09.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.491+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.491+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6e0 con 0x7f31f4059040 2024-09-14T10:57:09.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.492+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'77 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.492+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6c0 con 0x558ccd4a5c30 2024-09-14T10:57:09.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.493+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.493+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6c0 con 0x558ccd4a1240 2024-09-14T10:57:09.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.494+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.494+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6c0 con 0x558ccd4a1240 2024-09-14T10:57:09.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.496+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.496+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6c0 con 0x558ccd4a5c30 2024-09-14T10:57:09.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.497+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.497+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x7f31f4059040 2024-09-14T10:57:09.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.498+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.498+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.499+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.499+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.500+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.500+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.500+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.500+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.501+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.501+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x7f31ec05f040 2024-09-14T10:57:09.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.503+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.503+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.504+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.504+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x7f31ec05f040 2024-09-14T10:57:09.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.505+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.505+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x558ccd4a5c30 2024-09-14T10:57:09.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.506+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.506+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x7f31ec05f040 2024-09-14T10:57:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.507+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.507+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4bf6a0 con 0x7f31f4059040 2024-09-14T10:57:09.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.508+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.508+0000 7f30b1fe3640 20 reqs_thread_entry: start 2024-09-14T10:57:09.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.508+0000 7f3201326800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:09.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 20 Filter name: none 2024-09-14T10:57:09.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f30237fe640 20 reqs_thread_entry: start 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ea3f0 con 0x558ccd4a1240 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ec6d0 con 0x7f31f4059040 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 : miss 2024-09-14T10:57:09.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.509+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:96 8.6 8:63f283c7:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ecaf0 con 0x7f31ec05f040 2024-09-14T10:57:09.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(96 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=387 2024-09-14T10:57:09.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 info.flags=0x17 2024-09-14T10:57:09.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 to cache LRU end 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.510+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:97 4.1c 4:3ab31547:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31ec05f040 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(97 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 4.19 4:9a9258c4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x558ccd4a5c30 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(98 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:99 4.3b 4:df3ca3b6:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31f4059040 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(99 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.511+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:100 4.3d 4:bf157be7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x558ccd4a5c30 2024-09-14T10:57:09.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(100 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:101 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x558ccd4a5c30 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(101 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f3201326800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:102 4.e 4:7222a7a4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(102 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.512+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:103 4.18 4:19d58f30:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(103 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 4.1a 4:5b4e2ec3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(104 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:105 4.10 4:0a79d2fb:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x558ccd4a5c30 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(105 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.513+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 4.1a 4:5b3b0fcc:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31f4059040 2024-09-14T10:57:09.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(106 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:107 4.37 4:ef0ede63:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd56a030 con 0x7f31ec05f040 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(107 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 20 get_obj_state: octx=0x7f31f4018d30 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x558ccd568458 s->prefetch_data=0 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:108 3.3ds0 3:bc517334:::4d2cef0f-8511-4251-8070-7385f93096af.4241.7_15f6f8dc036519d7fe15b39338f6e5db:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ed5e0 con 0x558ccd4a5c30 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(108 4d2cef0f-8511-4251-8070-7385f93096af.4241.7_15f6f8dc036519d7fe15b39338f6e5db [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 10 manifest: total_size = 6 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 20 get_obj_state: setting s->obj_tag to 4d2cef0f-8511-4251-8070-7385f93096af.4241.13766177132868187887 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 20 get_obj_state: octx=0x7f31f4018d30 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x558ccd568458 s->prefetch_data=0 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 20 prepare_atomic_modification: state is not atomic. state=0x558ccd568458 2024-09-14T10:57:09.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.514+0000 7f3201326800 20 bucket index object: :.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.515+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:109 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569640 con 0x558ccd4a5c30 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.516+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(109 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.516+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:110 3.3ds0 3:bc517334:::4d2cef0f-8511-4251-8070-7385f93096af.4241.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569640 con 0x558ccd4a5c30 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(110 4d2cef0f-8511-4251-8070-7385f93096af.4241.7_15f6f8dc036519d7fe15b39338f6e5db [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:111 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4f1bf0 con 0x558ccd4a5c30 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 20 list_objects_ordered: starting attempt 1 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:112 4.1c 4:3ab31547:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f31f4074000 con 0x7f31ec05f040 2024-09-14T10:57:09.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:113 4.19 4:9a9258c4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4f1bf0 con 0x558ccd4a5c30 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:114 4.3b 4:df3ca3b6:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4f8340 con 0x7f31f4059040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:115 4.3d 4:bf157be7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4faf00 con 0x558ccd4a5c30 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:116 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4fdcc0 con 0x558ccd4a5c30 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:117 4.e 4:7222a7a4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ae0 con 0x7f31f4059040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:118 4.18 4:19d58f30:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd5038c0 con 0x7f31f4059040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:119 4.1a 4:5b4e2ec3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd5066f0 con 0x7f31f4059040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:120 4.10 4:0a79d2fb:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd509520 con 0x558ccd4a5c30 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:121 4.1a 4:5b3b0fcc:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd50c280 con 0x7f31f4059040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.517+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:122 4.37 4:ef0ede63:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd50ed10 con 0x7f31ec05f040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(112 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(122 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(113 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(115 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(114 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(117 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(120 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(119 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(118 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(121 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(111 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [stat,call,call] v37'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.518+0000 7f30d37fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(116 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T10:57:09.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[4d2cef0f-8511-4251-8070-7385f93096af.4241.7])"; uploads.size()=0; is_truncated=0 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:123 4.1c 4:3ab31547:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500b00 con 0x7f31ec05f040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:124 4.19 4:9a9258c4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4fdcc0 con 0x558ccd4a5c30 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:125 4.3b 4:df3ca3b6:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd5038c0 con 0x7f31f4059040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:126 4.3d 4:bf157be7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500b00 con 0x558ccd4a5c30 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:127 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd50c200 con 0x558ccd4a5c30 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:128 4.e 4:7222a7a4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4fdcc0 con 0x7f31f4059040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:129 4.18 4:19d58f30:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd5038c0 con 0x7f31f4059040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:130 4.1a 4:5b4e2ec3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500b00 con 0x7f31f4059040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:131 4.10 4:0a79d2fb:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd503450 con 0x558ccd4a5c30 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:132 4.1a 4:5b3b0fcc:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd50c200 con 0x7f31f4059040 2024-09-14T10:57:09.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:133 4.37 4:ef0ede63:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500b00 con 0x7f31ec05f040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(123 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(128 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5 [call out=89b] v0'0 uv15 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(124 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(129 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(126 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(131 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(127 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f31f4066040 con 0x558ccd4a5c30 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(125 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(133 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.519+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(130 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.520+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(132 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.520+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(134 foo.buckets [call] v37'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31f4059040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 20 rados_obj.operate() r=0 bl.length=165 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.521+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31f4059040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(136 myfoo [call,call,delete] v37'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f3201326800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94063228784720 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31ec05f040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== watch-notify(notify (1) cookie 94063228030752 notify 158913789997 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558ccd4ebcc0 con 0x7f31ec05f040 2024-09-14T10:57:09.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f30d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789997 cookie 94063228030752 notifier 4793 bl.length()=149 2024-09-14T10:57:09.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f30d3fff640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f30c0003d60 con 0x7f31ec05f040 2024-09-14T10:57:09.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.522+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(137 notify.6 [notify cookie 94063228784720 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.523+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.523+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== watch-notify(notify_complete (2) cookie 94063228784720 notify 158913789997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31e404a040 con 0x7f31ec05f040 2024-09-14T10:57:09.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.523+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:139 8.6 8:63f283c7:root::.bucket.meta.myfoo%3a4d2cef0f-8511-4251-8070-7385f93096af.4241.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31ec05f040 2024-09-14T10:57:09.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(139 .bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 [call,call,delete] v37'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7 from cache 2024-09-14T10:57:09.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:4d2cef0f-8511-4251-8070-7385f93096af.4241.7, ofs0, ns] 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 94063228276400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== watch-notify(notify (1) cookie 94063228025008 notify 158913789998 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f31e404a040 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f30d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789998 cookie 94063228025008 notifier 4793 bl.length()=206 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f30d37fe640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f3030003320 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(140 notify.7 [notify cookie 94063228276400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== watch-notify(notify_complete (2) cookie 94063228276400 notify 158913789998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ccd4bce90 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:142 4.1c 4:3ab31547:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31ec05f040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:143 4.19 4:9a9258c4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500230 con 0x558ccd4a5c30 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:144 4.3b 4:df3ca3b6:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd509240 con 0x7f31f4059040 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:145 4.3d 4:bf157be7:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x558ccd4a5c30 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 4.15 4:a95d0dff:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4eb410 con 0x558ccd4a5c30 2024-09-14T10:57:09.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:147 4.e 4:7222a7a4:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd509240 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:148 4.18 4:19d58f30:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500ab0 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:149 4.1a 4:5b4e2ec3:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd509240 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:150 4.10 4:0a79d2fb:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4eb410 con 0x558ccd4a5c30 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.524+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:151 4.1a 4:5b3b0fcc:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4eb410 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.525+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:152 4.37 4:ef0ede63:::.dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd50a320 con 0x7f31ec05f040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(145 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.3 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(150 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.8 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(142 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.0 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(144 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.2 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(143 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.1 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(147 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.5 [delete] v37'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.526+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(146 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.4 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.527+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(152 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.10 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.527+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(148 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.6 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.527+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(149 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.7 [delete] v37'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 42 ==== osd_op_reply(151 .dir.4d2cef0f-8511-4251-8070-7385f93096af.4241.7.9 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.7 : miss 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:153 6.b 6:d038e576:::pubsub..bucket.myfoo%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x558ccd4a5c30 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.7 info.flags=0x0 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 10 adding default.rgw.log++pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.7 to cache LRU end 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.528+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:154 6.b 6:d038e576:::pubsub..bucket.myfoo%2f4d2cef0f-8511-4251-8070-7385f93096af.4241.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x558ccd4a5c30 2024-09-14T10:57:09.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.529+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/4d2cef0f-8511-4251-8070-7385f93096af.4241.7 [delete] v37'29 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.529+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.530+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 43 ==== osd_op_reply(155 foo.buckets [call] v37'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.530+0000 7f3201326800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.530+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x7f31ec05f040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v37'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94063228276400 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500890 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 44 ==== watch-notify(notify (1) cookie 94063228020944 notify 158913789971 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558ccd4bb990 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f30d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 94063228020944 notifier 4793 bl.length()=170 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 45 ==== osd_op_reply(157 notify.3 [notify cookie 94063228276400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f30d3fff640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f30c0003d60 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 46 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 47 ==== watch-notify(notify_complete (2) cookie 94063228276400 notify 158913789971 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f31ec0a0040 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f3201326800 10 removing email index: foo@foo.com 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.531+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x558ccd4a1240 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.532+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(159 foo@foo.com [delete] v37'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.532+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.532+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94063228276400 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500890 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 48 ==== watch-notify(notify (1) cookie 94063228020944 notify 158913789972 ret 0) ==== 204+0+0 (crc 0 0 0) 0x7f31ec0a0040 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f30d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789972 cookie 94063228020944 notifier 4793 bl.length()=162 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f30d37fe640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f3030003320 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 49 ==== osd_op_reply(160 notify.3 [notify cookie 94063228276400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 50 ==== watch-notify(notify_complete (2) cookie 94063228276400 notify 158913789972 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ccd4678c0 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 51 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f3201326800 10 removing user buckets index 2024-09-14T10:57:09.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.533+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x7f31f4059040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 52 ==== osd_op_reply(162 foo.buckets [delete] v37'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94063228276400 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd500890 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== watch-notify(notify (1) cookie 94063228026752 notify 158913789999 ret 0) ==== 202+0+0 (crc 0 0 0) 0x558ccd4bce90 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f30d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789999 cookie 94063228026752 notifier 4793 bl.length()=160 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f30d3fff640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f30c0003d60 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.534+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(163 notify.5 [notify cookie 94063228276400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.535+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.535+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== watch-notify(notify_complete (2) cookie 94063228276400 notify 158913789999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ccd4bd7a0 con 0x7f31ec05f040 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.535+0000 7f3201326800 10 removing user index: foo 2024-09-14T10:57:09.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.535+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd569050 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(165 foo [call,call,delete] v37'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f3201326800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f3201326800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94063228276400 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4ea200 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== watch-notify(notify (1) cookie 94063228022736 notify 158913789970 ret 0) ==== 194+0+0 (crc 0 0 0) 0x558ccd4bd7a0 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f30d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 94063228022736 notifier 4793 bl.length()=152 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f30d37fe640 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f30300032e0 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(166 notify.4 [notify cookie 94063228276400 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.536+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== watch-notify(notify_complete (2) cookie 94063228276400 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ccd4bd590 con 0x558ccd4a1240 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.537+0000 7f30b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.537+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063228032448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x558ccd4a1240 2024-09-14T10:57:09.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.538+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94063228032448] v37'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.538+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063228010208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x7f31f4059040 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.539+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 53 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94063228010208] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.539+0000 7f3201326800 20 remove_watcher() i=0 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.539+0000 7f3201326800 2 removed watcher, disabling cache 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.539+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063228014672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x558ccd4a1240 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.541+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94063228014672] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.541+0000 7f3201326800 20 remove_watcher() i=1 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.541+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063228018576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x558ccd4a5c30 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.542+0000 7f31fd75e640 1 -- 172.21.15.164:0/2647144217 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94063228018576] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31f4081040 con 0x558ccd4a5c30 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.542+0000 7f3201326800 20 remove_watcher() i=2 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.542+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063228020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x7f31f4059040 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.543+0000 7f31fcf5d640 1 -- 172.21.15.164:0/2647144217 <== osd.2 v2:172.21.15.164:6800/813620551 54 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94063228020944] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31ec051070 con 0x7f31f4059040 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.543+0000 7f3201326800 20 remove_watcher() i=3 2024-09-14T10:57:09.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.543+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063228022736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x558ccd4a1240 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.544+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94063228022736] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x558ccd4a1240 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.544+0000 7f3201326800 20 remove_watcher() i=4 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.544+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063228026752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.545+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94063228026752] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.545+0000 7f3201326800 20 remove_watcher() i=5 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.545+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063228030752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.546+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 47 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94063228030752] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.546+0000 7f3201326800 20 remove_watcher() i=6 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.546+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063228025008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558ccd4b3660 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 <== osd.0 v2:172.21.15.116:6800/1614093354 48 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94063228025008] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31e4039040 con 0x7f31ec05f040 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 20 remove_watcher() i=7 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31ec05f040 msgr2=0x7f31ec07d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f31ec05f040 0x7f31ec07d760 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd4a1240 msgr2=0x558ccd4a3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd4a1240 0x558ccd4a3700 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31f4059040 msgr2=0x7f31f4001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f31f4059040 0x7f31f4001770 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd4a5c30 msgr2=0x558ccd4a8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd4a5c30 0x558ccd4a8020 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c803cdc0 msgr2=0x7f30c803f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30c803cdc0 0x7f30c803f280 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f31ec05dac0 tx=0x7f31ec088000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 msgr2=0x558ccd495480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/2647144217 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd48de90 0x558ccd495480 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f31f4053420 tx=0x7f31f40544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 reap_dead start 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f31fc75c640 1 -- 172.21.15.164:0/2647144217 reap_dead start 2024-09-14T10:57:09.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 shutdown_connections 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 >> 172.21.15.164:0/2647144217 conn(0x558ccd48a290 msgr2=0x558ccd4884a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 shutdown_connections 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/2647144217 wait complete. 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 msgr2=0x7f30d403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.547+0000 7f3201326800 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 0x7f30d403f320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x558ccd467d80 tx=0x7f31ec05f500 comp rx=0 tx=0).stop 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 msgr2=0x558ccd481830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x558ccd4674c0 tx=0x7f31f4018830 comp rx=0 tx=0).stop 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 shutdown_connections 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30d403ce60 0x7f30d403f320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/12630715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd481410 0x558ccd481830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 >> 172.21.15.164:0/12630715 conn(0x558ccd4757c0 msgr2=0x558ccd475ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 shutdown_connections 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/12630715 wait complete. 2024-09-14T10:57:09.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 msgr2=0x558ccd46db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 0x558ccd46db10 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 msgr2=0x558ccd4722e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 0x558ccd4722e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 msgr2=0x7f30e403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 0x7f30e403f320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31e4001d70 tx=0x7f31e40012d0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 msgr2=0x558ccd4664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f31ec025c20 tx=0x7f31ec002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 shutdown_connections 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x558ccd46fe40 0x558ccd4722e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558ccd371de0 0x558ccd46db10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f30e403ce60 0x7f30e403f320 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 --2- 172.21.15.164:0/3634322723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558ccd2e0730 0x558ccd4664c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 >> 172.21.15.164:0/3634322723 conn(0x558ccd366fd0 msgr2=0x558ccd458b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 shutdown_connections 2024-09-14T10:57:09.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.548+0000 7f3201326800 1 -- 172.21.15.164:0/3634322723 wait complete. 2024-09-14T10:57:09.554 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-14T10:57:09.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-14T10:57:09.554 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-14T10:57:09.598 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.598 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.599 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.601+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.601+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.601+0000 7f2e0b525800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55617db7b790 0x55617db7bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.601+0000 7f2e0b525800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55617db7d470 con 0x55617db7c8b0 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.601+0000 7f2e0b525800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55617da077d0 con 0x55617db7b790 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e071ae640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55617db7b790 0x55617db7bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e071ae640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55617db7b790 0x55617db7bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57244/0 (socket says 172.21.15.164:57244) 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e069ad640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55617db7c8b0 0x55617db7cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58252/0 (socket says 172.21.15.164:58252) 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e071ae640 1 -- 172.21.15.164:0/598499320 learned_addr learned my addr 172.21.15.164:0/598499320 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e071ae640 1 -- 172.21.15.164:0/598499320 >> v1:172.21.15.116:6789/0 conn(0x55617db7c8b0 legacy=0x55617db7cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.600 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.602+0000 7f2e071ae640 1 -- 172.21.15.164:0/598499320 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617db7d640 con 0x55617db7b790 2024-09-14T10:57:09.601 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e071ae640 1 --2- 172.21.15.164:0/598499320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617db7bb90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2df800a520 tx=0x7f2df8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fa031477d8c4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e061ac640 1 -- 172.21.15.164:0/598499320 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8055070 con 0x55617db7b790 2024-09-14T10:57:09.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e061ac640 1 -- 172.21.15.164:0/598499320 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df80515b0 con 0x55617db7b790 2024-09-14T10:57:09.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e061ac640 1 -- 172.21.15.164:0/598499320 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df80518d0 con 0x55617db7b790 2024-09-14T10:57:09.602 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 -- 172.21.15.164:0/598499320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 msgr2=0x55617db7bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 --2- 172.21.15.164:0/598499320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617db7bb90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2df800a520 tx=0x7f2df8045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 -- 172.21.15.164:0/598499320 shutdown_connections 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 --2- 172.21.15.164:0/598499320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617db7bb90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 -- 172.21.15.164:0/598499320 >> 172.21.15.164:0/598499320 conn(0x55617db76f80 msgr2=0x55617db793e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 -- 172.21.15.164:0/598499320 shutdown_connections 2024-09-14T10:57:09.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.604+0000 7f2e0b525800 1 -- 172.21.15.164:0/598499320 wait complete. 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.618+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e0b525800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e0b525800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55617da14dd0 con 0x55617db7b790 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e071ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e071ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57254/0 (socket says 172.21.15.164:57254) 2024-09-14T10:57:09.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e071ae640 1 -- 172.21.15.164:0/4270220479 learned_addr learned my addr 172.21.15.164:0/4270220479 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e071ae640 1 -- 172.21.15.164:0/4270220479 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617dc6bcd0 con 0x55617db7b790 2024-09-14T10:57:09.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.619+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4270220479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2df80460d0 tx=0x7f2df8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6856c7c1914f75b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2cf560a640 1 -- 172.21.15.164:0/4270220479 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df80519d0 con 0x55617db7b790 2024-09-14T10:57:09.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2cf560a640 1 -- 172.21.15.164:0/4270220479 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8051b70 con 0x55617db7b790 2024-09-14T10:57:09.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2cf560a640 1 -- 172.21.15.164:0/4270220479 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8051e50 con 0x55617db7b790 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 -- 172.21.15.164:0/4270220479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 msgr2=0x55617dc6b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4270220479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f2df80460d0 tx=0x7f2df8051000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 -- 172.21.15.164:0/4270220479 shutdown_connections 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4270220479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617dc6b6e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 -- 172.21.15.164:0/4270220479 >> 172.21.15.164:0/4270220479 conn(0x55617db76f80 msgr2=0x55617dc67060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 -- 172.21.15.164:0/4270220479 shutdown_connections 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.620+0000 7f2e0b525800 1 -- 172.21.15.164:0/4270220479 wait complete. 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e0b525800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e0b525800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55617db82da0 con 0x55617db7b790 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e071ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e071ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57264/0 (socket says 172.21.15.164:57264) 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e071ae640 1 -- 172.21.15.164:0/1742382876 learned_addr learned my addr 172.21.15.164:0/1742382876 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e071ae640 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617daf01d0 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.621+0000 7f2e071ae640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2df80460d0 tx=0x7f2df8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.622+0000 7f2cf3e07640 1 -- 172.21.15.164:0/1742382876 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df8073020 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.622+0000 7f2cf3e07640 1 -- 172.21.15.164:0/1742382876 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df806f580 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.622+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55617dc79160 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.622+0000 7f2cf3e07640 1 -- 172.21.15.164:0/1742382876 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2df806f8a0 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.622+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55617dc79610 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2cf3e07640 1 -- 172.21.15.164:0/1742382876 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2df8076020 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2cf3e07640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 0x7f2cec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2cf3e07640 1 -- 172.21.15.164:0/1742382876 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2df806b040 con 0x55617db7b790 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e069ad640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 0x7f2cec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 0x55617dc7d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dc7dba0 con 0x55617db7c8b0 2024-09-14T10:57:09.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e079af640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 0x55617dc7d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e069ad640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 0x7f2cec03f2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc001e30 tx=0x7f2dfc001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.623+0000 7f2e079af640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 0x55617dc7d580 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e079af640 1 -- 172.21.15.164:0/1742382876 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e0000a4d0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dc7e480 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e079af640 1 -- 172.21.15.164:0/1742382876 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e0000a4d0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 0x55617dc82230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dc829c0 con 0x55617dc7fd90 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e071ae640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 0x55617dc82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.624+0000 7f2e071ae640 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 0x55617dc82230 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e071ae640 1 -- 172.21.15.164:0/1742382876 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2df8057030 con 0x55617dc7fd90 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dc7ecd0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e079af640 1 -- 172.21.15.164:0/1742382876 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e0000a4d0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dc7f0b0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e079af640 1 -- 172.21.15.164:0/1742382876 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e0000a4d0 con 0x55617db7c8b0 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.625+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e0b525800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e0b525800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55617da734a0 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57266/0 (socket says 172.21.15.164:57266) 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e079af640 1 -- 172.21.15.164:0/2781540507 learned_addr learned my addr 172.21.15.164:0/2781540507 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e079af640 1 -- 172.21.15.164:0/2781540507 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617dc91e30 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2e079af640 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55617daef8d0 tx=0x7f2e00018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.626+0000 7f2cf1602640 1 -- 172.21.15.164:0/2781540507 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e00014450 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.627+0000 7f2cf1602640 1 -- 172.21.15.164:0/2781540507 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00014610 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.627+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55617dc92660 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.627+0000 7f2cf1602640 1 -- 172.21.15.164:0/2781540507 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e00014930 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.627+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55617dc92c00 con 0x55617dc913d0 2024-09-14T10:57:09.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.627+0000 7f2cf1602640 1 -- 172.21.15.164:0/2781540507 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2e00011040 con 0x55617dc913d0 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2cf1602640 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 0x7f2ce003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2cf1602640 1 -- 172.21.15.164:0/2781540507 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2e0001e070 con 0x55617dc913d0 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e071ae640 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 0x7f2ce003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e071ae640 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 0x7f2ce003f2d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55617dc7ab80 tx=0x7f2df8096780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e0b525800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e0b525800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55617dc6c040 con 0x55617dc9de90 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57276/0 (socket says 172.21.15.164:57276) 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.628+0000 7f2e079af640 1 -- 172.21.15.164:0/932475743 learned_addr learned my addr 172.21.15.164:0/932475743 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e079af640 1 -- 172.21.15.164:0/932475743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617dc9e860 con 0x55617dc9de90 2024-09-14T10:57:09.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e079af640 1 --2- 172.21.15.164:0/932475743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2e00022ea0 tx=0x7f2e00045490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c22864dccb51b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2ceaffd640 1 -- 172.21.15.164:0/932475743 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0004b070 con 0x55617dc9de90 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2ceaffd640 1 -- 172.21.15.164:0/932475743 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00051070 con 0x55617dc9de90 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2ceaffd640 1 -- 172.21.15.164:0/932475743 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e000167c0 con 0x55617dc9de90 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 -- 172.21.15.164:0/932475743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 msgr2=0x55617dc9e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 --2- 172.21.15.164:0/932475743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2e00022ea0 tx=0x7f2e00045490 comp rx=0 tx=0).stop 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 -- 172.21.15.164:0/932475743 shutdown_connections 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 --2- 172.21.15.164:0/932475743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dc9e270 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 -- 172.21.15.164:0/932475743 >> 172.21.15.164:0/932475743 conn(0x55617dc9a290 msgr2=0x55617dc984d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 -- 172.21.15.164:0/932475743 shutdown_connections 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.629+0000 7f2e0b525800 1 -- 172.21.15.164:0/932475743 wait complete. 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e0b525800 1 Processor -- start 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e0b525800 1 -- start start 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e0b525800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e0b525800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55617dc9eea0 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e079af640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57278/0 (socket says 172.21.15.164:57278) 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 learned_addr learned my addr 172.21.15.164:0/4212830417 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.630+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617dca5960 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2e079af640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2e00053410 tx=0x7f2e00054520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2ce97fa640 1 -- 172.21.15.164:0/4212830417 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e0004b040 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2ce97fa640 1 -- 172.21.15.164:0/4212830417 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00011cf0 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55617dca5bf0 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2ce97fa640 1 -- 172.21.15.164:0/4212830417 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e00014c00 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.631+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55617dca6570 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2ce97fa640 1 -- 172.21.15.164:0/4212830417 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2e00045760 con 0x55617dc9de90 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2ce97fa640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cd003ce10 0x7f2cd003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2ce97fa640 1 -- 172.21.15.164:0/4212830417 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2e0000e040 con 0x55617dc9de90 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cd003ce10 0x7f2cd003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617dcb11b0 0x55617dcb3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb3d90 con 0x55617dcb11b0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e069ad640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617dcb11b0 0x55617dcb3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.632+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cd003ce10 0x7f2cd003f2d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2df8050760 tx=0x7f2df8085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e069ad640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617dcb11b0 0x55617dcb3640 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dfc00f610 con 0x55617dcb11b0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 realm 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb0520 con 0x55617dcb11b0 2024-09-14T10:57:09.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dfc00f610 con 0x55617dcb11b0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb4870 con 0x55617dcb11b0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dfc00f610 con 0x55617dcb11b0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.633+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb5140 con 0x55617dcb11b0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2dfc00f610 con 0x55617dcb11b0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dcb5a80 0x55617dcb7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb85b0 con 0x55617dcb5a80 2024-09-14T10:57:09.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e079af640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dcb5a80 0x55617dcb7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e079af640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dcb5a80 0x55617dcb7e70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 20 searching for the correct realm 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.634+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e079af640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2e00014070 0x7f2e00037a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2e00014070 0x7f2e00037a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2e00014070 0x7f2e00037a40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e071ae640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2df8078020 0x7f2df8098690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.635+0000 7f2e069ad640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2df8078020 0x7f2df8098690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.636+0000 7f2e069ad640 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2df8078020 0x7f2df8098690 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.636+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc00f610 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.636+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.636+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc00f610 con 0x55617dcb11b0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.636+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.637+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.638+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.639+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.640+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x55617dcb11b0 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.641+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb5a80 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.642+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2df8078020 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dfc02b040 con 0x7f2df8078020 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x55617dcb11b0 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9f40 con 0x7f2e00014070 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9030 con 0x55617dcb11b0 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb98d0 con 0x55617dcb11b0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.643+0000 7f2e0b525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb8c70 con 0x55617dcb11b0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 zone default found 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 4 Realm: () 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 zonegroup default 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcb9480 con 0x7f2df8078020 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbc310 con 0x55617dcb5a80 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.644+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbc820 con 0x55617dcb5a80 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.645+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.645+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.645+0000 7f2e0b525800 20 started sync module instance, tier type = 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.645+0000 7f2e0b525800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:09.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.645+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbb780 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.646+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.646+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93877210692464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbd130 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.646+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbd980 con 0x55617dcb11b0 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.647+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93877210692464] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.647+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.647+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93877210696832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbda20 con 0x55617dcb11b0 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.647+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbe520 con 0x55617dcb5a80 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.648+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93877210696832] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.648+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.648+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93877210701840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbe4e0 con 0x55617dcb5a80 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.648+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbefa0 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.649+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.649+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93877210704560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbf840 con 0x7f2e00014070 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.649+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93877210701840] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.649+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcbd510 con 0x55617dcb11b0 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.650+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.650+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93877210709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc06d0 con 0x55617dcb11b0 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.650+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc1190 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.651+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93877210704560] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.651+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.651+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93877210713184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc1150 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.651+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc1ba0 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.651+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93877210709504] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.653+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93877210713184] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.653+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.653+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93877210706832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc16f0 con 0x7f2df8078020 2024-09-14T10:57:09.663 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.653+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc20b0 con 0x7f2df8078020 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93877210706832] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93877210710560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc20b0 con 0x7f2df8078020 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=0 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=1 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=2 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=3 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=4 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=5 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.654+0000 7f2e0b525800 20 add_watcher() i=6 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93877210710560] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e0b525800 20 add_watcher() i=7 2024-09-14T10:57:09.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e0b525800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc53a0 con 0x55617dcb11b0 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.656+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93877210717552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcc2640 con 0x55617dcb11b0 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.657+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93877210717552] v37'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.657+0000 7f2cbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.657+0000 7f2e0b525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.657+0000 7f2e0b525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.657+0000 7f2e0b525800 5 note: GC not initialized 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2cbcfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e0b525800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e0b525800 20 Filter name: none 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2c367fc640 20 reqs_thread_entry: start 2024-09-14T10:57:09.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e0b525800 20 rados->read ofs=0 len=0 2024-09-14T10:57:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf8210 con 0x55617dcb11b0 2024-09-14T10:57:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.658+0000 7f2e0b525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:09.666 INFO:teuthology.orchestra.run.smithi164.stderr:could not fetch user info: no user info saved 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.659+0000 7f2cbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.659+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93877210717552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf81d0 con 0x55617dcb11b0 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.660+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93877210717552] v37'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.660+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93877210692464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x7f2e00014070 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.661+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93877210692464] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.661+0000 7f2e0b525800 20 remove_watcher() i=0 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.661+0000 7f2e0b525800 2 removed watcher, disabling cache 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.661+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93877210696832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x55617dcb11b0 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.662+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93877210696832] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.662+0000 7f2e0b525800 20 remove_watcher() i=1 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.662+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93877210701840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x55617dcb5a80 2024-09-14T10:57:09.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.663+0000 7f2e079af640 1 -- 172.21.15.164:0/4212830417 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93877210701840] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e0002a070 con 0x55617dcb5a80 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.663+0000 7f2e0b525800 20 remove_watcher() i=2 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.663+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93877210704560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x7f2e00014070 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.664+0000 7f2e071ae640 1 -- 172.21.15.164:0/4212830417 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93877210704560] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2df8057030 con 0x7f2e00014070 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.664+0000 7f2e0b525800 20 remove_watcher() i=3 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.664+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93877210709504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x55617dcb11b0 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.666+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93877210709504] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x55617dcb11b0 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.666+0000 7f2e0b525800 20 remove_watcher() i=4 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.666+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93877210713184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x7f2df8078020 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.666+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93877210713184] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.667+0000 7f2e0b525800 20 remove_watcher() i=5 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.667+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93877210706832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x7f2df8078020 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.667+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93877210706832] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.668+0000 7f2e0b525800 20 remove_watcher() i=6 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.668+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93877210710560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55617dcf6080 con 0x7f2df8078020 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93877210710560] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dfc03b040 con 0x7f2df8078020 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 20 remove_watcher() i=7 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2df8078020 msgr2=0x7f2df8098690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2df8078020 0x7f2df8098690 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617dcb11b0 msgr2=0x55617dcb3640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617dcb11b0 0x55617dcb3640 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2e00014070 msgr2=0x7f2e00037a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2e00014070 0x7f2e00037a40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dcb5a80 msgr2=0x55617dcb7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dcb5a80 0x55617dcb7e70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cd003ce10 msgr2=0x7f2cd003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cd003ce10 0x7f2cd003f2d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2df8050760 tx=0x7f2df8085000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 msgr2=0x55617dca5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e069ad640 1 -- 172.21.15.164:0/4212830417 reap_dead start 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2e00053410 tx=0x7f2e00054520 comp rx=0 tx=0).stop 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 shutdown_connections 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/4212830417 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc9de90 0x55617dca5400 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 >> 172.21.15.164:0/4212830417 conn(0x55617dc9a290 msgr2=0x55617dc984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 shutdown_connections 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/4212830417 wait complete. 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 msgr2=0x7f2ce003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 0x7f2ce003f2d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55617dc7ab80 tx=0x7f2df8096780 comp rx=0 tx=0).stop 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 msgr2=0x55617dc917f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55617daef8d0 tx=0x7f2e00018830 comp rx=0 tx=0).stop 2024-09-14T10:57:09.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 shutdown_connections 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2ce003ce10 0x7f2ce003f2d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 --2- 172.21.15.164:0/2781540507 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617dc913d0 0x55617dc917f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 >> 172.21.15.164:0/2781540507 conn(0x55617dc85780 msgr2=0x55617dc85b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 shutdown_connections 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.669+0000 7f2e0b525800 1 -- 172.21.15.164:0/2781540507 wait complete. 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 msgr2=0x55617dc7d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 0x55617dc7d580 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 msgr2=0x55617dc82230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 0x55617dc82230 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 msgr2=0x7f2cec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 0x7f2cec03f2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc001e30 tx=0x7f2dfc001390 comp rx=0 tx=0).stop 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 msgr2=0x55617daefc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2df80460d0 tx=0x7f2df8002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 shutdown_connections 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55617dc7fd90 0x55617dc82230 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55617db7c8b0 0x55617dc7d580 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2cec03ce10 0x7f2cec03f2d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 --2- 172.21.15.164:0/1742382876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55617db7b790 0x55617daefc90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 >> 172.21.15.164:0/1742382876 conn(0x55617db76f80 msgr2=0x55617dc6ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 shutdown_connections 2024-09-14T10:57:09.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.670+0000 7f2e0b525800 1 -- 172.21.15.164:0/1742382876 wait complete. 2024-09-14T10:57:09.677 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-14T10:57:09.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-14T10:57:09.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-14T10:57:09.677 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-14T10:57:09.720 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.721 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.723+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.723+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30d0946800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5633e5091eb0 0x5633e50922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30d0946800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633e5098780 con 0x5633e5094c70 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30d0946800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5633e4f1d7d0 con 0x5633e5091eb0 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30ce437640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5633e5091eb0 0x5633e50922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30cdc36640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5633e5094c70 0x5633e5097060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58264/0 (socket says 172.21.15.164:58264) 2024-09-14T10:57:09.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30cdc36640 1 -- 172.21.15.164:0/4035158691 learned_addr learned my addr 172.21.15.164:0/4035158691 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:09.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30ce437640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5633e5091eb0 0x5633e50922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57286/0 (socket says 172.21.15.164:57286) 2024-09-14T10:57:09.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30ce437640 1 -- 172.21.15.164:0/4035158691 >> v1:172.21.15.116:6789/0 conn(0x5633e5094c70 legacy=0x5633e5097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.724+0000 7f30ce437640 1 -- 172.21.15.164:0/4035158691 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e5099960 con 0x5633e5091eb0 2024-09-14T10:57:09.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.726+0000 7f30ce437640 1 --2- 172.21.15.164:0/4035158691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e50922b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f30c000a470 tx=0x7f30c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5ee2efb58f7eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.726+0000 7f30cd435640 1 -- 172.21.15.164:0/4035158691 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0053570 con 0x5633e5091eb0 2024-09-14T10:57:09.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.726+0000 7f30cd435640 1 -- 172.21.15.164:0/4035158691 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0058070 con 0x5633e5091eb0 2024-09-14T10:57:09.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.726+0000 7f30cd435640 1 -- 172.21.15.164:0/4035158691 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0053880 con 0x5633e5091eb0 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 -- 172.21.15.164:0/4035158691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 msgr2=0x5633e50922b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 --2- 172.21.15.164:0/4035158691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e50922b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f30c000a470 tx=0x7f30c0045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 -- 172.21.15.164:0/4035158691 shutdown_connections 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 --2- 172.21.15.164:0/4035158691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e50922b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 -- 172.21.15.164:0/4035158691 >> 172.21.15.164:0/4035158691 conn(0x5633e508c830 msgr2=0x5633e508ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 -- 172.21.15.164:0/4035158691 shutdown_connections 2024-09-14T10:57:09.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.727+0000 7f30d0946800 1 -- 172.21.15.164:0/4035158691 wait complete. 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30d0946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30d0946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633e4f2add0 con 0x5633e5091eb0 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57290/0 (socket says 172.21.15.164:57290) 2024-09-14T10:57:09.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30ce437640 1 -- 172.21.15.164:0/665575800 learned_addr learned my addr 172.21.15.164:0/665575800 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30ce437640 1 -- 172.21.15.164:0/665575800 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e5180c50 con 0x5633e5091eb0 2024-09-14T10:57:09.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.741+0000 7f30ce437640 1 --2- 172.21.15.164:0/665575800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f30c0025c20 tx=0x7f30c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9434e7b2e9ddf64f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f2fbc608640 1 -- 172.21.15.164:0/665575800 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0053a20 con 0x5633e5091eb0 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f2fbc608640 1 -- 172.21.15.164:0/665575800 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0063070 con 0x5633e5091eb0 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f2fbc608640 1 -- 172.21.15.164:0/665575800 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0053cf0 con 0x5633e5091eb0 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 -- 172.21.15.164:0/665575800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 msgr2=0x5633e5180660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 --2- 172.21.15.164:0/665575800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f30c0025c20 tx=0x7f30c0051000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 -- 172.21.15.164:0/665575800 shutdown_connections 2024-09-14T10:57:09.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 --2- 172.21.15.164:0/665575800 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5180660 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 -- 172.21.15.164:0/665575800 >> 172.21.15.164:0/665575800 conn(0x5633e508c830 msgr2=0x5633e517bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 -- 172.21.15.164:0/665575800 shutdown_connections 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.742+0000 7f30d0946800 1 -- 172.21.15.164:0/665575800 wait complete. 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30d0946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30d0946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633e5098c50 con 0x5633e5091eb0 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57304/0 (socket says 172.21.15.164:57304) 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30ce437640 1 -- 172.21.15.164:0/532927654 learned_addr learned my addr 172.21.15.164:0/532927654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30ce437640 1 -- 172.21.15.164:0/532927654 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e51886c0 con 0x5633e5091eb0 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.743+0000 7f30ce437640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f30c0025c20 tx=0x7f30c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f2fbae05640 1 -- 172.21.15.164:0/532927654 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0068660 con 0x5633e5091eb0 2024-09-14T10:57:09.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f2fbae05640 1 -- 172.21.15.164:0/532927654 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0068800 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f2fbae05640 1 -- 172.21.15.164:0/532927654 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0068ae0 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633e5188950 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e5189560 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f30d0946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633e4f894a0 con 0x5633e5199bb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.744+0000 7f2fbae05640 1 -- 172.21.15.164:0/532927654 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f30c0068c80 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30cec38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30cec38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57310/0 (socket says 172.21.15.164:57310) 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30cec38640 1 -- 172.21.15.164:0/897811230 learned_addr learned my addr 172.21.15.164:0/897811230 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f2fbae05640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 0x7f2fb403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f2fbae05640 1 -- 172.21.15.164:0/532927654 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f30c0098ba0 con 0x5633e5091eb0 2024-09-14T10:57:09.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30ce437640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 0x7f2fb403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30cec38640 1 -- 172.21.15.164:0/897811230 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e519c570 con 0x5633e5199bb0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30cec38640 1 --2- 172.21.15.164:0/897811230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f30c800a3e0 tx=0x7f30c800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d28ce58cf78978 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f30ce437640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 0x7f2fb403f320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f30c0053ca0 tx=0x7f30c0045e60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f2fb8e01640 1 -- 172.21.15.164:0/897811230 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c8015070 con 0x5633e5199bb0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f2fb8e01640 1 -- 172.21.15.164:0/897811230 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c8001670 con 0x5633e5199bb0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.745+0000 7f2fb8e01640 1 -- 172.21.15.164:0/897811230 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c8001990 con 0x5633e5199bb0 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- 172.21.15.164:0/897811230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 msgr2=0x5633e519bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 --2- 172.21.15.164:0/897811230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f30c800a3e0 tx=0x7f30c800a8a0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- 172.21.15.164:0/897811230 shutdown_connections 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 --2- 172.21.15.164:0/897811230 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e519bfa0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- 172.21.15.164:0/897811230 >> 172.21.15.164:0/897811230 conn(0x5633e5094c70 msgr2=0x5633e51900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- 172.21.15.164:0/897811230 shutdown_connections 2024-09-14T10:57:09.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- 172.21.15.164:0/897811230 wait complete. 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30d0946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633e519c800 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30cec38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30cec38640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57322/0 (socket says 172.21.15.164:57322) 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.746+0000 7f30cec38640 1 -- 172.21.15.164:0/4206627898 learned_addr learned my addr 172.21.15.164:0/4206627898 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f30cec38640 1 -- 172.21.15.164:0/4206627898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e51a0fb0 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f30cec38640 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f30c8013040 tx=0x7f30c8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f2fb2ffd640 1 -- 172.21.15.164:0/4206627898 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c8020020 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f2fb2ffd640 1 -- 172.21.15.164:0/4206627898 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c8010780 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633e51a1240 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f2fb2ffd640 1 -- 172.21.15.164:0/4206627898 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c8015040 con 0x5633e5199bb0 2024-09-14T10:57:09.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.747+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e51a1bc0 con 0x5633e5199bb0 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f2fb2ffd640 1 -- 172.21.15.164:0/4206627898 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f30c8023020 con 0x5633e5199bb0 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f2fb2ffd640 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 0x7f2fa803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f2fb2ffd640 1 -- 172.21.15.164:0/4206627898 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f30c8053ce0 con 0x5633e5199bb0 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f30cdc36640 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 0x7f2fa803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f30d0946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.748+0000 7f30d0946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30cdc36640 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 0x7f2fa803f320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f30c4001cf0 tx=0x7f30c4001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30d0946800 1 Processor -- start 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30d0946800 1 -- start start 2024-09-14T10:57:09.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30d0946800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30d0946800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5633e5181020 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30ce437640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57338/0 (socket says 172.21.15.164:57338) 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30ce437640 1 -- 172.21.15.164:0/382386942 learned_addr learned my addr 172.21.15.164:0/382386942 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.749+0000 7f30ce437640 1 -- 172.21.15.164:0/382386942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e51bb5b0 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f30ce437640 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f30c005db10 tx=0x7f30c005cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f2f937e6640 1 -- 172.21.15.164:0/382386942 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c005c540 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f2f937e6640 1 -- 172.21.15.164:0/382386942 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0074480 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633e51bbde0 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f2f937e6640 1 -- 172.21.15.164:0/382386942 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30c0074780 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.750+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e51bc380 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f2f937e6640 1 -- 172.21.15.164:0/382386942 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f30c0086070 con 0x5633e51bab50 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f2f937e6640 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 0x7f2f0c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f2f937e6640 1 -- 172.21.15.164:0/382386942 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f30c0091070 con 0x5633e51bab50 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f30cdc36640 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 0x7f2f0c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f2f917e2640 20 reqs_thread_entry: start 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 0x5633e51ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f30cdc36640 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 0x7f2f0c03f2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000f60 tx=0x7f30c400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633e51cb040 con 0x5633e51c8500 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.751+0000 7f30cec38640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 0x5633e51ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30cec38640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 0x5633e51ca970 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30cec38640 1 -- 172.21.15.164:0/532927654 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30c800e070 con 0x5633e51c8500 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 0x5633e51cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:2 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5633e51cf900 con 0x5633e51cce10 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30ce437640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 0x5633e51cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.752+0000 7f30ce437640 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 0x5633e51cf200 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30ce437640 1 -- 172.21.15.164:0/532927654 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(2 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30c0085030 con 0x5633e51cce10 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 msgr2=0x7f2fa803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 0x7f2fa803f320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f30c4001cf0 tx=0x7f30c4001250 comp rx=0 tx=0).stop 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 msgr2=0x5633e51a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f30c8013040 tx=0x7f30c8003370 comp rx=0 tx=0).stop 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 shutdown_connections 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fa803ce60 0x7f2fa803f320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 --2- 172.21.15.164:0/4206627898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5199bb0 0x5633e51a0a50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.753+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 >> 172.21.15.164:0/4206627898 conn(0x5633e5094c70 msgr2=0x5633e5190090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 shutdown_connections 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/4206627898 wait complete. 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 msgr2=0x7f2f0c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 0x7f2f0c03f2d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f30c4000f60 tx=0x7f30c400f000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 msgr2=0x5633e51baf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f30c005db10 tx=0x7f30c005cc20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 shutdown_connections 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2f0c03ce10 0x7f2f0c03f2d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/382386942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e51bab50 0x5633e51baf70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 >> 172.21.15.164:0/382386942 conn(0x5633e51b0090 msgr2=0x5633e51b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 shutdown_connections 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/382386942 wait complete. 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 msgr2=0x5633e51ca970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 0x5633e51ca970 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 msgr2=0x5633e51cf200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.754+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 0x5633e51cf200 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 msgr2=0x7f2fb403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 0x7f2fb403f320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f30c0053ca0 tx=0x7f30c0045e60 comp rx=0 tx=0).stop 2024-09-14T10:57:09.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 msgr2=0x5633e5188160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f30c0025c20 tx=0x7f30c0002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 shutdown_connections 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5633e51cce10 0x5633e51cf200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5633e51c8500 0x5633e51ca970 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2fb403ce60 0x7f2fb403f320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 --2- 172.21.15.164:0/532927654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5633e5091eb0 0x5633e5188160 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 >> 172.21.15.164:0/532927654 conn(0x5633e508c830 msgr2=0x5633e517a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 shutdown_connections 2024-09-14T10:57:09.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.755+0000 7f30d0946800 1 -- 172.21.15.164:0/532927654 wait complete. 2024-09-14T10:57:09.761 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:57:09.761 DEBUG:tasks.util.rgw: json result: {'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:57:09.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-14T10:57:09.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-14T10:57:09.762 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-14T10:57:09.804 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.805 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.807+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.807+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e0662f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55bbe7615cd0 0x55bbe76160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e0662f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bbe7617380 con 0x55bbe7616700 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e0662f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55bbe74a17d0 con 0x55bbe7615cd0 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e04119640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55bbe7615cd0 0x55bbe76160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e04119640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55bbe7615cd0 0x55bbe76160d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57344/0 (socket says 172.21.15.164:57344) 2024-09-14T10:57:09.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e03918640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55bbe7616700 0x55bbe7616bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58278/0 (socket says 172.21.15.164:58278) 2024-09-14T10:57:09.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e04119640 1 -- 172.21.15.164:0/457428667 learned_addr learned my addr 172.21.15.164:0/457428667 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e04119640 1 -- 172.21.15.164:0/457428667 >> v1:172.21.15.116:6789/0 conn(0x55bbe7616700 legacy=0x55bbe7616bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.808+0000 7f4e04119640 1 -- 172.21.15.164:0/457428667 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe76175a0 con 0x55bbe7615cd0 2024-09-14T10:57:09.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.810+0000 7f4e04119640 1 --2- 172.21.15.164:0/457428667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76160d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4df400a520 tx=0x7f4df4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cac6a7fe46ad9f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.810+0000 7f4e03117640 1 -- 172.21.15.164:0/457428667 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4055070 con 0x55bbe7615cd0 2024-09-14T10:57:09.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.810+0000 7f4e03117640 1 -- 172.21.15.164:0/457428667 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df40515b0 con 0x55bbe7615cd0 2024-09-14T10:57:09.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.810+0000 7f4e03117640 1 -- 172.21.15.164:0/457428667 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40518d0 con 0x55bbe7615cd0 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 -- 172.21.15.164:0/457428667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 msgr2=0x55bbe76160d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 --2- 172.21.15.164:0/457428667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76160d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4df400a520 tx=0x7f4df4045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 -- 172.21.15.164:0/457428667 shutdown_connections 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 --2- 172.21.15.164:0/457428667 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76160d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 -- 172.21.15.164:0/457428667 >> 172.21.15.164:0/457428667 conn(0x55bbe76106d0 msgr2=0x55bbe7612b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 -- 172.21.15.164:0/457428667 shutdown_connections 2024-09-14T10:57:09.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.811+0000 7f4e0662f800 1 -- 172.21.15.164:0/457428667 wait complete. 2024-09-14T10:57:09.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.824+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.824+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e0662f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e0662f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bbe74aedd0 con 0x55bbe7615cd0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57354/0 (socket says 172.21.15.164:57354) 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e04119640 1 -- 172.21.15.164:0/4086766025 learned_addr learned my addr 172.21.15.164:0/4086766025 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e04119640 1 -- 172.21.15.164:0/4086766025 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe7709390 con 0x55bbe7615cd0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.825+0000 7f4e04119640 1 --2- 172.21.15.164:0/4086766025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4df40460d0 tx=0x7f4df4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c3cc7e244147ee server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4cf260c640 1 -- 172.21.15.164:0/4086766025 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40519d0 con 0x55bbe7615cd0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4cf260c640 1 -- 172.21.15.164:0/4086766025 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4051b70 con 0x55bbe7615cd0 2024-09-14T10:57:09.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4cf260c640 1 -- 172.21.15.164:0/4086766025 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4051e50 con 0x55bbe7615cd0 2024-09-14T10:57:09.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 -- 172.21.15.164:0/4086766025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 msgr2=0x55bbe76152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 --2- 172.21.15.164:0/4086766025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4df40460d0 tx=0x7f4df4051000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 -- 172.21.15.164:0/4086766025 shutdown_connections 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 --2- 172.21.15.164:0/4086766025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe76152d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 -- 172.21.15.164:0/4086766025 >> 172.21.15.164:0/4086766025 conn(0x55bbe76106d0 msgr2=0x55bbe7701050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 -- 172.21.15.164:0/4086766025 shutdown_connections 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.826+0000 7f4e0662f800 1 -- 172.21.15.164:0/4086766025 wait complete. 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e0662f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe770e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e0662f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bbe761cea0 con 0x55bbe7615cd0 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe770e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe770e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57360/0 (socket says 172.21.15.164:57360) 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.827+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 learned_addr learned my addr 172.21.15.164:0/1549968624 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe770e730 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe770e1d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4df40460d0 tx=0x7f4df4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4cf0e09640 1 -- 172.21.15.164:0/1549968624 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4073020 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4cf0e09640 1 -- 172.21.15.164:0/1549968624 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df406f580 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe770e9c0 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4cf0e09640 1 -- 172.21.15.164:0/1549968624 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df406f8a0 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe770f5d0 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.828+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0662f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0662f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bbe750d4a0 con 0x55bbe771b8a0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cf0e09640 1 -- 172.21.15.164:0/1549968624 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4df4076020 con 0x55bbe7615cd0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0491a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0491a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57364/0 (socket says 172.21.15.164:57364) 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0491a640 1 -- 172.21.15.164:0/564565614 learned_addr learned my addr 172.21.15.164:0/564565614 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cf0e09640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cec03ce10 0x7f4cec03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cf0e09640 1 -- 172.21.15.164:0/1549968624 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4df406b040 con 0x55bbe7615cd0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cec03ce10 0x7f4cec03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0491a640 1 -- 172.21.15.164:0/564565614 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe771e260 con 0x55bbe771b8a0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e0491a640 1 --2- 172.21.15.164:0/564565614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00a3e0 tx=0x7f4dfc00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddb7d4f1292582c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cec03ce10 0x7f4cec03f2d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4df4065fd0 tx=0x7f4df4064e20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cea7fc640 1 -- 172.21.15.164:0/564565614 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc015070 con 0x55bbe771b8a0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cea7fc640 1 -- 172.21.15.164:0/564565614 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc001670 con 0x55bbe771b8a0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.829+0000 7f4cea7fc640 1 -- 172.21.15.164:0/564565614 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc001990 con 0x55bbe771b8a0 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- 172.21.15.164:0/564565614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 msgr2=0x55bbe771dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 --2- 172.21.15.164:0/564565614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00a3e0 tx=0x7f4dfc00a8a0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- 172.21.15.164:0/564565614 shutdown_connections 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 --2- 172.21.15.164:0/564565614 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe771dc90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- 172.21.15.164:0/564565614 >> 172.21.15.164:0/564565614 conn(0x55bbe7616700 msgr2=0x55bbe77161c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- 172.21.15.164:0/564565614 shutdown_connections 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- 172.21.15.164:0/564565614 wait complete. 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.830+0000 7f4e0662f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bbe771e550 con 0x55bbe771b8a0 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0491a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0491a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57368/0 (socket says 172.21.15.164:57368) 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0491a640 1 -- 172.21.15.164:0/189477322 learned_addr learned my addr 172.21.15.164:0/189477322 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0491a640 1 -- 172.21.15.164:0/189477322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe7722d30 con 0x55bbe771b8a0 2024-09-14T10:57:09.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0491a640 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc013040 tx=0x7f4dfc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4ce8ff9640 1 -- 172.21.15.164:0/189477322 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc020020 con 0x55bbe771b8a0 2024-09-14T10:57:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4ce8ff9640 1 -- 172.21.15.164:0/189477322 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc010780 con 0x55bbe771b8a0 2024-09-14T10:57:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe7722fc0 con 0x55bbe771b8a0 2024-09-14T10:57:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4ce8ff9640 1 -- 172.21.15.164:0/189477322 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dfc015040 con 0x55bbe771b8a0 2024-09-14T10:57:09.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.831+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe7723940 con 0x55bbe771b8a0 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.832+0000 7f4ce8ff9640 1 -- 172.21.15.164:0/189477322 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4dfc023020 con 0x55bbe771b8a0 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.832+0000 7f4ce8ff9640 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 0x7f4cdc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4ce8ff9640 1 -- 172.21.15.164:0/189477322 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4dfc053c90 con 0x55bbe771b8a0 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e03918640 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 0x7f4cdc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e03918640 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 0x7f4cdc03f2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4df8001db0 tx=0x7f4df8001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 1 Processor -- start 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 1 -- start start 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.833+0000 7f4e0662f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bbe7709590 con 0x55bbe773c8b0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e04119640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57376/0 (socket says 172.21.15.164:57376) 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e04119640 1 -- 172.21.15.164:0/3016849729 learned_addr learned my addr 172.21.15.164:0/3016849729 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e04119640 1 -- 172.21.15.164:0/3016849729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe773d310 con 0x55bbe773c8b0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e04119640 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4df4064f90 tx=0x7f4df40966f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4cc8fe1640 1 -- 172.21.15.164:0/3016849729 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4060e60 con 0x55bbe773c8b0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4cc8fe1640 1 -- 172.21.15.164:0/3016849729 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4064a30 con 0x55bbe773c8b0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4cc8fe1640 1 -- 172.21.15.164:0/3016849729 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40964d0 con 0x55bbe773c8b0 2024-09-14T10:57:09.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbe773db40 con 0x55bbe773c8b0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.834+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe773e0e0 con 0x55bbe773c8b0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.835+0000 7f4cc8fe1640 1 -- 172.21.15.164:0/3016849729 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4df408c040 con 0x55bbe773c8b0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.835+0000 7f4cc8fe1640 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 0x7f4c4403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.835+0000 7f4cc8fe1640 1 -- 172.21.15.164:0/3016849729 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4df4062070 con 0x55bbe773c8b0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.835+0000 7f4e03918640 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 0x7f4c4403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4c727fc640 20 reqs_thread_entry: start 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e03918640 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 0x7f4c4403f2d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f60 tx=0x7f4df800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bbe774a220 0x55bbe774c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe774cd10 con 0x55bbe774a220 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0491a640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bbe774a220 0x55bbe774c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0491a640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bbe774a220 0x55bbe774c690 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.836+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe774d5c0 con 0x55bbe774a220 2024-09-14T10:57:09.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bbe774ee80 0x55bbe77512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7751a80 con 0x55bbe774ee80 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bbe774ee80 0x55bbe77512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bbe774ee80 0x55bbe77512f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.837+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe775ebc0 con 0x55bbe774a220 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:NOTICE: set zone's realm_id= 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(5 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e04119640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4df408f040 0x7f4df4006880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e03918640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4df408f040 0x7f4df4006880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.838+0000 7f4e03918640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4df408f040 0x7f4df4006880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e03918640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4df800f070 0x7f4df800e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e0491a640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4df800f070 0x7f4df800e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e0491a640 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4df800f070 0x7f4df800e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.839+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.840+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.841+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(17 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.842+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=137b] v28'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.843+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(25 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.844+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774ee80 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.845+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df800f070 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dfc042040 con 0x7f4df800f070 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x55bbe774a220 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(35 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7755f80 con 0x7f4df408f040 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e03918640 1 -- 172.21.15.164:0/1549968624 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(36 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df801e700 con 0x7f4df408f040 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7758a30 con 0x55bbe774a220 2024-09-14T10:57:09.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.846+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:38 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bbe775ca90 con 0x55bbe774ee80 2024-09-14T10:57:09.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.847+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(38 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.847+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:39 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bbe774e1e0 con 0x55bbe774ee80 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.848+0000 7f4e04119640 1 -- 172.21.15.164:0/1549968624 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(39 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [create,call,writefull 0~1155] v37'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f4df409f070 con 0x55bbe774ee80 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.848+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bbe775b410 con 0x55bbe774a220 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.849+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v37'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.849+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bbe7758eb0 con 0x55bbe774a220 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.850+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v37'3 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f4dfc042040 con 0x55bbe774a220 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 msgr2=0x7f4cdc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 0x7f4cdc03f2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4df8001db0 tx=0x7f4df8001310 comp rx=0 tx=0).stop 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 msgr2=0x55bbe77227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc013040 tx=0x7f4dfc003370 comp rx=0 tx=0).stop 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 shutdown_connections 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cdc03ce10 0x7f4cdc03f2d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/189477322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe771b8a0 0x55bbe77227d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 >> 172.21.15.164:0/189477322 conn(0x55bbe7616700 msgr2=0x55bbe7716190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 shutdown_connections 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/189477322 wait complete. 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 msgr2=0x7f4c4403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 0x7f4c4403f2d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4df8000f60 tx=0x7f4df800f000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 msgr2=0x55bbe773ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4df4064f90 tx=0x7f4df40966f0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 shutdown_connections 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4c4403ce10 0x7f4c4403f2d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 --2- 172.21.15.164:0/3016849729 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe773c8b0 0x55bbe773ccd0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 >> 172.21.15.164:0/3016849729 conn(0x55bbe7731df0 msgr2=0x55bbe77321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 shutdown_connections 2024-09-14T10:57:09.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.851+0000 7f4e0662f800 1 -- 172.21.15.164:0/3016849729 wait complete. 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4df800f070 msgr2=0x7f4df800e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f4df800f070 0x7f4df800e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bbe774a220 msgr2=0x55bbe774c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bbe774a220 0x55bbe774c690 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4df408f040 msgr2=0x7f4df4006880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f4df408f040 0x7f4df4006880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bbe774ee80 msgr2=0x55bbe77512f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bbe774ee80 0x55bbe77512f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cec03ce10 msgr2=0x7f4cec03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f4cec03ce10 0x7f4cec03f2d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4df4065fd0 tx=0x7f4df4064e20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 msgr2=0x55bbe770e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 --2- 172.21.15.164:0/1549968624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bbe7615cd0 0x55bbe770e1d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4df40460d0 tx=0x7f4df4002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 reap_dead start 2024-09-14T10:57:09.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0491a640 1 -- 172.21.15.164:0/1549968624 reap_dead start 2024-09-14T10:57:09.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 shutdown_connections 2024-09-14T10:57:09.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 >> 172.21.15.164:0/1549968624 conn(0x55bbe76106d0 msgr2=0x55bbe76ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 shutdown_connections 2024-09-14T10:57:09.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.852+0000 7f4e0662f800 1 -- 172.21.15.164:0/1549968624 wait complete. 2024-09-14T10:57:09.860 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:57:09.860 DEBUG:tasks.util.rgw: json result: {'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:57:09.860 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-14T10:57:09.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-14T10:57:09.860 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-14T10:57:09.942 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:09.942 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:09.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f803132c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55fc417faba0 0x55fc417fd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f803132c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc417fd710 con 0x55fc4176a7a0 2024-09-14T10:57:09.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f803132c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55fc416817d0 con 0x55fc417faba0 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f802c84e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55fc417faba0 0x55fc417fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f802d04f640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55fc4176a7a0 0x55fc417f9450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58288/0 (socket says 172.21.15.164:58288) 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f802d04f640 1 -- 172.21.15.164:0/1814944189 learned_addr learned my addr 172.21.15.164:0/1814944189 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.945+0000 7f802c84e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55fc417faba0 0x55fc417fd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57390/0 (socket says 172.21.15.164:57390) 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.946+0000 7f802c84e640 1 -- 172.21.15.164:0/1814944189 >> v1:172.21.15.116:6789/0 conn(0x55fc4176a7a0 legacy=0x55fc417f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.946+0000 7f802c84e640 1 -- 172.21.15.164:0/1814944189 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc417fe940 con 0x55fc417faba0 2024-09-14T10:57:09.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.946+0000 7f801ffff640 1 -- 172.21.15.164:0/1814944189 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995398813 0 0) 0x55fc417fd710 con 0x55fc4176a7a0 2024-09-14T10:57:09.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.947+0000 7f802c84e640 1 --2- 172.21.15.164:0/1814944189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc417faba0 0x55fc417fd060 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f802400a470 tx=0x7f8024045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484d645180b604d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f801ffff640 1 -- 172.21.15.164:0/1814944189 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8024053570 con 0x55fc417faba0 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f801ffff640 1 -- 172.21.15.164:0/1814944189 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8024058070 con 0x55fc417faba0 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f801ffff640 1 -- 172.21.15.164:0/1814944189 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8024053880 con 0x55fc417faba0 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 -- 172.21.15.164:0/1814944189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc417faba0 msgr2=0x55fc417fd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 --2- 172.21.15.164:0/1814944189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc417faba0 0x55fc417fd060 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f802400a470 tx=0x7f8024045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 -- 172.21.15.164:0/1814944189 shutdown_connections 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 --2- 172.21.15.164:0/1814944189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc417faba0 0x55fc417fd060 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 -- 172.21.15.164:0/1814944189 >> 172.21.15.164:0/1814944189 conn(0x55fc417f0fa0 msgr2=0x55fc417f33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 -- 172.21.15.164:0/1814944189 shutdown_connections 2024-09-14T10:57:09.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.948+0000 7f803132c800 1 -- 172.21.15.164:0/1814944189 wait complete. 2024-09-14T10:57:09.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.962+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.962+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f803132c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f803132c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fc4168edd0 con 0x55fc4176a7a0 2024-09-14T10:57:09.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57392/0 (socket says 172.21.15.164:57392) 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f802d04f640 1 -- 172.21.15.164:0/2446617509 learned_addr learned my addr 172.21.15.164:0/2446617509 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f802d04f640 1 -- 172.21.15.164:0/2446617509 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc417f71c0 con 0x55fc4176a7a0 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f802d04f640 1 --2- 172.21.15.164:0/2446617509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8020001ea0 tx=0x7f802000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1696799f87f27cf server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.963+0000 7f7f1b606640 1 -- 172.21.15.164:0/2446617509 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8020008070 con 0x55fc4176a7a0 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f7f1b606640 1 -- 172.21.15.164:0/2446617509 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802000d500 con 0x55fc4176a7a0 2024-09-14T10:57:09.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f7f1b606640 1 -- 172.21.15.164:0/2446617509 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f802000d880 con 0x55fc4176a7a0 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 -- 172.21.15.164:0/2446617509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 msgr2=0x55fc417f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 --2- 172.21.15.164:0/2446617509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8020001ea0 tx=0x7f802000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 -- 172.21.15.164:0/2446617509 shutdown_connections 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 --2- 172.21.15.164:0/2446617509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc417f6bd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 -- 172.21.15.164:0/2446617509 >> 172.21.15.164:0/2446617509 conn(0x55fc417f0fa0 msgr2=0x55fc418e1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 -- 172.21.15.164:0/2446617509 shutdown_connections 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.964+0000 7f803132c800 1 -- 172.21.15.164:0/2446617509 wait complete. 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f803132c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f803132c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fc417fdbe0 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57406/0 (socket says 172.21.15.164:57406) 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f802d04f640 1 -- 172.21.15.164:0/3575010446 learned_addr learned my addr 172.21.15.164:0/3575010446 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f802d04f640 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc418f07f0 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f802d04f640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f80200012f0 tx=0x7f8020000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f7f19e03640 1 -- 172.21.15.164:0/3575010446 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f802000f9d0 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f7f19e03640 1 -- 172.21.15.164:0/3575010446 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802000fb70 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f7f19e03640 1 -- 172.21.15.164:0/3575010446 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f802000fe50 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.965+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc418f0a80 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc418f1480 con 0x55fc4176a7a0 2024-09-14T10:57:09.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f803132c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f803132c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fc416ed4a0 con 0x55fc418fd8e0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f7f19e03640 1 -- 172.21.15.164:0/3575010446 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8020017040 con 0x55fc4176a7a0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f802d850640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.966+0000 7f802d850640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57412/0 (socket says 172.21.15.164:57412) 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f802d850640 1 -- 172.21.15.164:0/3411880993 learned_addr learned my addr 172.21.15.164:0/3411880993 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f7f19e03640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 0x7f7f1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f7f19e03640 1 -- 172.21.15.164:0/3575010446 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8020015020 con 0x55fc4176a7a0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f802d04f640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 0x7f7f1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f802d850640 1 -- 172.21.15.164:0/3411880993 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc419002a0 con 0x55fc418fd8e0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f802d850640 1 --2- 172.21.15.164:0/3411880993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f802800a3e0 tx=0x7f802800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ae38d7b3886b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f802d04f640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 0x7f7f1403f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8020018fd0 tx=0x7f8020034040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f7f137fe640 1 -- 172.21.15.164:0/3411880993 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8028015070 con 0x55fc418fd8e0 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f7f137fe640 1 -- 172.21.15.164:0/3411880993 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8028001670 con 0x55fc418fd8e0 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f7f137fe640 1 -- 172.21.15.164:0/3411880993 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8028001990 con 0x55fc418fd8e0 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f803132c800 1 -- 172.21.15.164:0/3411880993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 msgr2=0x55fc418ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.967+0000 7f803132c800 1 --2- 172.21.15.164:0/3411880993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f802800a3e0 tx=0x7f802800a8a0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- 172.21.15.164:0/3411880993 shutdown_connections 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 --2- 172.21.15.164:0/3411880993 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc418ffcd0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- 172.21.15.164:0/3411880993 >> 172.21.15.164:0/3411880993 conn(0x55fc417faba0 msgr2=0x55fc418f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- 172.21.15.164:0/3411880993 shutdown_connections 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- 172.21.15.164:0/3411880993 wait complete. 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f803132c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fc419005f0 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f802d850640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f802d850640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57426/0 (socket says 172.21.15.164:57426) 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.968+0000 7f802d850640 1 -- 172.21.15.164:0/4213432345 learned_addr learned my addr 172.21.15.164:0/4213432345 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f802d850640 1 -- 172.21.15.164:0/4213432345 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc41904dc0 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f802d850640 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8028013040 tx=0x7f8028003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f7f11ffb640 1 -- 172.21.15.164:0/4213432345 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8028020020 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f7f11ffb640 1 -- 172.21.15.164:0/4213432345 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8028010780 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f7f11ffb640 1 -- 172.21.15.164:0/4213432345 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8028015040 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc41905050 con 0x55fc418fd8e0 2024-09-14T10:57:09.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.969+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc419059d0 con 0x55fc418fd8e0 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f7f11ffb640 1 -- 172.21.15.164:0/4213432345 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8028023020 con 0x55fc418fd8e0 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f7f11ffb640 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 0x7f7f0803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f7f11ffb640 1 -- 172.21.15.164:0/4213432345 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8028053ce0 con 0x55fc418fd8e0 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f802c84e640 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 0x7f7f0803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f803132c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.970+0000 7f803132c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f802c84e640 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 0x7f7f0803f320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8024057000 tx=0x7f8024052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f803132c800 1 Processor -- start 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f803132c800 1 -- start start 2024-09-14T10:57:09.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f803132c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f803132c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55fc417f5620 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f802d04f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57440/0 (socket says 172.21.15.164:57440) 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f802d04f640 1 -- 172.21.15.164:0/4016709643 learned_addr learned my addr 172.21.15.164:0/4016709643 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.971+0000 7f802d04f640 1 -- 172.21.15.164:0/4016709643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc4191f3a0 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f802d04f640 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f802000f640 tx=0x7f802001cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f7ef27e4640 1 -- 172.21.15.164:0/4016709643 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8020018ad0 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f7ef27e4640 1 -- 172.21.15.164:0/4016709643 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80200183d0 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc4191fbd0 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f7ef27e4640 1 -- 172.21.15.164:0/4016709643 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8020019e40 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.972+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc41920170 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f7ef27e4640 1 -- 172.21.15.164:0/4016709643 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f802001a740 con 0x55fc4191e940 2024-09-14T10:57:09.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f7ef27e4640 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 0x7f7e6403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f7ef27e4640 1 -- 172.21.15.164:0/4016709643 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8020049d10 con 0x55fc4191e940 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f802c84e640 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 0x7f7e6403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f7eebfff640 20 reqs_thread_entry: start 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 0x55fc4192e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fc4192ef00 con 0x55fc4192c3f0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f802c84e640 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 0x7f7e6403f2d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8024045a60 tx=0x7f8024005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.973+0000 7f802d850640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 0x55fc4192e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f802d850640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 0x55fc4192e880 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f802d850640 1 -- 172.21.15.164:0/3575010446 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f802800e070 con 0x55fc4192c3f0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fc4192f7b0 con 0x55fc4192c3f0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f802d850640 1 -- 172.21.15.164:0/3575010446 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f802800e070 con 0x55fc4192c3f0 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 0x55fc41933530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:09.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fc41933cc0 con 0x55fc419310c0 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f802d04f640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 0x55fc41933530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.974+0000 7f802d04f640 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 0x55fc41933530 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.975+0000 7f802d04f640 1 -- 172.21.15.164:0/3575010446 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f802004f070 con 0x55fc419310c0 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.975+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 msgr2=0x7f7f0803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.975+0000 7f803132c800 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 0x7f7f0803f320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8024057000 tx=0x7f8024052000 comp rx=0 tx=0).stop 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.975+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 msgr2=0x55fc41904860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.975+0000 7f803132c800 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8028013040 tx=0x7f8028003370 comp rx=0 tx=0).stop 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 shutdown_connections 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f0803ce60 0x7f7f0803f320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4213432345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc418fd8e0 0x55fc41904860 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 >> 172.21.15.164:0/4213432345 conn(0x55fc417faba0 msgr2=0x55fc418f81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 shutdown_connections 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4213432345 wait complete. 2024-09-14T10:57:09.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 msgr2=0x7f7e6403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 0x7f7e6403f2d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8024045a60 tx=0x7f8024005a00 comp rx=0 tx=0).stop 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 msgr2=0x55fc4191ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f802000f640 tx=0x7f802001cec0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 shutdown_connections 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7e6403ce10 0x7f7e6403f2d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/4016709643 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4191e940 0x55fc4191ed60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 >> 172.21.15.164:0/4016709643 conn(0x55fc41913ea0 msgr2=0x55fc41914280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 shutdown_connections 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/4016709643 wait complete. 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 msgr2=0x55fc4192e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 0x55fc4192e880 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 msgr2=0x55fc41933530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 0x55fc41933530 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 msgr2=0x7f7f1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 0x7f7f1403f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8020018fd0 tx=0x7f8020034040 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 msgr2=0x55fc418f0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f80200012f0 tx=0x7f8020000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 shutdown_connections 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55fc419310c0 0x55fc41933530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55fc4192c3f0 0x55fc4192e880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7f1403cfb0 0x7f7f1403f470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.976+0000 7f803132c800 1 --2- 172.21.15.164:0/3575010446 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55fc4176a7a0 0x55fc418f0290 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.977+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 >> 172.21.15.164:0/3575010446 conn(0x55fc417f0fa0 msgr2=0x55fc418e1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.977+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 shutdown_connections 2024-09-14T10:57:09.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:09.977+0000 7f803132c800 1 -- 172.21.15.164:0/3575010446 wait complete. 2024-09-14T10:57:09.983 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:57:09.983 DEBUG:tasks.util.rgw: json result: {'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:57:09.984 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:57:09.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-14T10:57:09.984 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-14T10:57:10.071 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.072 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.074+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.074+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f07412800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5646893608d0 0x564689360cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f07412800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646893625b0 con 0x5646893619f0 2024-09-14T10:57:10.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f07412800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5646891ec7d0 con 0x5646893608d0 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f02be0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5646893608d0 0x564689360cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f023df640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5646893619f0 0x564689361ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58292/0 (socket says 172.21.15.164:58292) 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f02be0640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5646893608d0 0x564689360cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57446/0 (socket says 172.21.15.164:57446) 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f023df640 1 -- 172.21.15.164:0/3297589549 learned_addr learned my addr 172.21.15.164:0/3297589549 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f02be0640 1 -- 172.21.15.164:0/3297589549 >> v1:172.21.15.116:6789/0 conn(0x5646893619f0 legacy=0x564689361ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f02be0640 1 -- 172.21.15.164:0/3297589549 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564689362780 con 0x5646893608d0 2024-09-14T10:57:10.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.075+0000 7f8f01bde640 1 -- 172.21.15.164:0/3297589549 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028306134 0 0) 0x5646893625b0 con 0x5646893619f0 2024-09-14T10:57:10.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f02be0640 1 --2- 172.21.15.164:0/3297589549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x564689360cd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400a470 tx=0x7f8ef4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf8d63d0b92e8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f01bde640 1 -- 172.21.15.164:0/3297589549 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4053570 con 0x5646893608d0 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f01bde640 1 -- 172.21.15.164:0/3297589549 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4058070 con 0x5646893608d0 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f01bde640 1 -- 172.21.15.164:0/3297589549 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4053880 con 0x5646893608d0 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f07412800 1 -- 172.21.15.164:0/3297589549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 msgr2=0x564689360cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.077+0000 7f8f07412800 1 --2- 172.21.15.164:0/3297589549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x564689360cd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400a470 tx=0x7f8ef4045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.078+0000 7f8f07412800 1 -- 172.21.15.164:0/3297589549 shutdown_connections 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.078+0000 7f8f07412800 1 --2- 172.21.15.164:0/3297589549 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x564689360cd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.078+0000 7f8f07412800 1 -- 172.21.15.164:0/3297589549 >> 172.21.15.164:0/3297589549 conn(0x56468935c0e0 msgr2=0x56468935e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.078+0000 7f8f07412800 1 -- 172.21.15.164:0/3297589549 shutdown_connections 2024-09-14T10:57:10.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.078+0000 7f8f07412800 1 -- 172.21.15.164:0/3297589549 wait complete. 2024-09-14T10:57:10.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f07412800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f07412800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5646891f9dd0 con 0x5646893608d0 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57456/0 (socket says 172.21.15.164:57456) 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f02be0640 1 -- 172.21.15.164:0/2325866715 learned_addr learned my addr 172.21.15.164:0/2325866715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.092+0000 7f8f02be0640 1 -- 172.21.15.164:0/2325866715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646894542e0 con 0x5646893608d0 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f02be0640 1 --2- 172.21.15.164:0/2325866715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4025c20 tx=0x7f8ef4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801616cd540fcd2f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8df0e09640 1 -- 172.21.15.164:0/2325866715 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4053a20 con 0x5646893608d0 2024-09-14T10:57:10.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8df0e09640 1 -- 172.21.15.164:0/2325866715 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4063070 con 0x5646893608d0 2024-09-14T10:57:10.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8df0e09640 1 -- 172.21.15.164:0/2325866715 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4053d30 con 0x5646893608d0 2024-09-14T10:57:10.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 -- 172.21.15.164:0/2325866715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 msgr2=0x5646892d4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 --2- 172.21.15.164:0/2325866715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4025c20 tx=0x7f8ef4051000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 -- 172.21.15.164:0/2325866715 shutdown_connections 2024-09-14T10:57:10.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 --2- 172.21.15.164:0/2325866715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646892d4e50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 -- 172.21.15.164:0/2325866715 >> 172.21.15.164:0/2325866715 conn(0x56468935c0e0 msgr2=0x56468944bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 -- 172.21.15.164:0/2325866715 shutdown_connections 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.093+0000 7f8f07412800 1 -- 172.21.15.164:0/2325866715 wait complete. 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f07412800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f07412800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564689367ee0 con 0x5646893608d0 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57458/0 (socket says 172.21.15.164:57458) 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f02be0640 1 -- 172.21.15.164:0/651680875 learned_addr learned my addr 172.21.15.164:0/651680875 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.094+0000 7f8f02be0640 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564689459720 con 0x5646893608d0 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8f02be0640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4025c20 tx=0x7f8ef4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8def606640 1 -- 172.21.15.164:0/651680875 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4078070 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8def606640 1 -- 172.21.15.164:0/651680875 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef4073470 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646894599b0 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8def606640 1 -- 172.21.15.164:0/651680875 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4073750 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468945a570 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.095+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f07412800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f07412800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5646892584a0 con 0x564689466800 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8def606640 1 -- 172.21.15.164:0/651680875 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8ef407b070 con 0x5646893608d0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f033e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f033e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57460/0 (socket says 172.21.15.164:57460) 2024-09-14T10:57:10.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f033e1640 1 -- 172.21.15.164:0/3794841661 learned_addr learned my addr 172.21.15.164:0/3794841661 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8def606640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 0x7f8de803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8def606640 1 -- 172.21.15.164:0/651680875 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8ef4098530 con 0x5646893608d0 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f033e1640 1 -- 172.21.15.164:0/3794841661 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646894691c0 con 0x564689466800 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f02be0640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 0x7f8de803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8f033e1640 1 --2- 172.21.15.164:0/3794841661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00a3e0 tx=0x7f8efc00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d826398c0aa8256 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.096+0000 7f8ded602640 1 -- 172.21.15.164:0/3794841661 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc015070 con 0x564689466800 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8ded602640 1 -- 172.21.15.164:0/3794841661 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc001670 con 0x564689466800 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8ded602640 1 -- 172.21.15.164:0/3794841661 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc001990 con 0x564689466800 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- 172.21.15.164:0/3794841661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 msgr2=0x564689468bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f02be0640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 0x7f8de803f320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4053fd0 tx=0x7f8ef4053f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 --2- 172.21.15.164:0/3794841661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00a3e0 tx=0x7f8efc00a8a0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- 172.21.15.164:0/3794841661 shutdown_connections 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 --2- 172.21.15.164:0/3794841661 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x564689468bf0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- 172.21.15.164:0/3794841661 >> 172.21.15.164:0/3794841661 conn(0x5646893619f0 msgr2=0x564689461120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- 172.21.15.164:0/3794841661 shutdown_connections 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- 172.21.15.164:0/3794841661 wait complete. 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.097+0000 7f8f07412800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f07412800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5646894694b0 con 0x564689466800 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f033e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f033e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57476/0 (socket says 172.21.15.164:57476) 2024-09-14T10:57:10.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f033e1640 1 -- 172.21.15.164:0/1968423828 learned_addr learned my addr 172.21.15.164:0/1968423828 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f033e1640 1 -- 172.21.15.164:0/1968423828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468946dd10 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f033e1640 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x564689461b00 tx=0x7f8efc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8de77fe640 1 -- 172.21.15.164:0/1968423828 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc015070 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8de77fe640 1 -- 172.21.15.164:0/1968423828 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc022070 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56468946dfa0 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8de77fe640 1 -- 172.21.15.164:0/1968423828 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8efc0109f0 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.098+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468946e920 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.099+0000 7f8de77fe640 1 -- 172.21.15.164:0/1968423828 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8efc010b90 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.099+0000 7f8de77fe640 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 0x7f8ddc03f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.099+0000 7f8de77fe640 1 -- 172.21.15.164:0/1968423828 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8efc0540d0 con 0x564689466800 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.099+0000 7f8f023df640 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 0x7f8ddc03f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f023df640 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 0x7f8ddc03f370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 1 Processor -- start 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 1 -- start start 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f07412800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564689454560 con 0x564689487800 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f02be0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57482/0 (socket says 172.21.15.164:57482) 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.100+0000 7f8f02be0640 1 -- 172.21.15.164:0/3136748032 learned_addr learned my addr 172.21.15.164:0/3136748032 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8f02be0640 1 -- 172.21.15.164:0/3136748032 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564689488260 con 0x564689487800 2024-09-14T10:57:10.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8f02be0640 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8ef405ff80 tx=0x7f8ef405cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8dc37fe640 1 -- 172.21.15.164:0/3136748032 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4068c70 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8dc37fe640 1 -- 172.21.15.164:0/3136748032 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef405d580 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564689488a90 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8dc37fe640 1 -- 172.21.15.164:0/3136748032 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ef4068e10 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.101+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564689489030 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8dc37fe640 1 -- 172.21.15.164:0/3136748032 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8ef4096430 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8dc37fe640 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 0x7f8d3803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8dc37fe640 1 -- 172.21.15.164:0/3136748032 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8ef407e050 con 0x564689487800 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8f023df640 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 0x7f8d3803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8dc17fa640 20 reqs_thread_entry: start 2024-09-14T10:57:10.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 0x564689497570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564689497c40 con 0x564689495120 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8f023df640 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 0x7f8d3803f2d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000f60 tx=0x7f8ef8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.102+0000 7f8f033e1640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 0x564689497570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f033e1640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 0x564689497570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f033e1640 1 -- 172.21.15.164:0/651680875 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8efc00e070 con 0x564689495120 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 0x56468949be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:2 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56468949c500 con 0x564689499a10 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f02be0640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 0x56468949be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.103+0000 7f8f02be0640 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 0x56468949be00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.104+0000 7f8f02be0640 1 -- 172.21.15.164:0/651680875 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(2 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f8ef407a030 con 0x564689499a10 2024-09-14T10:57:10.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.104+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5646894990e0 con 0x564689499a10 2024-09-14T10:57:10.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.105+0000 7f8f02be0640 1 -- 172.21.15.164:0/651680875 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [stat,call,call,writefull 0~993] v37'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f8ef407a030 con 0x564689499a10 2024-09-14T10:57:10.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 msgr2=0x7f8ddc03f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 0x7f8ddc03f370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef8001330 comp rx=0 tx=0).stop 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 msgr2=0x56468946d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x564689461b00 tx=0x7f8efc003370 comp rx=0 tx=0).stop 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 shutdown_connections 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8ddc03ceb0 0x7f8ddc03f370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 --2- 172.21.15.164:0/1968423828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689466800 0x56468946d7b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 >> 172.21.15.164:0/1968423828 conn(0x5646893619f0 msgr2=0x5646894610f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 shutdown_connections 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/1968423828 wait complete. 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 msgr2=0x7f8d3803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.106+0000 7f8f07412800 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 0x7f8d3803f2d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000f60 tx=0x7f8ef8006000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 msgr2=0x564689487c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8ef405ff80 tx=0x7f8ef405cf70 comp rx=0 tx=0).stop 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 shutdown_connections 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8d3803ce10 0x7f8d3803f2d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/3136748032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564689487800 0x564689487c20 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 >> 172.21.15.164:0/3136748032 conn(0x56468947cd60 msgr2=0x56468947d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 shutdown_connections 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/3136748032 wait complete. 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 msgr2=0x564689497570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 0x564689497570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 msgr2=0x56468949be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 0x56468949be00 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 msgr2=0x7f8de803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 0x7f8de803f320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4053fd0 tx=0x7f8ef4053f60 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 msgr2=0x5646894591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4025c20 tx=0x7f8ef4002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 shutdown_connections 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564689499a10 0x56468949be00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564689495120 0x564689497570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8de803ce60 0x7f8de803f320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 --2- 172.21.15.164:0/651680875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5646893608d0 0x5646894591c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 >> 172.21.15.164:0/651680875 conn(0x56468935c0e0 msgr2=0x56468944a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 shutdown_connections 2024-09-14T10:57:10.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.107+0000 7f8f07412800 1 -- 172.21.15.164:0/651680875 wait complete. 2024-09-14T10:57:10.116 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:57:10.117 DEBUG:tasks.util.rgw: json result: {'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:57:10.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-14T10:57:10.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-14T10:57:10.117 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-14T10:57:10.159 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.160 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.162+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.162+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4ad460e800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eca986720 0x557ecaa154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4ad460e800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ecaa196e0 con 0x557ecaa15a10 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4ad460e800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x557eca89d7d0 con 0x557eca986720 2024-09-14T10:57:10.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acfc59640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eca986720 0x557ecaa154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acf458640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x557ecaa15a10 0x557ecaa17e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58308/0 (socket says 172.21.15.164:58308) 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acf458640 1 -- 172.21.15.164:0/504509713 learned_addr learned my addr 172.21.15.164:0/504509713 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acfc59640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x557eca986720 0x557ecaa154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57494/0 (socket says 172.21.15.164:57494) 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acfc59640 1 -- 172.21.15.164:0/504509713 >> v1:172.21.15.116:6789/0 conn(0x557ecaa15a10 legacy=0x557ecaa17e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acfc59640 1 -- 172.21.15.164:0/504509713 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecaa1a910 con 0x557eca986720 2024-09-14T10:57:10.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.163+0000 7f4acec57640 1 -- 172.21.15.164:0/504509713 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939007392 0 0) 0x557ecaa196e0 con 0x557ecaa15a10 2024-09-14T10:57:10.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.165+0000 7f4acfc59640 1 --2- 172.21.15.164:0/504509713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecaa154d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0005fd0 tx=0x7f4ac0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf43c870792c5366 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.165+0000 7f4acec57640 1 -- 172.21.15.164:0/504509713 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0058530 con 0x557eca986720 2024-09-14T10:57:10.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.165+0000 7f4acec57640 1 -- 172.21.15.164:0/504509713 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac00586d0 con 0x557eca986720 2024-09-14T10:57:10.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.165+0000 7f4acec57640 1 -- 172.21.15.164:0/504509713 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac00589d0 con 0x557eca986720 2024-09-14T10:57:10.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 -- 172.21.15.164:0/504509713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 msgr2=0x557ecaa154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 --2- 172.21.15.164:0/504509713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecaa154d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0005fd0 tx=0x7f4ac0045c30 comp rx=0 tx=0).stop 2024-09-14T10:57:10.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 -- 172.21.15.164:0/504509713 shutdown_connections 2024-09-14T10:57:10.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 --2- 172.21.15.164:0/504509713 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecaa154d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 -- 172.21.15.164:0/504509713 >> 172.21.15.164:0/504509713 conn(0x557ecaa0cfa0 msgr2=0x557ecaa0f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 -- 172.21.15.164:0/504509713 shutdown_connections 2024-09-14T10:57:10.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.166+0000 7f4ad460e800 1 -- 172.21.15.164:0/504509713 wait complete. 2024-09-14T10:57:10.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.179+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.179+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4ad460e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4ad460e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eca8aadd0 con 0x557eca986720 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57496/0 (socket says 172.21.15.164:57496) 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4acfc59640 1 -- 172.21.15.164:0/3668453580 learned_addr learned my addr 172.21.15.164:0/3668453580 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4acfc59640 1 -- 172.21.15.164:0/3668453580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecab02c40 con 0x557eca986720 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f4acfc59640 1 --2- 172.21.15.164:0/3668453580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0025a60 tx=0x7f4ac0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e1f5503ff1be server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f49bde0b640 1 -- 172.21.15.164:0/3668453580 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0068070 con 0x557eca986720 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f49bde0b640 1 -- 172.21.15.164:0/3668453580 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0058880 con 0x557eca986720 2024-09-14T10:57:10.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.180+0000 7f49bde0b640 1 -- 172.21.15.164:0/3668453580 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0058ba0 con 0x557eca986720 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 -- 172.21.15.164:0/3668453580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 msgr2=0x557ecab02650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 --2- 172.21.15.164:0/3668453580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0025a60 tx=0x7f4ac0051000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 -- 172.21.15.164:0/3668453580 shutdown_connections 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 --2- 172.21.15.164:0/3668453580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab02650 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 -- 172.21.15.164:0/3668453580 >> 172.21.15.164:0/3668453580 conn(0x557ecaa0cfa0 msgr2=0x557ecaafdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 -- 172.21.15.164:0/3668453580 shutdown_connections 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 -- 172.21.15.164:0/3668453580 wait complete. 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.181+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4ad460e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4ad460e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557ecaa19bb0 con 0x557eca986720 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57506/0 (socket says 172.21.15.164:57506) 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4acfc59640 1 -- 172.21.15.164:0/4164707956 learned_addr learned my addr 172.21.15.164:0/4164707956 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4acfc59640 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecab0a600 con 0x557eca986720 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.182+0000 7f4acfc59640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0025a60 tx=0x7f4ac0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f49b7fff640 1 -- 172.21.15.164:0/4164707956 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0068040 con 0x557eca986720 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f49b7fff640 1 -- 172.21.15.164:0/4164707956 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0071070 con 0x557eca986720 2024-09-14T10:57:10.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f49b7fff640 1 -- 172.21.15.164:0/4164707956 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac00637b0 con 0x557eca986720 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ecab0a890 con 0x557eca986720 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ecab0b210 con 0x557eca986720 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f4ad460e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557eca9094a0 con 0x557ecab17690 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.183+0000 7f49b7fff640 1 -- 172.21.15.164:0/4164707956 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4ac0063950 con 0x557eca986720 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4ad045a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4ad045a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57522/0 (socket says 172.21.15.164:57522) 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4ad045a640 1 -- 172.21.15.164:0/1449083954 learned_addr learned my addr 172.21.15.164:0/1449083954 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f49b7fff640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 0x7f49b803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f49b7fff640 1 -- 172.21.15.164:0/4164707956 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4ac0097dd0 con 0x557eca986720 2024-09-14T10:57:10.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4acfc59640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 0x7f49b803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4ad045a640 1 -- 172.21.15.164:0/1449083954 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecab1a050 con 0x557ecab17690 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4ad045a640 1 --2- 172.21.15.164:0/1449083954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a430 tx=0x7f4ac800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b852893f843d170 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f4acfc59640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 0x7f49b803f320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ac006cfd0 tx=0x7f4ac0075f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f49b5ffb640 1 -- 172.21.15.164:0/1449083954 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8008840 con 0x557ecab17690 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f49b5ffb640 1 -- 172.21.15.164:0/1449083954 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8008a00 con 0x557ecab17690 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.184+0000 7f49b5ffb640 1 -- 172.21.15.164:0/1449083954 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8008d20 con 0x557ecab17690 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- 172.21.15.164:0/1449083954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 msgr2=0x557ecab19a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1449083954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800a430 tx=0x7f4ac800a8f0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- 172.21.15.164:0/1449083954 shutdown_connections 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1449083954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab19a80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- 172.21.15.164:0/1449083954 >> 172.21.15.164:0/1449083954 conn(0x557ecaa15a10 msgr2=0x557ecab11fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- 172.21.15.164:0/1449083954 shutdown_connections 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- 172.21.15.164:0/1449083954 wait complete. 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad460e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557ecab1a3a0 con 0x557ecab17690 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad045a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad045a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57530/0 (socket says 172.21.15.164:57530) 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.185+0000 7f4ad045a640 1 -- 172.21.15.164:0/1466745819 learned_addr learned my addr 172.21.15.164:0/1466745819 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f4ad045a640 1 -- 172.21.15.164:0/1466745819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecab1eae0 con 0x557ecab17690 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f4ad045a640 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800adf0 tx=0x7f4ac8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f49affff640 1 -- 172.21.15.164:0/1466745819 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8022030 con 0x557ecab17690 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f49affff640 1 -- 172.21.15.164:0/1466745819 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8019040 con 0x557ecab17690 2024-09-14T10:57:10.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ecab1ed70 con 0x557ecab17690 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f49affff640 1 -- 172.21.15.164:0/1466745819 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac8013970 con 0x557ecab17690 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.186+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ecab1f6f0 con 0x557ecab17690 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f49affff640 1 -- 172.21.15.164:0/1466745819 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4ac8025070 con 0x557ecab17690 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f49affff640 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 0x7f49a803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f49affff640 1 -- 172.21.15.164:0/1466745819 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4ac8023070 con 0x557ecab17690 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f4acf458640 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 0x7f49a803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f4ad460e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.187+0000 7f4ad460e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4acf458640 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 0x7f49a803f2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000c00 tx=0x7f4ab8001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4ad460e800 1 Processor -- start 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4ad460e800 1 -- start start 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4ad460e800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4ad460e800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x557ecab02fb0 con 0x557ecab38600 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4acfc59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57538/0 (socket says 172.21.15.164:57538) 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.188+0000 7f4acfc59640 1 -- 172.21.15.164:0/1786823108 learned_addr learned my addr 172.21.15.164:0/1786823108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f4acfc59640 1 -- 172.21.15.164:0/1786823108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ecab39060 con 0x557ecab38600 2024-09-14T10:57:10.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f4acfc59640 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0096080 tx=0x7f4ac006bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f493ffff640 1 -- 172.21.15.164:0/1786823108 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0092070 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f493ffff640 1 -- 172.21.15.164:0/1786823108 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0097470 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ecab39890 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f493ffff640 1 -- 172.21.15.164:0/1786823108 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0097750 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.189+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ecab39e30 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f493ffff640 1 -- 172.21.15.164:0/1786823108 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f4ac0095070 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f493ffff640 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 0x7f490803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f493ffff640 1 -- 172.21.15.164:0/1786823108 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4ac0082070 con 0x557ecab38600 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f4acf458640 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 0x7f490803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f4acf458640 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 0x7f490803f320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f493dffb640 20 reqs_thread_entry: start 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 0x557ecab48350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557ecab489d0 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.190+0000 7f4ad045a640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 0x557ecab48350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.191+0000 7f4ad045a640 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 0x557ecab48350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.191+0000 7f4ad045a640 1 -- 172.21.15.164:0/4164707956 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ac801e8f0 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.191+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557ecab492b0 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.191+0000 7f4ad045a640 1 -- 172.21.15.164:0/4164707956 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ac801e8f0 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.191+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557ecab4a660 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad045a640 1 -- 172.21.15.164:0/4164707956 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ac801e8f0 con 0x557ecab45f20 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 msgr2=0x7f49a803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 0x7f49a803f2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000c00 tx=0x7f4ab8001330 comp rx=0 tx=0).stop 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 msgr2=0x557ecab1e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800adf0 tx=0x7f4ac8002ff0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 shutdown_connections 2024-09-14T10:57:10.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49a803ce10 0x7f49a803f2d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1466745819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab17690 0x557ecab1e580 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 >> 172.21.15.164:0/1466745819 conn(0x557ecaa15a10 msgr2=0x557ecab11f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 shutdown_connections 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.192+0000 7f4ad460e800 1 -- 172.21.15.164:0/1466745819 wait complete. 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 msgr2=0x7f490803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 0x7f490803f320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8006000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 msgr2=0x557ecab38a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0096080 tx=0x7f4ac006bb30 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 shutdown_connections 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f490803ce60 0x7f490803f320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/1786823108 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557ecab38600 0x557ecab38a20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 >> 172.21.15.164:0/1786823108 conn(0x557ecab2db80 msgr2=0x557ecab2df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 shutdown_connections 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/1786823108 wait complete. 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 msgr2=0x557ecab48350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 0x557ecab48350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 msgr2=0x7f49b803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 0x7f49b803f320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ac006cfd0 tx=0x7f4ac0075f30 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 msgr2=0x557ecab0a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0025a60 tx=0x7f4ac0003330 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 shutdown_connections 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x557ecab45f20 0x557ecab48350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f49b803ce60 0x7f49b803f320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 --2- 172.21.15.164:0/4164707956 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557eca986720 0x557ecab0a0a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 >> 172.21.15.164:0/4164707956 conn(0x557ecaa0cfa0 msgr2=0x557ecab03a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 shutdown_connections 2024-09-14T10:57:10.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.193+0000 7f4ad460e800 1 -- 172.21.15.164:0/4164707956 wait complete. 2024-09-14T10:57:10.200 INFO:teuthology.orchestra.run.smithi164.stdout:{"id":"c136da01-f20d-479c-ad02-fc389f5894e9","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"4d2cef0f-8511-4251-8070-7385f93096af","zones":[{"id":"4d2cef0f-8511-4251-8070-7385f93096af","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-14T10:57:10.201 DEBUG:tasks.util.rgw: json result: {'id': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '4d2cef0f-8511-4251-8070-7385f93096af', 'zones': [{'id': '4d2cef0f-8511-4251-8070-7385f93096af', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-14T10:57:10.203 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-14T10:57:10.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-14T10:57:10.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-14T10:57:10.228 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-14T10:57:10.295 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.295 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f66126800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b8248f6f20 0x55b8248f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f66126800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8248ff950 con 0x55b8248f7860 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f66126800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55b8247817d0 con 0x55b8248f6f20 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f61d5d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b8248f6f20 0x55b8248f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f6155c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55b8248f7860 0x55b8248fe170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58322/0 (socket says 172.21.15.164:58322) 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f61d5d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b8248f6f20 0x55b8248f7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57540/0 (socket says 172.21.15.164:57540) 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.298+0000 7f2f6155c640 1 -- 172.21.15.164:0/1907133945 learned_addr learned my addr 172.21.15.164:0/1907133945 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.299+0000 7f2f61d5d640 1 -- 172.21.15.164:0/1907133945 >> v1:172.21.15.116:6789/0 conn(0x55b8248f7860 legacy=0x55b8248fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.299+0000 7f2f61d5d640 1 -- 172.21.15.164:0/1907133945 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b824900b80 con 0x55b8248f6f20 2024-09-14T10:57:10.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.299+0000 7f2f60d5b640 1 -- 172.21.15.164:0/1907133945 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198659473 0 0) 0x55b8248ff950 con 0x55b8248f7860 2024-09-14T10:57:10.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.300+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/1907133945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8248f7320 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a470 tx=0x7f2f54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5c0056fac864c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.300+0000 7f2f60d5b640 1 -- 172.21.15.164:0/1907133945 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54053570 con 0x55b8248f6f20 2024-09-14T10:57:10.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f60d5b640 1 -- 172.21.15.164:0/1907133945 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54058070 con 0x55b8248f6f20 2024-09-14T10:57:10.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f60d5b640 1 -- 172.21.15.164:0/1907133945 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54053880 con 0x55b8248f6f20 2024-09-14T10:57:10.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 -- 172.21.15.164:0/1907133945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 msgr2=0x55b8248f7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 --2- 172.21.15.164:0/1907133945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8248f7320 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400a470 tx=0x7f2f54045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:10.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 -- 172.21.15.164:0/1907133945 shutdown_connections 2024-09-14T10:57:10.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 --2- 172.21.15.164:0/1907133945 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8248f7320 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 -- 172.21.15.164:0/1907133945 >> 172.21.15.164:0/1907133945 conn(0x55b8248f0740 msgr2=0x55b8248f2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 -- 172.21.15.164:0/1907133945 shutdown_connections 2024-09-14T10:57:10.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.301+0000 7f2f66126800 1 -- 172.21.15.164:0/1907133945 wait complete. 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f66126800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f66126800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b82478edd0 con 0x55b8248f6f20 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f61d5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f61d5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57554/0 (socket says 172.21.15.164:57554) 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.315+0000 7f2f61d5d640 1 -- 172.21.15.164:0/3536325635 learned_addr learned my addr 172.21.15.164:0/3536325635 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.316+0000 7f2f61d5d640 1 -- 172.21.15.164:0/3536325635 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8249e9000 con 0x55b8248f6f20 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.316+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/3536325635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2f54025c20 tx=0x7f2f54051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48af10aa985c919 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.316+0000 7f2e4fe07640 1 -- 172.21.15.164:0/3536325635 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54053a20 con 0x55b8248f6f20 2024-09-14T10:57:10.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.316+0000 7f2e4fe07640 1 -- 172.21.15.164:0/3536325635 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54063070 con 0x55b8248f6f20 2024-09-14T10:57:10.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.316+0000 7f2e4fe07640 1 -- 172.21.15.164:0/3536325635 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54053d30 con 0x55b8248f6f20 2024-09-14T10:57:10.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- 172.21.15.164:0/3536325635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 msgr2=0x55b8249e8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.319 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 --2- 172.21.15.164:0/3536325635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2f54025c20 tx=0x7f2f54051000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- 172.21.15.164:0/3536325635 shutdown_connections 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 --2- 172.21.15.164:0/3536325635 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249e8a10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- 172.21.15.164:0/3536325635 >> 172.21.15.164:0/3536325635 conn(0x55b8248f0740 msgr2=0x55b8249e4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- 172.21.15.164:0/3536325635 shutdown_connections 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- 172.21.15.164:0/3536325635 wait complete. 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f66126800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b8248ffe20 con 0x55b8248f6f20 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f61d5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f61d5d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57558/0 (socket says 172.21.15.164:57558) 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.317+0000 7f2f61d5d640 1 -- 172.21.15.164:0/3288856642 learned_addr learned my addr 172.21.15.164:0/3288856642 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2f61d5d640 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8249f0a00 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2f54025c20 tx=0x7f2f54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2e4e604640 1 -- 172.21.15.164:0/3288856642 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54078070 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2e4e604640 1 -- 172.21.15.164:0/3288856642 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54073470 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2e4e604640 1 -- 172.21.15.164:0/3288856642 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f54073750 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8249f0c90 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.318+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8249f18a0 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2e4e604640 1 -- 172.21.15.164:0/3288856642 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2f5407b070 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2e4e604640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 0x7f2e4803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2e4e604640 1 -- 172.21.15.164:0/3288856642 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2f540984b0 con 0x55b8248f6f20 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2f6155c640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 0x7f2e4803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 0x55b8249f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b8249f2260 con 0x55b8248f7860 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2f6255e640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 0x55b8249f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.319+0000 7f2f6155c640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 0x7f2e4803f320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000c00 tx=0x7f2f580013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f6255e640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 0x55b8249f7af0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f6255e640 1 -- 172.21.15.164:0/3288856642 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b8248f7860 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b8249f1c10 con 0x55b8248f7860 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f6255e640 1 -- 172.21.15.164:0/3288856642 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b8248f7860 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 0x55b8249fc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b8249fca20 con 0x55b8249f9f60 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 0x55b8249fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.320+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 0x55b8249fc350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.321+0000 7f2f61d5d640 1 -- 172.21.15.164:0/3288856642 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f5407a030 con 0x55b8249f9f60 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.321+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b8249f8e00 con 0x55b8248f7860 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.321+0000 7f2f6255e640 1 -- 172.21.15.164:0/3288856642 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b8248f7860 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.321+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b8249f9280 con 0x55b8248f7860 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.321+0000 7f2f6255e640 1 -- 172.21.15.164:0/3288856642 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b8248f7860 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f66126800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f66126800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b8247ed4a0 con 0x55b824a0b3f0 2024-09-14T10:57:10.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57574/0 (socket says 172.21.15.164:57574) 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f6255e640 1 -- 172.21.15.164:0/2358051112 learned_addr learned my addr 172.21.15.164:0/2358051112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.322+0000 7f2f6255e640 1 -- 172.21.15.164:0/2358051112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b824a0be50 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2f6255e640 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55b8249f8030 tx=0x7f2f5c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2e477fe640 1 -- 172.21.15.164:0/2358051112 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c014450 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b824a0c680 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2e477fe640 1 -- 172.21.15.164:0/2358051112 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0145f0 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b824a0cc20 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.323+0000 7f2e477fe640 1 -- 172.21.15.164:0/2358051112 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c028060 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2e477fe640 1 -- 172.21.15.164:0/2358051112 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2f5c011040 con 0x55b824a0b3f0 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2e477fe640 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 0x7f2e3c03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2e477fe640 1 -- 172.21.15.164:0/2358051112 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2f5c01e070 con 0x55b824a0b3f0 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 0x7f2e3c03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 0x7f2e3c03f2d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55b8249f80d0 tx=0x7f2f54087290 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.324+0000 7f2f66126800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f66126800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b8249e93d0 con 0x55b824a17e30 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57580/0 (socket says 172.21.15.164:57580) 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f6255e640 1 -- 172.21.15.164:0/4226892959 learned_addr learned my addr 172.21.15.164:0/4226892959 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f6255e640 1 -- 172.21.15.164:0/4226892959 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b824a18820 con 0x55b824a17e30 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2f6255e640 1 --2- 172.21.15.164:0/4226892959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0546d0 tx=0x7f2f5c02c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a1c4bb1e6fdc0d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2e457fa640 1 -- 172.21.15.164:0/4226892959 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c051020 con 0x55b824a17e30 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2e457fa640 1 -- 172.21.15.164:0/4226892959 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0167e0 con 0x55b824a17e30 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.325+0000 7f2e457fa640 1 -- 172.21.15.164:0/4226892959 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c044020 con 0x55b824a17e30 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- 172.21.15.164:0/4226892959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 msgr2=0x55b824a18230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 --2- 172.21.15.164:0/4226892959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0546d0 tx=0x7f2f5c02c460 comp rx=0 tx=0).stop 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- 172.21.15.164:0/4226892959 shutdown_connections 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 --2- 172.21.15.164:0/4226892959 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a18230 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- 172.21.15.164:0/4226892959 >> 172.21.15.164:0/4226892959 conn(0x55b824a14230 msgr2=0x55b824a12470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- 172.21.15.164:0/4226892959 shutdown_connections 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- 172.21.15.164:0/4226892959 wait complete. 2024-09-14T10:57:10.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 Processor -- start 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- start start 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f66126800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b824a18e40 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f6255e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57594/0 (socket says 172.21.15.164:57594) 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 learned_addr learned my addr 172.21.15.164:0/315016715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.326+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b824a1f960 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2f6255e640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c02bff0 tx=0x7f2f5c054660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2e337fe640 1 -- 172.21.15.164:0/315016715 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c031020 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2e337fe640 1 -- 172.21.15.164:0/315016715 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c056070 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b824a1fbf0 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2e337fe640 1 -- 172.21.15.164:0/315016715 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f5c051040 con 0x55b824a17e30 2024-09-14T10:57:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b824a20570 con 0x55b824a17e30 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.327+0000 7f2e337fe640 1 -- 172.21.15.164:0/315016715 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2f5c034020 con 0x55b824a17e30 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2e337fe640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e2c03ce60 0x7f2e2c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2e337fe640 1 -- 172.21.15.164:0/315016715 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f2f5c04d050 con 0x55b824a17e30 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e2c03ce60 0x7f2e2c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e2c03ce60 0x7f2e2c03f320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f5405dac0 tx=0x7f2f54091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.328+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b824a2b180 0x55b824a2d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a2dd90 con 0x55b824a2b180 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f6155c640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b824a2b180 0x55b824a2d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f6155c640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b824a2b180 0x55b824a2d640 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5800f5f0 con 0x55b824a2b180 2024-09-14T10:57:10.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 20 realm 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a2a4d0 con 0x55b824a2b180 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5800f5f0 con 0x55b824a2b180 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.329+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a2e880 con 0x55b824a2b180 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5800f5f0 con 0x55b824a2b180 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a2f150 con 0x55b824a2b180 2024-09-14T10:57:10.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f5800f5f0 con 0x55b824a2b180 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b824a2fb70 0x55b824a31f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a326d0 con 0x55b824a2fb70 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f6255e640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b824a2fb70 0x55b824a31f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f6255e640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b824a2fb70 0x55b824a31f60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.330+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b824a2fb70 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f66126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f66126800 20 searching for the correct realm 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f5c00a4d0 con 0x55b824a2fb70 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f6255e640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2f5c036020 0x7f2f5c0353b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2f5c036020 0x7f2f5c0353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2f5c036020 0x7f2f5c0353b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f61d5d640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2f540a6040 0x7f2f540738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.331+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.332+0000 7f2f6155c640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2f540a6040 0x7f2f540738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.332+0000 7f2f6155c640 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2f540a6040 0x7f2f540738f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.332+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5800f5f0 con 0x7f2f540a6040 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.332+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5800f5f0 con 0x55b824a2b180 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.333+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.334+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.335+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.336+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.352 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x55b824a2b180 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.337+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2fb70 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.338+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f540a6040 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5802b040 con 0x7f2f540a6040 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x55b824a2b180 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33fc0 con 0x7f2f5c036020 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33090 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.339+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a33930 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a34440 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 zone default found 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 4 Realm: () 2024-09-14T10:57:10.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 zonegroup default 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a347e0 con 0x7f2f540a6040 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a36680 con 0x55b824a2fb70 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.340+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a36a20 con 0x55b824a2fb70 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 20 started sync module instance, tier type = 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.341+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a35b10 con 0x7f2f5c036020 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.342+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.342+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94249377029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a372e0 con 0x7f2f5c036020 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.342+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a37b30 con 0x55b824a2b180 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.343+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94249377029888] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.343+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.343+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94249377033776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a37bd0 con 0x55b824a2b180 2024-09-14T10:57:10.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.343+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a38670 con 0x55b824a2fb70 2024-09-14T10:57:10.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.344+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94249377033776] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.345+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.345+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94249377038688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a38630 con 0x55b824a2fb70 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.345+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a39110 con 0x7f2f5c036020 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.346+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.346+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94249377041440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a39610 con 0x7f2f5c036020 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.346+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3a130 con 0x55b824a2b180 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.346+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94249377038688] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.347+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94249377041440] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.347+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.347+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94249377045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3a0f0 con 0x55b824a2b180 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.347+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3a9d0 con 0x7f2f540a6040 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.348+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94249377045504] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.348+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.348+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94249377035904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3a5a0 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.348+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3b060 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.349+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94249377035904] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.349+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.349+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94249377046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3a510 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.349+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3baf0 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94249377046768] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94249377050656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3baf0 con 0x7f2f540a6040 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=0 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=1 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=2 2024-09-14T10:57:10.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=3 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=4 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=5 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.350+0000 7f2f66126800 20 add_watcher() i=6 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94249377050656] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f66126800 20 add_watcher() i=7 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f66126800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3ef20 con 0x55b824a2b180 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.353+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94249377052688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a3c4b0 con 0x55b824a2b180 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.354+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94249377052688] v37'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.354+0000 7f2e137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.354+0000 7f2f66126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.354+0000 7f2f66126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.354+0000 7f2f66126800 5 note: GC not initialized 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2e127fc640 20 reqs_thread_entry: start 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 20 Filter name: none 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2d83fff640 20 reqs_thread_entry: start 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a722e0 con 0x7f2f540a6040 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-14T10:57:10.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.355+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70980 con 0x55b824a2b180 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.356+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a71290 con 0x7f2f540a6040 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v37'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f66126800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:10.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f66126800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f66126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94249377271200 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a75c20 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== watch-notify(notify (1) cookie 94249377045504 notify 158913789971 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55b824a71630 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2e457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 94249377045504 notifier 4842 bl.length()=649 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify cookie 94249377271200 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2e457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2e457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.357+0000 7f2e457fa640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f2e24003ea0 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.358+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.358+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== watch-notify(notify_complete (2) cookie 94249377271200 notify 158913789971 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b824a71db0 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.358+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70d20 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v37'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f66126800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-14T10:57:10.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f66126800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f66126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94249377271072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b824a76030 con 0x55b824a2fb70 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== watch-notify(notify (1) cookie 94249377038688 notify 158913789970 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b824a20570 con 0x55b824a2fb70 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2e457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 94249377038688 notifier 4842 bl.length()=177 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2e457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2e457fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(68 notify.2 [notify cookie 94249377271072 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2e457fa640 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f2e24003ea0 con 0x55b824a2fb70 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.359+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== watch-notify(notify_complete (2) cookie 94249377271072 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b824a1fbf0 con 0x55b824a2fb70 2024-09-14T10:57:10.371 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:10.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.360+0000 7f2e137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.360+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94249377052688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x55b824a2b180 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.361+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94249377052688] v37'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.361+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94249377029888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x7f2f5c036020 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.362+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94249377029888] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.362+0000 7f2f66126800 20 remove_watcher() i=0 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.362+0000 7f2f66126800 2 removed watcher, disabling cache 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.362+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94249377033776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x55b824a2b180 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.364+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94249377033776] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.364+0000 7f2f66126800 20 remove_watcher() i=1 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.364+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94249377038688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x55b824a2fb70 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.364+0000 7f2f6255e640 1 -- 172.21.15.164:0/315016715 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94249377038688] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5c060040 con 0x55b824a2fb70 2024-09-14T10:57:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.364+0000 7f2f66126800 20 remove_watcher() i=2 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.365+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94249377041440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x7f2f5c036020 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.365+0000 7f2f61d5d640 1 -- 172.21.15.164:0/315016715 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94249377041440] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5407a030 con 0x7f2f5c036020 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.365+0000 7f2f66126800 20 remove_watcher() i=3 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.365+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94249377045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x55b824a2b180 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.366+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94249377045504] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x55b824a2b180 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.366+0000 7f2f66126800 20 remove_watcher() i=4 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.367+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94249377035904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x7f2f540a6040 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.368+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94249377035904] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.368+0000 7f2f66126800 20 remove_watcher() i=5 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.368+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94249377046768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x7f2f540a6040 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.369+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94249377046768] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.369+0000 7f2f66126800 20 remove_watcher() i=6 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.369+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94249377050656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b824a70020 con 0x7f2f540a6040 2024-09-14T10:57:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94249377050656] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f5803b040 con 0x7f2f540a6040 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 20 remove_watcher() i=7 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2f540a6040 msgr2=0x7f2f540738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f2f540a6040 0x7f2f540738f0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b824a2b180 msgr2=0x55b824a2d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b824a2b180 0x55b824a2d640 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2f5c036020 msgr2=0x7f2f5c0353b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2f5c036020 0x7f2f5c0353b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b824a2fb70 msgr2=0x55b824a31f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b824a2fb70 0x55b824a31f60 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e2c03ce60 msgr2=0x7f2e2c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e2c03ce60 0x7f2e2c03f320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f5405dac0 tx=0x7f2f54091000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 msgr2=0x55b824a1f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f6155c640 1 -- 172.21.15.164:0/315016715 reap_dead start 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c02bff0 tx=0x7f2f5c054660 comp rx=0 tx=0).stop 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 shutdown_connections 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/315016715 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a17e30 0x55b824a1f400 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 >> 172.21.15.164:0/315016715 conn(0x55b824a14230 msgr2=0x55b824a12440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 shutdown_connections 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/315016715 wait complete. 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 msgr2=0x7f2e3c03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 0x7f2e3c03f2d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55b8249f80d0 tx=0x7f2f54087290 comp rx=0 tx=0).stop 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 msgr2=0x55b824a0b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x55b8249f8030 tx=0x7f2f5c018830 comp rx=0 tx=0).stop 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 shutdown_connections 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e3c03ce10 0x7f2e3c03f2d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 --2- 172.21.15.164:0/2358051112 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b824a0b3f0 0x55b824a0b810 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.370+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 >> 172.21.15.164:0/2358051112 conn(0x55b8249ff7a0 msgr2=0x55b8249ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 shutdown_connections 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/2358051112 wait complete. 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 msgr2=0x55b8249f7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 0x55b8249f7af0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 msgr2=0x55b8249fc350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 0x55b8249fc350 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 msgr2=0x7f2e4803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 0x7f2e4803f320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000c00 tx=0x7f2f580013b0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 msgr2=0x55b8249f04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2f54025c20 tx=0x7f2f54002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 shutdown_connections 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b8249f9f60 0x55b8249fc350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b8248f7860 0x55b8249f7af0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f2e4803ce60 0x7f2e4803f320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 --2- 172.21.15.164:0/3288856642 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b8248f6f20 0x55b8249f04a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 >> 172.21.15.164:0/3288856642 conn(0x55b8248f0740 msgr2=0x55b8249e9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 shutdown_connections 2024-09-14T10:57:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.371+0000 7f2f66126800 1 -- 172.21.15.164:0/3288856642 wait complete. 2024-09-14T10:57:10.382 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.382 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.382 ERROR:root:0 2024-09-14T10:57:10.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:10.389 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000747f51b2d39df67b-0066e56c06-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:57:10.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-14T10:57:10.399 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:10.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-14T10:57:10.410 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-14T10:57:10.411 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-14T10:57:10.425 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-14T10:57:10.425 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-14T10:57:10.434 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-14T10:57:10.435 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:10.439 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:10.439 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-14T10:57:10.443 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:10.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:10.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:10.445 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-14T10:57:10.492 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.492 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.494+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbf012c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558704f1cef0 0x558704fae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbf012c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558704fb2900 con 0x558704faedf0 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbf012c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x558704e347d0 con 0x558704f1cef0 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbebe4f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558704f1cef0 0x558704fae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbeb64e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x558704faedf0 0x558704fb11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58326/0 (socket says 172.21.15.164:58326) 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbebe4f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x558704f1cef0 0x558704fae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57600/0 (socket says 172.21.15.164:57600) 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbeb64e640 1 -- 172.21.15.164:0/2563501723 learned_addr learned my addr 172.21.15.164:0/2563501723 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbebe4f640 1 -- 172.21.15.164:0/2563501723 >> v1:172.21.15.116:6789/0 conn(0x558704faedf0 legacy=0x558704fb11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbeae4d640 1 -- 172.21.15.164:0/2563501723 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630369793 0 0) 0x558704fb2900 con 0x558704faedf0 2024-09-14T10:57:10.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.495+0000 7fdbebe4f640 1 -- 172.21.15.164:0/2563501723 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558704fb3b30 con 0x558704f1cef0 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.497+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/2563501723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x558704fae8b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc005fd0 tx=0x7fdbdc045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfa0902bce49b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbeae4d640 1 -- 172.21.15.164:0/2563501723 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc058530 con 0x558704f1cef0 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbeae4d640 1 -- 172.21.15.164:0/2563501723 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc0586d0 con 0x558704f1cef0 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbeae4d640 1 -- 172.21.15.164:0/2563501723 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc0589d0 con 0x558704f1cef0 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 -- 172.21.15.164:0/2563501723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 msgr2=0x558704fae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 --2- 172.21.15.164:0/2563501723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x558704fae8b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc005fd0 tx=0x7fdbdc045c30 comp rx=0 tx=0).stop 2024-09-14T10:57:10.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 -- 172.21.15.164:0/2563501723 shutdown_connections 2024-09-14T10:57:10.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 --2- 172.21.15.164:0/2563501723 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x558704fae8b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 -- 172.21.15.164:0/2563501723 >> 172.21.15.164:0/2563501723 conn(0x558704fa3fa0 msgr2=0x558704fa6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 -- 172.21.15.164:0/2563501723 shutdown_connections 2024-09-14T10:57:10.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.498+0000 7fdbf012c800 1 -- 172.21.15.164:0/2563501723 wait complete. 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.512+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.512+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbf012c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbf012c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558704e41dd0 con 0x558704f1cef0 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbebe4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbebe4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57610/0 (socket says 172.21.15.164:57610) 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbebe4f640 1 -- 172.21.15.164:0/189240248 learned_addr learned my addr 172.21.15.164:0/189240248 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbebe4f640 1 -- 172.21.15.164:0/189240248 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55870509beb0 con 0x558704f1cef0 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/189240248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025a60 tx=0x7fdbdc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b137e38dd39c3405 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdad9e0b640 1 -- 172.21.15.164:0/189240248 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc068070 con 0x558704f1cef0 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdad9e0b640 1 -- 172.21.15.164:0/189240248 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc058880 con 0x558704f1cef0 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.513+0000 7fdad9e0b640 1 -- 172.21.15.164:0/189240248 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc058ba0 con 0x558704f1cef0 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 -- 172.21.15.164:0/189240248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 msgr2=0x55870509b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 --2- 172.21.15.164:0/189240248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025a60 tx=0x7fdbdc051000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 -- 172.21.15.164:0/189240248 shutdown_connections 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 --2- 172.21.15.164:0/189240248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x55870509b8c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 -- 172.21.15.164:0/189240248 >> 172.21.15.164:0/189240248 conn(0x558704fa3fa0 msgr2=0x558705097240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 -- 172.21.15.164:0/189240248 shutdown_connections 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.514+0000 7fdbf012c800 1 -- 172.21.15.164:0/189240248 wait complete. 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbf012c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbf012c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558704fb2dd0 con 0x558704f1cef0 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbebe4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbebe4f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57618/0 (socket says 172.21.15.164:57618) 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3783565740 learned_addr learned my addr 172.21.15.164:0/3783565740 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587050a3890 con 0x558704f1cef0 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.515+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025a60 tx=0x7fdbdc003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdad3fff640 1 -- 172.21.15.164:0/3783565740 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc068040 con 0x558704f1cef0 2024-09-14T10:57:10.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdad3fff640 1 -- 172.21.15.164:0/3783565740 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbdc071070 con 0x558704f1cef0 2024-09-14T10:57:10.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587050a3b20 con 0x558704f1cef0 2024-09-14T10:57:10.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdad3fff640 1 -- 172.21.15.164:0/3783565740 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbdc0637b0 con 0x558704f1cef0 2024-09-14T10:57:10.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587050a44a0 con 0x558704f1cef0 2024-09-14T10:57:10.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.516+0000 7fdad3fff640 1 -- 172.21.15.164:0/3783565740 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fdbdc0639e0 con 0x558704f1cef0 2024-09-14T10:57:10.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdad3fff640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 0x7fdad403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdad3fff640 1 -- 172.21.15.164:0/3783565740 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fdbdc097e30 con 0x558704f1cef0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 0x7fdad403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 0x5587050aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050a50f0 con 0x558704faedf0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbec650640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 0x5587050aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 0x7fdad403f2d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c00 tx=0x7fdbd40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.517+0000 7fdbec650640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 0x5587050aa980 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbec650640 1 -- 172.21.15.164:0/3783565740 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbe40083e0 con 0x558704faedf0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050a4980 con 0x558704faedf0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbec650640 1 -- 172.21.15.164:0/3783565740 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbe40083e0 con 0x558704faedf0 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 0x5587050af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050af8f0 con 0x5587050ace30 2024-09-14T10:57:10.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 0x5587050af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 0x5587050af220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.518+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3783565740 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdbdc063cd0 con 0x5587050ace30 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050abcd0 con 0x558704faedf0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbec650640 1 -- 172.21.15.164:0/3783565740 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbe40083e0 con 0x558704faedf0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050ac1b0 con 0x558704faedf0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbec650640 1 -- 172.21.15.164:0/3783565740 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdbe40083e0 con 0x558704faedf0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.519+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbf012c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbf012c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x558704ea04a0 con 0x5587050be2d0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57626/0 (socket says 172.21.15.164:57626) 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbec650640 1 -- 172.21.15.164:0/1614850482 learned_addr learned my addr 172.21.15.164:0/1614850482 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbec650640 1 -- 172.21.15.164:0/1614850482 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587050bed30 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbec650640 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5587050a4330 tx=0x7fdbe400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdad17fa640 1 -- 172.21.15.164:0/1614850482 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe4007dc0 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdad17fa640 1 -- 172.21.15.164:0/1614850482 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe401e020 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdad17fa640 1 -- 172.21.15.164:0/1614850482 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe4019570 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587050bf560 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.520+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587050bfb00 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.521+0000 7fdad17fa640 1 -- 172.21.15.164:0/1614850482 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fdbe4016040 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.521+0000 7fdad17fa640 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 0x7fdac403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.521+0000 7fdad17fa640 1 -- 172.21.15.164:0/1614850482 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fdbe401f030 con 0x5587050be2d0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.521+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 0x7fdac403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 0x7fdac403f2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5587050aafa0 tx=0x7fdbdc04e5b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbf012c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbf012c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55870509c220 con 0x5587050cad90 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57634/0 (socket says 172.21.15.164:57634) 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbec650640 1 -- 172.21.15.164:0/3867999291 learned_addr learned my addr 172.21.15.164:0/3867999291 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.522+0000 7fdbec650640 1 -- 172.21.15.164:0/3867999291 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587050cb760 con 0x5587050cad90 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbec650640 1 --2- 172.21.15.164:0/3867999291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40547e0 tx=0x7fdbe4019ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27ee2800697bd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdacaffd640 1 -- 172.21.15.164:0/3867999291 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe404b070 con 0x5587050cad90 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdacaffd640 1 -- 172.21.15.164:0/3867999291 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe40532e0 con 0x5587050cad90 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdacaffd640 1 -- 172.21.15.164:0/3867999291 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe401d040 con 0x5587050cad90 2024-09-14T10:57:10.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 -- 172.21.15.164:0/3867999291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 msgr2=0x5587050cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3867999291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40547e0 tx=0x7fdbe4019ae0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 -- 172.21.15.164:0/3867999291 shutdown_connections 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3867999291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050cb170 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 -- 172.21.15.164:0/3867999291 >> 172.21.15.164:0/3867999291 conn(0x5587050c7190 msgr2=0x5587050c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 -- 172.21.15.164:0/3867999291 shutdown_connections 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 -- 172.21.15.164:0/3867999291 wait complete. 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.523+0000 7fdbf012c800 1 Processor -- start 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbf012c800 1 -- start start 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbf012c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050d2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbf012c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5587050cbda0 con 0x5587050cad90 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050d2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbec650640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050d2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57638/0 (socket says 172.21.15.164:57638) 2024-09-14T10:57:10.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 learned_addr learned my addr 172.21.15.164:0/3133073901 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587050d28d0 con 0x5587050cad90 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbec650640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050d2370 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4017850 tx=0x7fdbe4054770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdac97fa640 1 -- 172.21.15.164:0/3133073901 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe404b070 con 0x5587050cad90 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdac97fa640 1 -- 172.21.15.164:0/3133073901 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe4022dd0 con 0x5587050cad90 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587050d2b60 con 0x5587050cad90 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdac97fa640 1 -- 172.21.15.164:0/3133073901 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe401d030 con 0x5587050cad90 2024-09-14T10:57:10.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.524+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587050d34e0 con 0x5587050cad90 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.525+0000 7fdac97fa640 1 -- 172.21.15.164:0/3133073901 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fdbe4054cc0 con 0x5587050cad90 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.525+0000 7fdac97fa640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdab403ce60 0x7fdab403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.525+0000 7fdac97fa640 1 -- 172.21.15.164:0/3133073901 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fdbe4041cf0 con 0x5587050cad90 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.525+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdab403ce60 0x7fdab403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdab403ce60 0x7fdab403f320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc075f90 tx=0x7fdbdc04eee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5587050dded0 0x5587050e0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e0ae0 con 0x5587050dded0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5587050dded0 0x5587050e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.526+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5587050dded0 0x5587050e0390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbd400f5f0 con 0x5587050dded0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 realm 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050dd220 con 0x5587050dded0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbd400f5f0 con 0x5587050dded0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e15d0 con 0x5587050dded0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbd400f5f0 con 0x5587050dded0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e1ea0 con 0x5587050dded0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdbd400f5f0 con 0x5587050dded0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050e28c0 0x5587050e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.527+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e5420 con 0x5587050e28c0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050e28c0 0x5587050e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050e28c0 0x5587050e4cb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdbe403e070 con 0x5587050e28c0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbf012c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbf012c800 20 searching for the correct realm 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdbe403e070 con 0x5587050e28c0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fdbe4037020 0x7fdbe40223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.528+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fdbe4037020 0x7fdbe40223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fdbe4037020 0x7fdbe40223c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbebe4f640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fdbdc08f070 0x7fdbdc04f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.529+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fdbdc08f070 0x7fdbdc04f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.530+0000 7fdbeb64e640 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fdbdc08f070 0x7fdbdc04f7b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.530+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd400f5f0 con 0x7fdbdc08f070 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.530+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.530+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd400f5f0 con 0x5587050dded0 2024-09-14T10:57:10.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.530+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.531+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe403e070 con 0x5587050e28c0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.532+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe403e070 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.533+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.534+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x5587050dded0 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.535+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.536+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050e28c0 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbd402b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x5587050dded0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5587050e6d10 con 0x7fdbe4037020 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.537+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e5e10 con 0x5587050dded0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e66b0 con 0x5587050dded0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e7190 con 0x5587050dded0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 zone default found 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 4 Realm: () 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:10.551 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 zonegroup default 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e7530 con 0x7fdbdc08f070 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.538+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e93d0 con 0x5587050e28c0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050e9770 con 0x5587050e28c0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 20 started sync module instance, tier type = 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.539+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050e8810 con 0x7fdbe4037020 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.540+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.540+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038393783136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050e9c00 con 0x7fdbe4037020 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.540+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ea450 con 0x5587050dded0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.541+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038393783136] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.541+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.541+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038393790368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ea870 con 0x5587050dded0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.541+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050eb0c0 con 0x5587050e28c0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.542+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038393790368] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.543+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.543+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038393791904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050eaff0 con 0x5587050e28c0 2024-09-14T10:57:10.553 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.543+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ebab0 con 0x7fdbe4037020 2024-09-14T10:57:10.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.544+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038393791904] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.544+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.544+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038393795968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ebea0 con 0x7fdbe4037020 2024-09-14T10:57:10.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.544+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ec8d0 con 0x5587050dded0 2024-09-14T10:57:10.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.545+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.545+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038393799648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ec8d0 con 0x5587050dded0 2024-09-14T10:57:10.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.545+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ed8f0 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.545+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038393795968] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.546+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.546+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038393803712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ed8b0 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.546+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ee300 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.546+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038393799648] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.547+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038393803712] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.547+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.547+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038393793088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ede50 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.547+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ee740 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038393793088] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038393801968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ee920 con 0x7fdbdc08f070 2024-09-14T10:57:10.559 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=0 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=1 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=2 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=3 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=4 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=5 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.548+0000 7fdbf012c800 20 add_watcher() i=6 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038393801968] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbf012c800 20 add_watcher() i=7 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbf012c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587050f1cf0 con 0x5587050dded0 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.549+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038393808912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587050ef110 con 0x5587050dded0 2024-09-14T10:57:10.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.550+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038393808912] v37'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x5587050dded0 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.550+0000 7fdaa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.550+0000 7fdbf012c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.550+0000 7fdbf012c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 5 note: GC not initialized 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdaa0fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 20 Filter name: none 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fda1a7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.551+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558705124f70 con 0x7fdbdc08f070 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbf012c800 20 rados_obj.operate() r=0 bl.length=473 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbf012c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbf012c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbf012c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.552+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55870512b770 con 0x7fdbdc08f070 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdbd403b040 con 0x7fdbdc08f070 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbf012c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbf012c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbf012c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94038394057008 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x558705126d50 con 0x5587050dded0 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94038393799648 notify 158913789973 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fdbd4018040 con 0x5587050dded0 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdacaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789973 cookie 94038393799648 notifier 4849 bl.length()=636 2024-09-14T10:57:10.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdacaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdacaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdacaffd640 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fdab0003ea0 con 0x5587050dded0 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94038394057008 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdbd4041020 con 0x5587050dded0 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.553+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x5587050dded0 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.554+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94038394057008 notify 158913789973 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdbd401e910 con 0x5587050dded0 2024-09-14T10:57:10.563 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.554+0000 7fdaa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.554+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038393808912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x5587050dded0 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.555+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94038393808912] v37'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x5587050dded0 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.555+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038393783136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x7fdbe4037020 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.556+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94038393783136] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.556+0000 7fdbf012c800 20 remove_watcher() i=0 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.556+0000 7fdbf012c800 2 removed watcher, disabling cache 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.556+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038393790368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x5587050dded0 2024-09-14T10:57:10.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.558+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94038393790368] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x5587050dded0 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.558+0000 7fdbf012c800 20 remove_watcher() i=1 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.558+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038393791904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x5587050e28c0 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.559+0000 7fdbec650640 1 -- 172.21.15.164:0/3133073901 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94038393791904] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbe4064040 con 0x5587050e28c0 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.559+0000 7fdbf012c800 20 remove_watcher() i=2 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.559+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038393795968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x7fdbe4037020 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.560+0000 7fdbebe4f640 1 -- 172.21.15.164:0/3133073901 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94038393795968] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbdc063cd0 con 0x7fdbe4037020 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.560+0000 7fdbf012c800 20 remove_watcher() i=3 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.560+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038393799648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x5587050dded0 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.561+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94038393799648] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x5587050dded0 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.561+0000 7fdbf012c800 20 remove_watcher() i=4 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.561+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038393803712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x7fdbdc08f070 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.562+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94038393803712] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x7fdbdc08f070 2024-09-14T10:57:10.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.562+0000 7fdbf012c800 20 remove_watcher() i=5 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.562+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038393793088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x7fdbdc08f070 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.563+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94038393793088] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x7fdbdc08f070 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.563+0000 7fdbf012c800 20 remove_watcher() i=6 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.563+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038393801968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x558705122d50 con 0x7fdbdc08f070 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94038393801968] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdbd4041020 con 0x7fdbdc08f070 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 20 remove_watcher() i=7 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fdbdc08f070 msgr2=0x7fdbdc04f7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fdbdc08f070 0x7fdbdc04f7b0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5587050dded0 msgr2=0x5587050e0390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5587050dded0 0x5587050e0390 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fdbe4037020 msgr2=0x7fdbe40223c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fdbe4037020 0x7fdbe40223c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050e28c0 msgr2=0x5587050e4cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050e28c0 0x5587050e4cb0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdab403ce60 msgr2=0x7fdab403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdab403ce60 0x7fdab403f320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc075f90 tx=0x7fdbdc04eee0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 msgr2=0x5587050d2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3133073901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050cad90 0x5587050d2370 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4017850 tx=0x7fdbe4054770 comp rx=0 tx=0).stop 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 reap_dead start 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbeb64e640 1 -- 172.21.15.164:0/3133073901 reap_dead start 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 shutdown_connections 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 >> 172.21.15.164:0/3133073901 conn(0x5587050c7190 msgr2=0x5587050c53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 shutdown_connections 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.564+0000 7fdbf012c800 1 -- 172.21.15.164:0/3133073901 wait complete. 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 msgr2=0x7fdac403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 0x7fdac403f2d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x5587050aafa0 tx=0x7fdbdc04e5b0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 msgr2=0x5587050be6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x5587050a4330 tx=0x7fdbe400af40 comp rx=0 tx=0).stop 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 shutdown_connections 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdac403ce10 0x7fdac403f2d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/1614850482 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5587050be2d0 0x5587050be6f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 >> 172.21.15.164:0/1614850482 conn(0x5587050b2680 msgr2=0x5587050b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 shutdown_connections 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/1614850482 wait complete. 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 msgr2=0x5587050aa980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 0x5587050aa980 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 msgr2=0x5587050af220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 0x5587050af220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 msgr2=0x7fdad403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 0x7fdad403f2d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c00 tx=0x7fdbd40013b0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 msgr2=0x5587050a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc025a60 tx=0x7fdbdc003330 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 shutdown_connections 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5587050ace30 0x5587050af220 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x558704faedf0 0x5587050aa980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fdad403ce10 0x7fdad403f2d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 --2- 172.21.15.164:0/3783565740 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558704f1cef0 0x5587050a3330 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 >> 172.21.15.164:0/3783565740 conn(0x558704fa3fa0 msgr2=0x55870509ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 shutdown_connections 2024-09-14T10:57:10.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.565+0000 7fdbf012c800 1 -- 172.21.15.164:0/3783565740 wait complete. 2024-09-14T10:57:10.574 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.574 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.574 ERROR:root:0 2024-09-14T10:57:10.575 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-14T10:57:10.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-14T10:57:10.575 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-14T10:57:10.628 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.629 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.631+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.631+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa73d23800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5619b0575070 0x5619b0604430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa73d23800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619b0608730 con 0x5619b0604a30 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa73d23800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5619b048c7d0 con 0x5619b0575070 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6fa0c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5619b0575070 0x5619b0604430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6f20b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x5619b0604a30 0x5619b0606ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58338/0 (socket says 172.21.15.164:58338) 2024-09-14T10:57:10.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6f20b640 1 -- 172.21.15.164:0/4250827455 learned_addr learned my addr 172.21.15.164:0/4250827455 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/4250827455 >> v1:172.21.15.116:6789/0 conn(0x5619b0604a30 legacy=0x5619b0606ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6ea0a640 1 -- 172.21.15.164:0/4250827455 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978250267 0 0) 0x5619b0608730 con 0x5619b0604a30 2024-09-14T10:57:10.631 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.632+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/4250827455 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b0609960 con 0x5619b0575070 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.634+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/4250827455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0604430 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000a470 tx=0x7ffa60045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c65887d4e02e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.634+0000 7ffa6ea0a640 1 -- 172.21.15.164:0/4250827455 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60053570 con 0x5619b0575070 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.634+0000 7ffa6ea0a640 1 -- 172.21.15.164:0/4250827455 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60058070 con 0x5619b0575070 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.634+0000 7ffa6ea0a640 1 -- 172.21.15.164:0/4250827455 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60053880 con 0x5619b0575070 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 -- 172.21.15.164:0/4250827455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 msgr2=0x5619b0604430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 --2- 172.21.15.164:0/4250827455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0604430 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000a470 tx=0x7ffa60045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 -- 172.21.15.164:0/4250827455 shutdown_connections 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 --2- 172.21.15.164:0/4250827455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0604430 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 -- 172.21.15.164:0/4250827455 >> 172.21.15.164:0/4250827455 conn(0x5619b05fbfe0 msgr2=0x5619b05fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 -- 172.21.15.164:0/4250827455 shutdown_connections 2024-09-14T10:57:10.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.635+0000 7ffa73d23800 1 -- 172.21.15.164:0/4250827455 wait complete. 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.648+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa73d23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa73d23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5619b0499dd0 con 0x5619b0575070 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa6fa0c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa6fa0c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57652/0 (socket says 172.21.15.164:57652) 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/900030942 learned_addr learned my addr 172.21.15.164:0/900030942 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.649+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/900030942 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b06f1ce0 con 0x5619b0575070 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/900030942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffa60025c20 tx=0x7ffa60051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aab392013bba952 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ff95de0b640 1 -- 172.21.15.164:0/900030942 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60053a20 con 0x5619b0575070 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ff95de0b640 1 -- 172.21.15.164:0/900030942 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60063070 con 0x5619b0575070 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ff95de0b640 1 -- 172.21.15.164:0/900030942 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60053d30 con 0x5619b0575070 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 -- 172.21.15.164:0/900030942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 msgr2=0x5619b06f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 --2- 172.21.15.164:0/900030942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ffa60025c20 tx=0x7ffa60051000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 -- 172.21.15.164:0/900030942 shutdown_connections 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 --2- 172.21.15.164:0/900030942 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b06f16f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 -- 172.21.15.164:0/900030942 >> 172.21.15.164:0/900030942 conn(0x5619b05fbfe0 msgr2=0x5619b06ed070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.650+0000 7ffa73d23800 1 -- 172.21.15.164:0/900030942 shutdown_connections 2024-09-14T10:57:10.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa73d23800 1 -- 172.21.15.164:0/900030942 wait complete. 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa73d23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa73d23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5619b0608c00 con 0x5619b0575070 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa6fa0c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa6fa0c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57654/0 (socket says 172.21.15.164:57654) 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/771711231 learned_addr learned my addr 172.21.15.164:0/771711231 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.651+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b06020a0 con 0x5619b0575070 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffa60025c20 tx=0x7ffa60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ff957fff640 1 -- 172.21.15.164:0/771711231 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60078070 con 0x5619b0575070 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ff957fff640 1 -- 172.21.15.164:0/771711231 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60073470 con 0x5619b0575070 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ff957fff640 1 -- 172.21.15.164:0/771711231 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa60073750 con 0x5619b0575070 2024-09-14T10:57:10.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619b0600450 con 0x5619b0575070 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.652+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b0600a70 con 0x5619b0575070 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ff957fff640 1 -- 172.21.15.164:0/771711231 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ffa6007b070 con 0x5619b0575070 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ff957fff640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 0x7ff95803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ff957fff640 1 -- 172.21.15.164:0/771711231 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ffa600985c0 con 0x5619b0575070 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 0x7ff95803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 0x5619b07026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0702c00 con 0x5619b0604a30 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa7020d640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 0x5619b07026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 0x7ff95803f2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000c00 tx=0x7ffa640013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.653+0000 7ffa7020d640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 0x5619b07026c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa7020d640 1 -- 172.21.15.164:0/771711231 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6800a4d0 con 0x5619b0604a30 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0600f20 con 0x5619b0604a30 2024-09-14T10:57:10.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa7020d640 1 -- 172.21.15.164:0/771711231 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa6800a4d0 con 0x5619b0604a30 2024-09-14T10:57:10.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 0x5619b0707260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0707930 con 0x5619b0704e70 2024-09-14T10:57:10.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 0x5619b0707260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.654+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 0x5619b0707260 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.655+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/771711231 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa6007a030 con 0x5619b0704e70 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.655+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0703d40 con 0x5619b0604a30 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.655+0000 7ffa7020d640 1 -- 172.21.15.164:0/771711231 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa6800a4d0 con 0x5619b0604a30 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.655+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0704160 con 0x5619b0604a30 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.655+0000 7ffa7020d640 1 -- 172.21.15.164:0/771711231 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa6800a4d0 con 0x5619b0604a30 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa73d23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa73d23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5619b04f84a0 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57668/0 (socket says 172.21.15.164:57668) 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa7020d640 1 -- 172.21.15.164:0/3308913281 learned_addr learned my addr 172.21.15.164:0/3308913281 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa7020d640 1 -- 172.21.15.164:0/3308913281 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b0716d20 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ffa7020d640 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x5619b06023b0 tx=0x7ffa68018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.656+0000 7ff9557fa640 1 -- 172.21.15.164:0/3308913281 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa68014450 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.657+0000 7ff9557fa640 1 -- 172.21.15.164:0/3308913281 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa680145f0 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.657+0000 7ff9557fa640 1 -- 172.21.15.164:0/3308913281 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa68014910 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.657+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619b0717550 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.657+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b0717af0 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.657+0000 7ff9557fa640 1 -- 172.21.15.164:0/3308913281 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ffa68011040 con 0x5619b07162c0 2024-09-14T10:57:10.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ff9557fa640 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 0x7ff94803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ff9557fa640 1 -- 172.21.15.164:0/3308913281 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ffa6801e070 con 0x5619b07162c0 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 0x7ff94803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 0x7ff94803f320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5619b0703010 tx=0x7ffa60096ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa73d23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa73d23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5619b06f20b0 con 0x5619b0722d20 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57678/0 (socket says 172.21.15.164:57678) 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.658+0000 7ffa7020d640 1 -- 172.21.15.164:0/535531530 learned_addr learned my addr 172.21.15.164:0/535531530 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa7020d640 1 -- 172.21.15.164:0/535531530 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b07236f0 con 0x5619b0722d20 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa7020d640 1 --2- 172.21.15.164:0/535531530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffa68016620 tx=0x7ffa68011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcb37571a112c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ff94effd640 1 -- 172.21.15.164:0/535531530 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa68051020 con 0x5619b0722d20 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ff94effd640 1 -- 172.21.15.164:0/535531530 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa68022de0 con 0x5619b0722d20 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ff94effd640 1 -- 172.21.15.164:0/535531530 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa68028070 con 0x5619b0722d20 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 -- 172.21.15.164:0/535531530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 msgr2=0x5619b0723100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 --2- 172.21.15.164:0/535531530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffa68016620 tx=0x7ffa68011a80 comp rx=0 tx=0).stop 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 -- 172.21.15.164:0/535531530 shutdown_connections 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 --2- 172.21.15.164:0/535531530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b0723100 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 -- 172.21.15.164:0/535531530 >> 172.21.15.164:0/535531530 conn(0x5619b071f120 msgr2=0x5619b071d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 -- 172.21.15.164:0/535531530 shutdown_connections 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.659+0000 7ffa73d23800 1 -- 172.21.15.164:0/535531530 wait complete. 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa73d23800 1 Processor -- start 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa73d23800 1 -- start start 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa73d23800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa73d23800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5619b0723d30 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa7020d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57682/0 (socket says 172.21.15.164:57682) 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 learned_addr learned my addr 172.21.15.164:0/3992683502 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b072a840 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ffa7020d640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffa68022f90 tx=0x7ffa68054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.660+0000 7ff94d7fa640 1 -- 172.21.15.164:0/3992683502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa6802b350 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ff94d7fa640 1 -- 172.21.15.164:0/3992683502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa68045130 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619b072aad0 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ff94d7fa640 1 -- 172.21.15.164:0/3992683502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa68045410 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b072b450 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ff94d7fa640 1 -- 172.21.15.164:0/3992683502 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7ffa68034030 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.661+0000 7ff94d7fa640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff93803ce60 0x7ff93803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ff94d7fa640 1 -- 172.21.15.164:0/3992683502 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7ffa68032070 con 0x5619b0722d20 2024-09-14T10:57:10.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff93803ce60 0x7ff93803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff93803ce60 0x7ff93803f320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa6005db10 tx=0x7ffa60091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0736020 0x5619b07384e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0738c30 con 0x5619b0736020 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.662+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0736020 0x5619b07384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0736020 0x5619b07384e0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f5f0 con 0x5619b0736020 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 realm 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0735370 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f5f0 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0739720 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6400f5f0 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0739ff0 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa6400f5f0 con 0x5619b0736020 2024-09-14T10:57:10.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.663+0000 7ffa73d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b073aa10 0x5619b073ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b073d570 con 0x5619b073aa10 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b073aa10 0x5619b073ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b073aa10 0x5619b073ce00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 20 searching for the correct realm 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ffa6804dc20 0x7ffa6803c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.664+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ffa6804dc20 0x7ffa6803c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ffa6804dc20 0x7ffa6803c290 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6fa0c640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ffa600a6040 0x7ffa600738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.665+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ffa600a6040 0x7ffa600738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.666+0000 7ffa6f20b640 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ffa600a6040 0x7ffa600738f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.666+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f5f0 con 0x7ffa600a6040 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.666+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.666+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6400f5f0 con 0x5619b0736020 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.666+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.667+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.668+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.669+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.670+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x5619b0736020 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.671+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b073aa10 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.672+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa600a6040 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6402b040 con 0x7ffa600a6040 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x5619b0736020 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5619b073ee60 con 0x7ffa6804dc20 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:10.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:10.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:10.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:10.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b073df60 con 0x5619b0736020 2024-09-14T10:57:10.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.673+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b073e800 con 0x5619b0736020 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b073f2e0 con 0x5619b0736020 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 zone default found 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 4 Realm: () 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:10.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 zonegroup default 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b073f680 con 0x7ffa600a6040 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0741520 con 0x5619b073aa10 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.674+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b07418c0 con 0x5619b073aa10 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa73d23800 20 started sync module instance, tier type = 2024-09-14T10:57:10.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa73d23800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:10.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.675+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07409b0 con 0x7ffa6804dc20 2024-09-14T10:57:10.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.676+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.676+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94668334566816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07421b0 con 0x7ffa6804dc20 2024-09-14T10:57:10.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.676+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0742a00 con 0x5619b0736020 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.677+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94668334566816] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.677+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.677+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94668334570752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0742a80 con 0x5619b0736020 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.677+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0743550 con 0x5619b073aa10 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.678+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94668334570752] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.678+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.678+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94668334575680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0743510 con 0x5619b073aa10 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.678+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0743fc0 con 0x7ffa6804dc20 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.679+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94668334575680] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.680+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.680+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94668334572880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0743f90 con 0x7ffa6804dc20 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.680+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0744a60 con 0x5619b0736020 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.681+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94668334572880] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.681+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.681+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94668334581072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0743f90 con 0x5619b0736020 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.681+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07454e0 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.682+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.682+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94668334583792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0745900 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.682+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07463f0 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.682+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94668334581072] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.683+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94668334583792] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.683+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.683+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94668334587584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0745410 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.683+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07469d0 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94668334587584] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94668334578400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b07469d0 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=0 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=1 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=2 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=3 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=4 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=5 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.684+0000 7ffa73d23800 20 add_watcher() i=6 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.685+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94668334578400] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.685+0000 7ffa73d23800 20 add_watcher() i=7 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.685+0000 7ffa73d23800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.685+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0749c90 con 0x5619b0736020 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.686+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.686+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94668334589584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b0746f60 con 0x5619b0736020 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94668334589584] v37'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ff925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 5 note: GC not initialized 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ff924fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 20 Filter name: none 2024-09-14T10:57:10.704 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ff89e7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.687+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b077cf90 con 0x7ffa600a6040 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-14T10:57:10.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b077b650 con 0x5619b073aa10 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.688+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077bef0 con 0x7ffa600a6040 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v37'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa73d23800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa73d23800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa73d23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94668334807616 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b07808d0 con 0x7ffa6804dc20 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== watch-notify(notify (1) cookie 94668334566816 notify 158913789975 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7ffa600ae040 con 0x7ffa6804dc20 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ff94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 94668334566816 notifier 4856 bl.length()=533 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(65 notify.0 [notify cookie 94668334807616 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ff94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-14T10:57:10.707 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ff94effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ff94effd640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ff934003ea0 con 0x7ffa6804dc20 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== watch-notify(notify_complete (2) cookie 94668334807616 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619b0600a70 con 0x7ffa6804dc20 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.690+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ba40 con 0x5619b073aa10 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v37'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa73d23800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa73d23800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa73d23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94668334807616 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5619b0780a30 con 0x5619b0736020 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94668334570752 notify 158913789974 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5619b077c290 con 0x5619b0736020 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ff94effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789974 cookie 94668334570752 notifier 4856 bl.length()=176 2024-09-14T10:57:10.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ff94effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ff94effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ff94effd640 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ff934003ea0 con 0x5619b0736020 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(68 notify.1 [notify cookie 94668334807616 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.692+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94668334807616 notify 158913789974 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619b077c8e0 con 0x5619b0736020 2024-09-14T10:57:10.709 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-14T10:57:10.689669Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.689658Z","tags":[],"group_ids":[]} 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.693+0000 7ff925fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.693+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94668334589584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x5619b0736020 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.694+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94668334589584] v37'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.694+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94668334566816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x7ffa6804dc20 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.695+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94668334566816] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.695+0000 7ffa73d23800 20 remove_watcher() i=0 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.695+0000 7ffa73d23800 2 removed watcher, disabling cache 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.695+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94668334570752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x5619b0736020 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.696+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94668334570752] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.696+0000 7ffa73d23800 20 remove_watcher() i=1 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.696+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94668334575680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x5619b073aa10 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.697+0000 7ffa7020d640 1 -- 172.21.15.164:0/3992683502 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94668334575680] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6802a070 con 0x5619b073aa10 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.697+0000 7ffa73d23800 20 remove_watcher() i=2 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.697+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94668334572880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x7ffa6804dc20 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.698+0000 7ffa6fa0c640 1 -- 172.21.15.164:0/3992683502 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94668334572880] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6007a030 con 0x7ffa6804dc20 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.698+0000 7ffa73d23800 20 remove_watcher() i=3 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.698+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94668334581072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x5619b0736020 2024-09-14T10:57:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.699+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94668334581072] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x5619b0736020 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.699+0000 7ffa73d23800 20 remove_watcher() i=4 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.699+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94668334583792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.700+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94668334583792] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.700+0000 7ffa73d23800 20 remove_watcher() i=5 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.700+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94668334587584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.701+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94668334587584] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.701+0000 7ffa73d23800 20 remove_watcher() i=6 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.701+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94668334578400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5619b077ad50 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94668334578400] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa6403b040 con 0x7ffa600a6040 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 20 remove_watcher() i=7 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ffa600a6040 msgr2=0x7ffa600738f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7ffa600a6040 0x7ffa600738f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0736020 msgr2=0x5619b07384e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0736020 0x5619b07384e0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ffa6804dc20 msgr2=0x7ffa6803c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7ffa6804dc20 0x7ffa6803c290 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b073aa10 msgr2=0x5619b073ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b073aa10 0x5619b073ce00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff93803ce60 msgr2=0x7ff93803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff93803ce60 0x7ff93803f320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa6005db10 tx=0x7ffa60091000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa6f20b640 1 -- 172.21.15.164:0/3992683502 reap_dead start 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 msgr2=0x5619b072a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ffa68022f90 tx=0x7ffa68054580 comp rx=0 tx=0).stop 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 shutdown_connections 2024-09-14T10:57:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3992683502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0722d20 0x5619b072a2e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 >> 172.21.15.164:0/3992683502 conn(0x5619b071f120 msgr2=0x5619b071d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 shutdown_connections 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.702+0000 7ffa73d23800 1 -- 172.21.15.164:0/3992683502 wait complete. 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 msgr2=0x7ff94803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 0x7ff94803f320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5619b0703010 tx=0x7ffa60096ad0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 msgr2=0x5619b07166e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x5619b06023b0 tx=0x7ffa68018830 comp rx=0 tx=0).stop 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 shutdown_connections 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff94803ce60 0x7ff94803f320 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/3308913281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b07162c0 0x5619b07166e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 >> 172.21.15.164:0/3308913281 conn(0x5619b070a670 msgr2=0x5619b070aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 shutdown_connections 2024-09-14T10:57:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/3308913281 wait complete. 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 msgr2=0x5619b07026c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 0x5619b07026c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 msgr2=0x5619b0707260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 0x5619b0707260 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 msgr2=0x7ff95803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 0x7ff95803f2d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffa64000c00 tx=0x7ffa640013b0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 msgr2=0x5619b0601b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffa60025c20 tx=0x7ffa60002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 shutdown_connections 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5619b0704e70 0x5619b0707260 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5619b0604a30 0x5619b07026c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7ff95803ce10 0x7ff95803f2d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 --2- 172.21.15.164:0/771711231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5619b0575070 0x5619b0601b40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 >> 172.21.15.164:0/771711231 conn(0x5619b05fbfe0 msgr2=0x5619b06f2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 shutdown_connections 2024-09-14T10:57:10.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.703+0000 7ffa73d23800 1 -- 172.21.15.164:0/771711231 wait complete. 2024-09-14T10:57:10.722 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-14T10:57:10.689669Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.689658Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.722 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-14T10:57:10.689669Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.689658Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:10.722 ERROR:root:0 2024-09-14T10:57:10.723 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:10.727 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:10.727 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-14T10:57:10.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-14T10:57:10.728 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-14T10:57:10.772 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.772 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb54b35800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55bc0bfeeba0 0x55bc0bff1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb54b35800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc0bff1710 con 0x55bc0bf5df90 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb54b35800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55bc0be757d0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb4bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55bc0bfeeba0 0x55bc0bff1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb5087d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55bc0bf5df90 0x55bc0bfed450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58348/0 (socket says 172.21.15.164:58348) 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.775+0000 7fcb5087d640 1 -- 172.21.15.164:0/1735941529 learned_addr learned my addr 172.21.15.164:0/1735941529 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.776+0000 7fcb4bfff640 1 -- 172.21.15.164:0/1735941529 >> v1:172.21.15.116:6789/0 conn(0x55bc0bf5df90 legacy=0x55bc0bfed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.776+0000 7fcb4bfff640 1 -- 172.21.15.164:0/1735941529 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0bff2940 con 0x55bc0bfeeba0 2024-09-14T10:57:10.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.777+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/1735941529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bfeeba0 0x55bc0bff1060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8d6583d9d5498b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb4b7fe640 1 -- 172.21.15.164:0/1735941529 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053570 con 0x55bc0bfeeba0 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb4b7fe640 1 -- 172.21.15.164:0/1735941529 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c058070 con 0x55bc0bfeeba0 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb4b7fe640 1 -- 172.21.15.164:0/1735941529 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c053880 con 0x55bc0bfeeba0 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 -- 172.21.15.164:0/1735941529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bfeeba0 msgr2=0x55bc0bff1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1735941529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bfeeba0 0x55bc0bff1060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a470 tx=0x7fcb3c045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 -- 172.21.15.164:0/1735941529 shutdown_connections 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1735941529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bfeeba0 0x55bc0bff1060 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 -- 172.21.15.164:0/1735941529 >> 172.21.15.164:0/1735941529 conn(0x55bc0bfe4f80 msgr2=0x55bc0bfe73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 -- 172.21.15.164:0/1735941529 shutdown_connections 2024-09-14T10:57:10.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.778+0000 7fcb54b35800 1 -- 172.21.15.164:0/1735941529 wait complete. 2024-09-14T10:57:10.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb54b35800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb54b35800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc0be82dd0 con 0x55bc0bf5df90 2024-09-14T10:57:10.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb5087d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb5087d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57696/0 (socket says 172.21.15.164:57696) 2024-09-14T10:57:10.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb5087d640 1 -- 172.21.15.164:0/91367621 learned_addr learned my addr 172.21.15.164:0/91367621 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.792+0000 7fcb5087d640 1 -- 172.21.15.164:0/91367621 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0bfeb1a0 con 0x55bc0bf5df90 2024-09-14T10:57:10.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fcb5087d640 1 --2- 172.21.15.164:0/91367621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001e40 tx=0x7fcb44001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c529d3a86569814a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fca3ee05640 1 -- 172.21.15.164:0/91367621 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44012020 con 0x55bc0bf5df90 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fca3ee05640 1 -- 172.21.15.164:0/91367621 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400e5a0 con 0x55bc0bf5df90 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fca3ee05640 1 -- 172.21.15.164:0/91367621 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4400e8a0 con 0x55bc0bf5df90 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fcb54b35800 1 -- 172.21.15.164:0/91367621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 msgr2=0x55bc0bfeabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.793+0000 7fcb54b35800 1 --2- 172.21.15.164:0/91367621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fcb44001e40 tx=0x7fcb44001e70 comp rx=0 tx=0).stop 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- 172.21.15.164:0/91367621 shutdown_connections 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 --2- 172.21.15.164:0/91367621 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0bfeabb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- 172.21.15.164:0/91367621 >> 172.21.15.164:0/91367621 conn(0x55bc0bfe4f80 msgr2=0x55bc0c0d6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- 172.21.15.164:0/91367621 shutdown_connections 2024-09-14T10:57:10.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- 172.21.15.164:0/91367621 wait complete. 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb54b35800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc0bff1be0 con 0x55bc0bf5df90 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb5087d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb5087d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57710/0 (socket says 172.21.15.164:57710) 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb5087d640 1 -- 172.21.15.164:0/1787755824 learned_addr learned my addr 172.21.15.164:0/1787755824 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.794+0000 7fcb5087d640 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c0e4a20 con 0x55bc0bf5df90 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fcb5087d640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c010 tx=0x7fcb44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fca3d602640 1 -- 172.21.15.164:0/1787755824 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44012030 con 0x55bc0bf5df90 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fca3d602640 1 -- 172.21.15.164:0/1787755824 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb440014a0 con 0x55bc0bf5df90 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0c0e4d10 con 0x55bc0bf5df90 2024-09-14T10:57:10.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fca3d602640 1 -- 172.21.15.164:0/1787755824 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4401a7a0 con 0x55bc0bf5df90 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.795+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0c0e58c0 con 0x55bc0bf5df90 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fca3d602640 1 -- 172.21.15.164:0/1787755824 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcb44015020 con 0x55bc0bf5df90 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fca3d602640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 0x7fca3803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fca3d602640 1 -- 172.21.15.164:0/1787755824 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fcb44020030 con 0x55bc0bf5df90 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 0x7fca3803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 0x55bc0c0ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c0ec050 con 0x55bc0bfeeba0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb5107e640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 0x55bc0c0ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 0x7fca3803f2d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c057000 tx=0x7fcb3c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.796+0000 7fcb5107e640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 0x55bc0c0ebb10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb5107e640 1 -- 172.21.15.164:0/1787755824 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c0ec3f0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb5107e640 1 -- 172.21.15.164:0/1787755824 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 0x55bc0c0f03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c0f0b30 con 0x55bc0c0edf30 2024-09-14T10:57:10.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb5087d640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 0x55bc0c0f03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.797+0000 7fcb5087d640 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 0x55bc0c0f03a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.798+0000 7fcb5087d640 1 -- 172.21.15.164:0/1787755824 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb4401ab20 con 0x55bc0c0edf30 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.798+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c0ecc40 con 0x55bc0bfeeba0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.798+0000 7fcb5107e640 1 -- 172.21.15.164:0/1787755824 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.798+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c0ed0a0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.798+0000 7fcb5107e640 1 -- 172.21.15.164:0/1787755824 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb4c00a4d0 con 0x55bc0bfeeba0 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb54b35800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb54b35800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc0bee14a0 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57726/0 (socket says 172.21.15.164:57726) 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb5107e640 1 -- 172.21.15.164:0/188782225 learned_addr learned my addr 172.21.15.164:0/188782225 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb5107e640 1 -- 172.21.15.164:0/188782225 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c0fffa0 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.799+0000 7fcb5107e640 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55bc0c0e5350 tx=0x7fcb4c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fca367fc640 1 -- 172.21.15.164:0/188782225 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014450 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fca367fc640 1 -- 172.21.15.164:0/188782225 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c014610 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0c1007d0 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fca367fc640 1 -- 172.21.15.164:0/188782225 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014930 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0c100d70 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.800+0000 7fca367fc640 1 -- 172.21.15.164:0/188782225 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcb4c011040 con 0x55bc0c0ff540 2024-09-14T10:57:10.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fca367fc640 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 0x7fca2803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fca367fc640 1 -- 172.21.15.164:0/188782225 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fcb4c01e070 con 0x55bc0c0ff540 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb5087d640 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 0x7fca2803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb5087d640 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 0x7fca2803f320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55bc0c0e65e0 tx=0x7fcb44052770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb54b35800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb54b35800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc0bfe95f0 con 0x55bc0c10bfa0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57734/0 (socket says 172.21.15.164:57734) 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.801+0000 7fcb5107e640 1 -- 172.21.15.164:0/360334123 learned_addr learned my addr 172.21.15.164:0/360334123 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb5107e640 1 -- 172.21.15.164:0/360334123 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c10c990 con 0x55bc0c10bfa0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb5107e640 1 --2- 172.21.15.164:0/360334123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c018430 tx=0x7fcb4c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a18593aa0cc48d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fca27fff640 1 -- 172.21.15.164:0/360334123 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c04b070 con 0x55bc0c10bfa0 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fca27fff640 1 -- 172.21.15.164:0/360334123 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c051070 con 0x55bc0c10bfa0 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fca27fff640 1 -- 172.21.15.164:0/360334123 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0167c0 con 0x55bc0c10bfa0 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 -- 172.21.15.164:0/360334123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 msgr2=0x55bc0c10c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 --2- 172.21.15.164:0/360334123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c018430 tx=0x7fcb4c014ea0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 -- 172.21.15.164:0/360334123 shutdown_connections 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 --2- 172.21.15.164:0/360334123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c10c3a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 -- 172.21.15.164:0/360334123 >> 172.21.15.164:0/360334123 conn(0x55bc0c1083a0 msgr2=0x55bc0c1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 -- 172.21.15.164:0/360334123 shutdown_connections 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.802+0000 7fcb54b35800 1 -- 172.21.15.164:0/360334123 wait complete. 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb54b35800 1 Processor -- start 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb54b35800 1 -- start start 2024-09-14T10:57:10.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb54b35800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c1135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb54b35800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c10cfb0 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c1135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb5107e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c1135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57738/0 (socket says 172.21.15.164:57738) 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 learned_addr learned my addr 172.21.15.164:0/610767003 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c113b30 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.803+0000 7fcb5107e640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c1135d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c02bfd0 tx=0x7fcb4c0544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fca267fc640 1 -- 172.21.15.164:0/610767003 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c04b040 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fca267fc640 1 -- 172.21.15.164:0/610767003 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c031030 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0c113dc0 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fca267fc640 1 -- 172.21.15.164:0/610767003 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c0167c0 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0c114740 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.804+0000 7fca267fc640 1 -- 172.21.15.164:0/610767003 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcb4c045720 con 0x55bc0c10bfa0 2024-09-14T10:57:10.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fca267fc640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca1c03ce60 0x7fca1c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fca267fc640 1 -- 172.21.15.164:0/610767003 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fcb4c00e040 con 0x55bc0c10bfa0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb5087d640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca1c03ce60 0x7fca1c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb5087d640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca1c03ce60 0x7fca1c03f320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c720 tx=0x7fcb4404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0c11f310 0x55bc0c1217d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c121f20 con 0x55bc0c11f310 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.805+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0c11f310 0x55bc0c1217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0c11f310 0x55bc0c1217d0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 realm 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c122350 con 0x55bc0c11f310 2024-09-14T10:57:10.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c122c20 con 0x55bc0c11f310 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.806+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c122fc0 con 0x55bc0c11f310 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c123d20 0x55bc0c126110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c126720 con 0x55bc0c123d20 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb5107e640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c123d20 0x55bc0c126110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb5107e640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c123d20 0x55bc0c126110 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb4c03e070 con 0x55bc0c123d20 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 20 searching for the correct realm 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.807+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb4c03e070 con 0x55bc0c123d20 2024-09-14T10:57:10.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5107e640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcb4c059040 0x7fcb4c0363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5087d640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcb4c059040 0x7fcb4c0363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5087d640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcb4c059040 0x7fcb4c0363e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5087d640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcb44017050 0x7fcb440163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.808+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcb44017050 0x7fcb440163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcb44017050 0x7fcb440163b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.809+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c03e070 con 0x55bc0c123d20 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.810+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c03e070 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.811+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.812+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.813+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x55bc0c11f310 2024-09-14T10:57:10.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.814+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c051070 con 0x7fcb44017050 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c123d20 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb44017050 2024-09-14T10:57:10.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.815+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x55bc0c11f310 2024-09-14T10:57:10.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128010 con 0x7fcb4c059040 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c1270e0 con 0x55bc0c11f310 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c127930 con 0x55bc0c11f310 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.816+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128490 con 0x55bc0c11f310 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 zone default found 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 4 Realm: () 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:10.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 zonegroup default 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c128830 con 0x7fcb44017050 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12a640 con 0x55bc0c123d20 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12ab30 con 0x55bc0c123d20 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 started sync module instance, tier type = 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.817+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c129ae0 con 0x7fcb4c059040 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.818+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.818+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266144759504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c129740 con 0x7fcb4c059040 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.819+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12ba60 con 0x55bc0c11f310 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.819+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266144759504] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.820+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.820+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266144765360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12be80 con 0x55bc0c11f310 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.820+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12c840 con 0x55bc0c123d20 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.821+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266144765360] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.821+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.821+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266144769392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12be80 con 0x55bc0c123d20 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.821+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12d2b0 con 0x7fcb4c059040 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.822+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266144769392] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.822+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.822+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266144766416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12bdf0 con 0x7fcb4c059040 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.822+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12e170 con 0x55bc0c11f310 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.823+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.823+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266144775360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12e0e0 con 0x55bc0c11f310 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.823+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12f120 con 0x7fcb44017050 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.823+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266144766416] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.824+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.824+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266144773792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12f0e0 con 0x7fcb44017050 2024-09-14T10:57:10.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.824+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12fb30 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.824+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266144775360] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.825+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266144773792] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.825+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.825+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266144779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12f050 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.825+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12ffe0 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266144779312] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266144781952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12ff50 con 0x7fcb44017050 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=0 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=1 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=2 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=3 2024-09-14T10:57:10.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=4 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=5 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.826+0000 7fcb54b35800 20 add_watcher() i=6 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.827+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266144781952] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.827+0000 7fcb54b35800 20 add_watcher() i=7 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.827+0000 7fcb54b35800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.827+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c133380 con 0x55bc0c11f310 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.828+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.828+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266144783472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c1308d0 con 0x55bc0c11f310 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.829+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266144783472] v37'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.829+0000 7fca06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.829+0000 7fcb54b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:10.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.829+0000 7fcb54b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.829+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13bcd0 con 0x55bc0c11f310 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.830+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.830+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13bcd0 con 0x7fcb44017050 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.831+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.831+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13c810 con 0x55bc0c123d20 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.832+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.832+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13c810 con 0x55bc0c11f310 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.833+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.833+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13cda0 con 0x7fcb4c059040 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.834+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'78 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.834+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13d250 con 0x55bc0c123d20 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.835+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.835+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13d250 con 0x55bc0c11f310 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.836+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.836+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13a330 con 0x7fcb44017050 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.838+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.838+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13a330 con 0x7fcb4c059040 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.839+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.839+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b340 con 0x55bc0c123d20 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.840+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.840+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b340 con 0x7fcb4c059040 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.841+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'79 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.841+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b340 con 0x7fcb44017050 2024-09-14T10:57:10.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.842+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.842+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b340 con 0x7fcb4c059040 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.843+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.843+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b340 con 0x7fcb44017050 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.844+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.844+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b510 con 0x55bc0c11f310 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.845+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.845+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b550 con 0x55bc0c123d20 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.846+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.846+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b510 con 0x7fcb4c059040 2024-09-14T10:57:10.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.847+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'80 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.847+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6e0 con 0x55bc0c123d20 2024-09-14T10:57:10.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.848+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.848+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6e0 con 0x55bc0c11f310 2024-09-14T10:57:10.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.849+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.849+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6e0 con 0x55bc0c11f310 2024-09-14T10:57:10.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.850+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.850+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6e0 con 0x55bc0c123d20 2024-09-14T10:57:10.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.851+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.851+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b670 con 0x7fcb4c059040 2024-09-14T10:57:10.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.852+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.852+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b630 con 0x55bc0c123d20 2024-09-14T10:57:10.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.853+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.853+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b630 con 0x55bc0c123d20 2024-09-14T10:57:10.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.854+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.854+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b670 con 0x55bc0c123d20 2024-09-14T10:57:10.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.855+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.855+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b670 con 0x55bc0c123d20 2024-09-14T10:57:10.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.856+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.856+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6b0 con 0x7fcb44017050 2024-09-14T10:57:10.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.857+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.857+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6b0 con 0x55bc0c123d20 2024-09-14T10:57:10.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.858+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.858+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b670 con 0x7fcb44017050 2024-09-14T10:57:10.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.859+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.860+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6b0 con 0x55bc0c123d20 2024-09-14T10:57:10.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.860+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.861+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b670 con 0x7fcb44017050 2024-09-14T10:57:10.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.862+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.862+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c13b6f0 con 0x7fcb4c059040 2024-09-14T10:57:10.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fca05fe3640 20 reqs_thread_entry: start 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb54b35800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb54b35800 20 Filter name: none 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fc9777fe640 20 reqs_thread_entry: start 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb54b35800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb54b35800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.863+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c168770 con 0x7fcb44017050 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 20 rados_obj.operate() r=0 bl.length=349 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c16aac0 con 0x7fcb44017050 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 10 removing key index: system_akey 2024-09-14T10:57:10.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.864+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c16aac0 con 0x55bc0c123d20 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(96 system_akey [delete] v37'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb54b35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94266145019312 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c16b3f0 con 0x55bc0c11f310 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== watch-notify(notify (1) cookie 94266144765360 notify 158913789975 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55bc0c13ad80 con 0x55bc0c11f310 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fca27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 94266144765360 notifier 4863 bl.length()=161 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(97 notify.1 [notify cookie 94266145019312 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fca27fff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fca14003d60 con 0x55bc0c11f310 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.865+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.866+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== watch-notify(notify_complete (2) cookie 94266145019312 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc0c13bea0 con 0x55bc0c11f310 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.866+0000 7fcb54b35800 10 removing email index: 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.866+0000 7fcb54b35800 10 removing user buckets index 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.866+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c168a50 con 0x7fcb44017050 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.867+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(99 system_user.buckets [delete] v37'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.867+0000 7fcb54b35800 10 removing user index: system_user 2024-09-14T10:57:10.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.867+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c16d410 con 0x7fcb44017050 2024-09-14T10:57:10.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(100 system_user [call,call,delete] v37'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb54b35800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-14T10:57:10.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb54b35800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-14T10:57:10.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94266145015200 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c169e80 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== watch-notify(notify (1) cookie 94266144759504 notify 158913789976 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55bc0c13c530 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fca27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789976 cookie 94266144759504 notifier 4863 bl.length()=160 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fca27fff640 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fca14003d60 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(101 notify.0 [notify cookie 94266145015200 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== watch-notify(notify_complete (2) cookie 94266145015200 notify 158913789976 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc0c13c360 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.868+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.869+0000 7fca06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:10.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.869+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266144783472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x55bc0c11f310 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.870+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94266144783472] v37'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.870+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266144759504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x7fcb4c059040 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.871+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94266144759504] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.871+0000 7fcb54b35800 20 remove_watcher() i=0 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.871+0000 7fcb54b35800 2 removed watcher, disabling cache 2024-09-14T10:57:10.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.871+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266144765360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x55bc0c11f310 2024-09-14T10:57:10.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.873+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94266144765360] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.873+0000 7fcb54b35800 20 remove_watcher() i=1 2024-09-14T10:57:10.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.873+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266144769392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12b5b0 con 0x55bc0c123d20 2024-09-14T10:57:10.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.874+0000 7fcb5107e640 1 -- 172.21.15.164:0/610767003 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94266144769392] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c063040 con 0x55bc0c123d20 2024-09-14T10:57:10.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.874+0000 7fcb54b35800 20 remove_watcher() i=2 2024-09-14T10:57:10.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.874+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266144766416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x7fcb4c059040 2024-09-14T10:57:10.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.875+0000 7fcb5087d640 1 -- 172.21.15.164:0/610767003 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94266144766416] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4401ab20 con 0x7fcb4c059040 2024-09-14T10:57:10.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.875+0000 7fcb54b35800 20 remove_watcher() i=3 2024-09-14T10:57:10.873 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.875+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266144775360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x55bc0c11f310 2024-09-14T10:57:10.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.876+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94266144775360] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x55bc0c11f310 2024-09-14T10:57:10.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.876+0000 7fcb54b35800 20 remove_watcher() i=4 2024-09-14T10:57:10.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.876+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266144773792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12dcc0 con 0x7fcb44017050 2024-09-14T10:57:10.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.877+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94266144773792] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.877+0000 7fcb54b35800 20 remove_watcher() i=5 2024-09-14T10:57:10.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.877+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266144779312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c139db0 con 0x7fcb44017050 2024-09-14T10:57:10.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.878+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94266144779312] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.878+0000 7fcb54b35800 20 remove_watcher() i=6 2024-09-14T10:57:10.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.878+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266144781952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55bc0c12dcc0 con 0x7fcb44017050 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94266144781952] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c080040 con 0x7fcb44017050 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 20 remove_watcher() i=7 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcb44017050 msgr2=0x7fcb440163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fcb44017050 0x7fcb440163b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0c11f310 msgr2=0x55bc0c1217d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0c11f310 0x55bc0c1217d0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcb4c059040 msgr2=0x7fcb4c0363e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fcb4c059040 0x7fcb4c0363e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c123d20 msgr2=0x55bc0c126110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c123d20 0x55bc0c126110 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca1c03ce60 msgr2=0x7fca1c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca1c03ce60 0x7fca1c03f320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c720 tx=0x7fcb4404f000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 msgr2=0x55bc0c1135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 --2- 172.21.15.164:0/610767003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c10bfa0 0x55bc0c1135d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c02bfd0 tx=0x7fcb4c0544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 reap_dead start 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb4bfff640 1 -- 172.21.15.164:0/610767003 reap_dead start 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 shutdown_connections 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 >> 172.21.15.164:0/610767003 conn(0x55bc0c1083a0 msgr2=0x55bc0c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 shutdown_connections 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.879+0000 7fcb54b35800 1 -- 172.21.15.164:0/610767003 wait complete. 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 msgr2=0x7fca2803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 0x7fca2803f320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55bc0c0e65e0 tx=0x7fcb44052770 comp rx=0 tx=0).stop 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 msgr2=0x55bc0c0ff960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55bc0c0e5350 tx=0x7fcb4c018830 comp rx=0 tx=0).stop 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 shutdown_connections 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca2803ce60 0x7fca2803f320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/188782225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0c0ff540 0x55bc0c0ff960 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 >> 172.21.15.164:0/188782225 conn(0x55bc0c0f38f0 msgr2=0x55bc0c0f3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 shutdown_connections 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/188782225 wait complete. 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 msgr2=0x55bc0c0ebb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 0x55bc0c0ebb10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 msgr2=0x55bc0c0f03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 0x55bc0c0f03a0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 msgr2=0x7fca3803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 0x7fca3803f2d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c057000 tx=0x7fcb3c052000 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 msgr2=0x55bc0c0e44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c010 tx=0x7fcb44000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 shutdown_connections 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55bc0c0edf30 0x55bc0c0f03a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55bc0bfeeba0 0x55bc0c0ebb10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fca3803ce10 0x7fca3803f2d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 --2- 172.21.15.164:0/1787755824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc0bf5df90 0x55bc0c0e44c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 >> 172.21.15.164:0/1787755824 conn(0x55bc0bfe4f80 msgr2=0x55bc0c0d5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 shutdown_connections 2024-09-14T10:57:10.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.880+0000 7fcb54b35800 1 -- 172.21.15.164:0/1787755824 wait complete. 2024-09-14T10:57:10.887 ERROR:root:None 2024-09-14T10:57:10.887 ERROR:root:0 2024-09-14T10:57:10.887 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-14T10:57:10.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-14T10:57:10.887 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-14T10:57:10.941 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:10.941 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:10.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.943+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2cb615800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55cf57de2ba0 0x55cf57de4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2cb615800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf57de5630 con 0x55cf57dde7f0 2024-09-14T10:57:10.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2cb615800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55cf57c6a7d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2be591640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55cf57de2ba0 0x55cf57de4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2be591640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55cf57de2ba0 0x55cf57de4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57750/0 (socket says 172.21.15.164:57750) 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2c6d92640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55cf57dde7f0 0x55cf57ddebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58360/0 (socket says 172.21.15.164:58360) 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2be591640 1 -- 172.21.15.164:0/3564307937 learned_addr learned my addr 172.21.15.164:0/3564307937 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2be591640 1 -- 172.21.15.164:0/3564307937 >> v1:172.21.15.116:6789/0 conn(0x55cf57dde7f0 legacy=0x55cf57ddebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2c6591640 1 -- 172.21.15.164:0/3564307937 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995065709 0 0) 0x55cf57de5630 con 0x55cf57dde7f0 2024-09-14T10:57:10.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.944+0000 7fc2be591640 1 -- 172.21.15.164:0/3564307937 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57de6860 con 0x55cf57de2ba0 2024-09-14T10:57:10.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.946+0000 7fc2be591640 1 --2- 172.21.15.164:0/3564307937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57de2ba0 0x55cf57de4fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000a520 tx=0x7fc2b0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81184f01c176eae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.946+0000 7fc2c6591640 1 -- 172.21.15.164:0/3564307937 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0055070 con 0x55cf57de2ba0 2024-09-14T10:57:10.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.946+0000 7fc2c6591640 1 -- 172.21.15.164:0/3564307937 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b00515b0 con 0x55cf57de2ba0 2024-09-14T10:57:10.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.946+0000 7fc2c6591640 1 -- 172.21.15.164:0/3564307937 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b00518d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 -- 172.21.15.164:0/3564307937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57de2ba0 msgr2=0x55cf57de4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 --2- 172.21.15.164:0/3564307937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57de2ba0 0x55cf57de4fb0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000a520 tx=0x7fc2b0045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 -- 172.21.15.164:0/3564307937 shutdown_connections 2024-09-14T10:57:10.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 --2- 172.21.15.164:0/3564307937 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57de2ba0 0x55cf57de4fb0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 -- 172.21.15.164:0/3564307937 >> 172.21.15.164:0/3564307937 conn(0x55cf57dd9fe0 msgr2=0x55cf57ddc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 -- 172.21.15.164:0/3564307937 shutdown_connections 2024-09-14T10:57:10.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.947+0000 7fc2cb615800 1 -- 172.21.15.164:0/3564307937 wait complete. 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2cb615800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2cb615800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cf57c77dd0 con 0x55cf57dde7f0 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2c6d92640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2c6d92640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57758/0 (socket says 172.21.15.164:57758) 2024-09-14T10:57:10.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2c6d92640 1 -- 172.21.15.164:0/4020912373 learned_addr learned my addr 172.21.15.164:0/4020912373 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.961+0000 7fc2c6d92640 1 -- 172.21.15.164:0/4020912373 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57ed22a0 con 0x55cf57dde7f0 2024-09-14T10:57:10.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.962+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/4020912373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8001ea0 tx=0x7fc2b800b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9417bd94f4e26f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.962+0000 7fc1b4e09640 1 -- 172.21.15.164:0/4020912373 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b8008070 con 0x55cf57dde7f0 2024-09-14T10:57:10.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.962+0000 7fc1b4e09640 1 -- 172.21.15.164:0/4020912373 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b800d500 con 0x55cf57dde7f0 2024-09-14T10:57:10.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.962+0000 7fc1b4e09640 1 -- 172.21.15.164:0/4020912373 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b800d880 con 0x55cf57dde7f0 2024-09-14T10:57:10.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- 172.21.15.164:0/4020912373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 msgr2=0x55cf57d52de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 --2- 172.21.15.164:0/4020912373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8001ea0 tx=0x7fc2b800b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- 172.21.15.164:0/4020912373 shutdown_connections 2024-09-14T10:57:10.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 --2- 172.21.15.164:0/4020912373 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57d52de0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- 172.21.15.164:0/4020912373 >> 172.21.15.164:0/4020912373 conn(0x55cf57dd9fe0 msgr2=0x55cf57ec9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- 172.21.15.164:0/4020912373 shutdown_connections 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- 172.21.15.164:0/4020912373 wait complete. 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2cb615800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cf57de5b00 con 0x55cf57dde7f0 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2c6d92640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2c6d92640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57774/0 (socket says 172.21.15.164:57774) 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.963+0000 7fc2c6d92640 1 -- 172.21.15.164:0/2257857350 learned_addr learned my addr 172.21.15.164:0/2257857350 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc2c6d92640 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57ed7750 con 0x55cf57dde7f0 2024-09-14T10:57:10.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80012f0 tx=0x7fc2b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc1b3606640 1 -- 172.21.15.164:0/2257857350 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b800f9d0 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc1b3606640 1 -- 172.21.15.164:0/2257857350 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b800fb70 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf57ed79e0 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc1b3606640 1 -- 172.21.15.164:0/2257857350 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2b800fe50 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.964+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf57ed83e0 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc1b3606640 1 -- 172.21.15.164:0/2257857350 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc2b8017040 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc1b3606640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc1b3606640 1 -- 172.21.15.164:0/2257857350 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc2b8015020 con 0x55cf57dde7f0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc2be591640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 0x55cf57ede840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57eded80 con 0x55cf57de2ba0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc2c7593640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 0x55cf57ede840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.965+0000 7fc2be591640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0057000 tx=0x7fc2b0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2c7593640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 0x55cf57ede840 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2c7593640 1 -- 172.21.15.164:0/2257857350 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2c000a4d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57edf120 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2c7593640 1 -- 172.21.15.164:0/2257857350 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2c000a4d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 0x55cf57ee30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57ee3830 con 0x55cf57ee0c20 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.966+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 0x55cf57ee30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.967+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 0x55cf57ee30a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.967+0000 7fc2c6d92640 1 -- 172.21.15.164:0/2257857350 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2b802d070 con 0x55cf57ee0c20 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.967+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57edf970 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.967+0000 7fc2c7593640 1 -- 172.21.15.164:0/2257857350 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2c000a4d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.967+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57edfdc0 con 0x55cf57de2ba0 2024-09-14T10:57:10.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2c7593640 1 -- 172.21.15.164:0/2257857350 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2c000a4d0 con 0x55cf57de2ba0 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2cb615800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2cb615800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cf57cd64a0 con 0x55cf57ef2210 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57778/0 (socket says 172.21.15.164:57778) 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.968+0000 7fc2c7593640 1 -- 172.21.15.164:0/1849242601 learned_addr learned my addr 172.21.15.164:0/1849242601 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc2c7593640 1 -- 172.21.15.164:0/1849242601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57ef2c70 con 0x55cf57ef2210 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc2c7593640 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000a2a0 tx=0x7fc2c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc1b0e01640 1 -- 172.21.15.164:0/1849242601 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0014450 con 0x55cf57ef2210 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc1b0e01640 1 -- 172.21.15.164:0/1849242601 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c00145f0 con 0x55cf57ef2210 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf57ef34a0 con 0x55cf57ef2210 2024-09-14T10:57:10.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc1b0e01640 1 -- 172.21.15.164:0/1849242601 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0014910 con 0x55cf57ef2210 2024-09-14T10:57:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.969+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf57ef3a40 con 0x55cf57ef2210 2024-09-14T10:57:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc1b0e01640 1 -- 172.21.15.164:0/1849242601 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc2c0011040 con 0x55cf57ef2210 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc1b0e01640 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 0x7fc1a003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc1b0e01640 1 -- 172.21.15.164:0/1849242601 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc2c001e070 con 0x55cf57ef2210 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 0x7fc1a003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 0x7fc1a003f320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55cf57ed92e0 tx=0x7fc2b80011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2cb615800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.970+0000 7fc2cb615800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cf57ed2580 con 0x55cf57efec50 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57794/0 (socket says 172.21.15.164:57794) 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2c7593640 1 -- 172.21.15.164:0/3968884274 learned_addr learned my addr 172.21.15.164:0/3968884274 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2c7593640 1 -- 172.21.15.164:0/3968884274 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57eff640 con 0x55cf57efec50 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2c7593640 1 --2- 172.21.15.164:0/3968884274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0016fd0 tx=0x7fc2c0001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457b3652226af792 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc1aa7fc640 1 -- 172.21.15.164:0/3968884274 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0051020 con 0x55cf57efec50 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc1aa7fc640 1 -- 172.21.15.164:0/3968884274 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c002b350 con 0x55cf57efec50 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc1aa7fc640 1 -- 172.21.15.164:0/3968884274 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0028070 con 0x55cf57efec50 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2cb615800 1 -- 172.21.15.164:0/3968884274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 msgr2=0x55cf57eff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.971+0000 7fc2cb615800 1 --2- 172.21.15.164:0/3968884274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0016fd0 tx=0x7fc2c0001440 comp rx=0 tx=0).stop 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- 172.21.15.164:0/3968884274 shutdown_connections 2024-09-14T10:57:10.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 --2- 172.21.15.164:0/3968884274 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57eff050 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- 172.21.15.164:0/3968884274 >> 172.21.15.164:0/3968884274 conn(0x55cf57efb050 msgr2=0x55cf57ef9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- 172.21.15.164:0/3968884274 shutdown_connections 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- 172.21.15.164:0/3968884274 wait complete. 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 Processor -- start 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- start start 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2cb615800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55cf57effc60 con 0x55cf57efec50 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2c7593640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57802/0 (socket says 172.21.15.164:57802) 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 learned_addr learned my addr 172.21.15.164:0/1214891546 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:10.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.972+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf57f067c0 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc2c7593640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00534c0 tx=0x7fc2c0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc1a8ff9640 1 -- 172.21.15.164:0/1214891546 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0031020 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc1a8ff9640 1 -- 172.21.15.164:0/1214891546 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0016440 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf57f06a50 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc1a8ff9640 1 -- 172.21.15.164:0/1214891546 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2c0054b90 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf57f073d0 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.973+0000 7fc1a8ff9640 1 -- 172.21.15.164:0/1214891546 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fc2c0034020 con 0x55cf57efec50 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc1a8ff9640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc19003ce10 0x7fc19003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc1a8ff9640 1 -- 172.21.15.164:0/1214891546 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fc2c000e040 con 0x55cf57efec50 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc19003ce10 0x7fc19003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc19003ce10 0x7fc19003f2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80189e0 tx=0x7fc2b8041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57f11ff0 0x55cf57f144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f14c00 con 0x55cf57f11ff0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.974+0000 7fc2be591640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57f11ff0 0x55cf57f144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2be591640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57f11ff0 0x55cf57f144b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 20 realm 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f15030 con 0x55cf57f11ff0 2024-09-14T10:57:10.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f15900 con 0x55cf57f11ff0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.975+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f15ca0 con 0x55cf57f11ff0 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57f16a00 0x55cf57f18df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f19400 con 0x55cf57f16a00 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2c7593640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57f16a00 0x55cf57f18df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2c7593640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57f16a00 0x55cf57f18df0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 20 searching for the correct realm 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.976+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x55cf57f16a00 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c7593640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc2c0036020 0x7fc2c002d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2c0036020 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc2c0036020 0x7fc2c002d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc2c0036020 0x7fc2c002d8e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c6d92640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc2b804b430 0x7fc2b80540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.977+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2b804b430 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc2b804b430 0x7fc2b80540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc2b804b430 0x7fc2b80540f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x55cf57f11ff0 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.978+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x55cf57f11ff0 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2b804b430 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2b804b430 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2c0036020 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.979+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x55cf57f16a00 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x55cf57f11ff0 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1acf0 con 0x7fc2c0036020 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f11ff0 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.980+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2c0036020 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2b804b430 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.981+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f11ff0 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f11ff0 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.982+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2b804b430 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2c0036020 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f11ff0 2024-09-14T10:57:10.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x55cf57f11ff0 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.983+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2b804b430 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2b804b430 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b0057030 con 0x7fc2b804b430 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2c0036020 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.984+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f16a00 2024-09-14T10:57:10.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2b804b430 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x55cf57f11ff0 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fc2b8061040 con 0x7fc2c0036020 2024-09-14T10:57:11.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.985+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f19df0 con 0x55cf57f11ff0 2024-09-14T10:57:11.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1a640 con 0x55cf57f11ff0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1b170 con 0x55cf57f11ff0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 zone default found 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 4 Realm: () 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 zonegroup default 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.986+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1b510 con 0x7fc2b804b430 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1d2f0 con 0x55cf57f16a00 2024-09-14T10:57:11.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1d7d0 con 0x55cf57f16a00 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 started sync module instance, tier type = 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.987+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1c790 con 0x7fc2c0036020 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.988+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.988+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94349022055296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1c3f0 con 0x7fc2c0036020 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.988+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1e700 con 0x55cf57f11ff0 2024-09-14T10:57:11.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.989+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94349022055296] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.990+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.990+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94349022061136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1eb20 con 0x55cf57f11ff0 2024-09-14T10:57:11.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.990+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1f4e0 con 0x55cf57f16a00 2024-09-14T10:57:11.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.991+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94349022061136] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.991+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.991+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94349022065168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1eb20 con 0x55cf57f16a00 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.991+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f1ff50 con 0x7fc2c0036020 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.992+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.992+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94349022067264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f20820 con 0x7fc2c0036020 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.992+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f21300 con 0x55cf57f11ff0 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.992+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94349022065168] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.993+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.993+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94349022072336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f21300 con 0x55cf57f11ff0 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.993+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f21db0 con 0x7fc2b804b430 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.993+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94349022067264] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.994+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.994+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94349022069616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f21d70 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.994+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f227f0 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.994+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94349022072336] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.995+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94349022069616] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.995+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.995+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94349022075072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f21ce0 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.995+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f22ca0 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94349022075072] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94349022078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f230c0 con 0x7fc2b804b430 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=0 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=1 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=2 2024-09-14T10:57:11.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=3 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=4 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=5 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.996+0000 7fc2cb615800 20 add_watcher() i=6 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94349022078960] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2cb615800 20 add_watcher() i=7 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2cb615800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f230c0 con 0x55cf57f11ff0 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:10.999+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94349022080016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f230a0 con 0x55cf57f11ff0 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.000+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94349022080016] v37'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.000+0000 7fc17d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.000+0000 7fc2cb615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.000+0000 7fc2cb615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 5 note: GC not initialized 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc0f7fff640 20 reqs_thread_entry: start 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 20 Filter name: none 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc0f5ffb640 20 reqs_thread_entry: start 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f59300 con 0x55cf57f16a00 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-14T10:57:11.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.001+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f579a0 con 0x55cf57f16a00 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.002+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f58240 con 0x55cf57f16a00 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v37'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2cb615800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-14T10:57:11.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2cb615800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2cb615800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94349022297488 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f5c790 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== watch-notify(notify (1) cookie 94349022065168 notify 158913789971 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55cf57f58c50 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc1aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 94349022065168 notifier 4870 bl.length()=542 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc1aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc1aa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc1aa7fc640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc18c003ea0 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(65 notify.2 [notify cookie 94349022297488 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.003+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== watch-notify(notify_complete (2) cookie 94349022297488 notify 158913789971 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2c006f040 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.004+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.004+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f581f0 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.005+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v37'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2cb615800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2cb615800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2cb615800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94349022297408 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f5c770 con 0x7fc2b804b430 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== watch-notify(notify (1) cookie 94349022069616 notify 158913790000 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55cf57de6860 con 0x7fc2b804b430 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(68 notify.5 [notify cookie 94349022297408 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc1a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913790000 cookie 94349022069616 notifier 4870 bl.length()=175 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc1a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc1a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc1a9ffb640 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc0fc003400 con 0x7fc2b804b430 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== watch-notify(notify_complete (2) cookie 94349022297408 notify 158913790000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2b005b9b0 con 0x7fc2b804b430 2024-09-14T10:57:11.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.006+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.019 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-14T10:57:11.002913Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:11.002902Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.007+0000 7fc17d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.007+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94349022080016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x55cf57f11ff0 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.008+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94349022080016] v37'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.008+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94349022055296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x7fc2c0036020 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.009+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94349022055296] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.009+0000 7fc2cb615800 20 remove_watcher() i=0 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.009+0000 7fc2cb615800 2 removed watcher, disabling cache 2024-09-14T10:57:11.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.009+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94349022061136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x55cf57f11ff0 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.010+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94349022061136] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.010+0000 7fc2cb615800 20 remove_watcher() i=1 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.010+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94349022065168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x55cf57f16a00 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.011+0000 7fc2c7593640 1 -- 172.21.15.164:0/1214891546 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94349022065168] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2c002a070 con 0x55cf57f16a00 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.011+0000 7fc2cb615800 20 remove_watcher() i=2 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.011+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94349022067264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x7fc2c0036020 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.012+0000 7fc2c6d92640 1 -- 172.21.15.164:0/1214891546 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94349022067264] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b8055d70 con 0x7fc2c0036020 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.013+0000 7fc2cb615800 20 remove_watcher() i=3 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.013+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94349022072336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x55cf57f11ff0 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.014+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94349022072336] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x55cf57f11ff0 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.014+0000 7fc2cb615800 20 remove_watcher() i=4 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.014+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94349022069616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x7fc2b804b430 2024-09-14T10:57:11.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.015+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94349022069616] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.015+0000 7fc2cb615800 20 remove_watcher() i=5 2024-09-14T10:57:11.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.015+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94349022075072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x7fc2b804b430 2024-09-14T10:57:11.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.016+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94349022075072] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.016+0000 7fc2cb615800 20 remove_watcher() i=6 2024-09-14T10:57:11.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.016+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94349022078960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cf57f57080 con 0x7fc2b804b430 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94349022078960] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2b007f040 con 0x7fc2b804b430 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 20 remove_watcher() i=7 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc2b804b430 msgr2=0x7fc2b80540f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fc2b804b430 0x7fc2b80540f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57f11ff0 msgr2=0x55cf57f144b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57f11ff0 0x55cf57f144b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc2c0036020 msgr2=0x7fc2c002d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fc2c0036020 0x7fc2c002d8e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57f16a00 msgr2=0x55cf57f18df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57f16a00 0x55cf57f18df0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc19003ce10 msgr2=0x7fc19003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc19003ce10 0x7fc19003f2d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80189e0 tx=0x7fc2b8041000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 msgr2=0x55cf57f06260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00534c0 tx=0x7fc2c0011f60 comp rx=0 tx=0).stop 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2be591640 1 -- 172.21.15.164:0/1214891546 reap_dead start 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 shutdown_connections 2024-09-14T10:57:11.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1214891546 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57efec50 0x55cf57f06260 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 >> 172.21.15.164:0/1214891546 conn(0x55cf57efb050 msgr2=0x55cf57ef9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 shutdown_connections 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1214891546 wait complete. 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 msgr2=0x7fc1a003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 0x7fc1a003f320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55cf57ed92e0 tx=0x7fc2b80011b0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 msgr2=0x55cf57ef2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.017+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000a2a0 tx=0x7fc2c0018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 shutdown_connections 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1a003ce60 0x7fc1a003f320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/1849242601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57ef2210 0x55cf57ef2630 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 >> 172.21.15.164:0/1849242601 conn(0x55cf57ee65c0 msgr2=0x55cf57ee69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 shutdown_connections 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/1849242601 wait complete. 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 msgr2=0x55cf57ede840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 0x55cf57ede840 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 msgr2=0x55cf57ee30a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 0x55cf57ee30a0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 msgr2=0x7fc1ac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0057000 tx=0x7fc2b0052000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 msgr2=0x55cf57ed71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80012f0 tx=0x7fc2b8000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 shutdown_connections 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55cf57ee0c20 0x55cf57ee30a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55cf57de2ba0 0x55cf57ede840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fc1ac03d000 0x7fc1ac03f4c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 --2- 172.21.15.164:0/2257857350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cf57dde7f0 0x55cf57ed71f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 >> 172.21.15.164:0/2257857350 conn(0x55cf57dd9fe0 msgr2=0x55cf57ec8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 shutdown_connections 2024-09-14T10:57:11.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.018+0000 7fc2cb615800 1 -- 172.21.15.164:0/2257857350 wait complete. 2024-09-14T10:57:11.032 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-14T10:57:11.002913Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:11.002902Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.032 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-14T10:57:11.002913Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:11.002902Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.033 ERROR:root:0 2024-09-14T10:57:11.033 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:11.037 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:11.038 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-14T10:57:11.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-14T10:57:11.038 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-14T10:57:11.083 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.083 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.085+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbc2c0f800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e929bdfc40 0x55e929be2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbc2c0f800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e929be2600 con 0x55e929bdbca0 2024-09-14T10:57:11.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbc2c0f800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55e929a677d0 con 0x55e929bdfc40 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbdb21640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e929bdfc40 0x55e929be2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbdb21640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55e929bdfc40 0x55e929be2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57810/0 (socket says 172.21.15.164:57810) 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbe322640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55e929bdbca0 0x55e929bdc0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58362/0 (socket says 172.21.15.164:58362) 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbdb21640 1 -- 172.21.15.164:0/1036251623 learned_addr learned my addr 172.21.15.164:0/1036251623 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbdb21640 1 -- 172.21.15.164:0/1036251623 >> v1:172.21.15.116:6789/0 conn(0x55e929bdbca0 legacy=0x55e929bdc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbdb21640 1 -- 172.21.15.164:0/1036251623 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929be3810 con 0x55e929bdfc40 2024-09-14T10:57:11.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.086+0000 7fbbbd320640 1 -- 172.21.15.164:0/1036251623 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1239735386 0 0) 0x55e929be2600 con 0x55e929bdbca0 2024-09-14T10:57:11.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.088+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/1036251623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdfc40 0x55e929be2030 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400a520 tx=0x7fbbb4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9b32ddedea028 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.088+0000 7fbbbd320640 1 -- 172.21.15.164:0/1036251623 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb4055070 con 0x55e929bdfc40 2024-09-14T10:57:11.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.088+0000 7fbbbd320640 1 -- 172.21.15.164:0/1036251623 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb40515b0 con 0x55e929bdfc40 2024-09-14T10:57:11.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.088+0000 7fbbbd320640 1 -- 172.21.15.164:0/1036251623 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb40518d0 con 0x55e929bdfc40 2024-09-14T10:57:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1036251623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdfc40 msgr2=0x55e929be2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/1036251623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdfc40 0x55e929be2030 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400a520 tx=0x7fbbb4045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1036251623 shutdown_connections 2024-09-14T10:57:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/1036251623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdfc40 0x55e929be2030 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1036251623 >> 172.21.15.164:0/1036251623 conn(0x55e929bd66e0 msgr2=0x55e929bd8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1036251623 shutdown_connections 2024-09-14T10:57:11.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.089+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1036251623 wait complete. 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.102+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbc2c0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbc2c0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e929a74dd0 con 0x55e929bdbca0 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbbe322640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbbe322640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57822/0 (socket says 172.21.15.164:57822) 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbbe322640 1 -- 172.21.15.164:0/3589719087 learned_addr learned my addr 172.21.15.164:0/3589719087 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.103+0000 7fbbbe322640 1 -- 172.21.15.164:0/3589719087 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929ccbac0 con 0x55e929bdbca0 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3589719087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0001ea0 tx=0x7fbbb000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb9262e0a104e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbaac608640 1 -- 172.21.15.164:0/3589719087 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb0008070 con 0x55e929bdbca0 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbaac608640 1 -- 172.21.15.164:0/3589719087 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb000d500 con 0x55e929bdbca0 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbaac608640 1 -- 172.21.15.164:0/3589719087 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb000d880 con 0x55e929bdbca0 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3589719087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 msgr2=0x55e929ccb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3589719087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0001ea0 tx=0x7fbbb000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3589719087 shutdown_connections 2024-09-14T10:57:11.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3589719087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929ccb4d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3589719087 >> 172.21.15.164:0/3589719087 conn(0x55e929bd66e0 msgr2=0x55e929cc6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3589719087 shutdown_connections 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.104+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3589719087 wait complete. 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbc2c0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbc2c0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e929be2ad0 con 0x55e929bdbca0 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbbe322640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbbe322640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57830/0 (socket says 172.21.15.164:57830) 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbbe322640 1 -- 172.21.15.164:0/499526948 learned_addr learned my addr 172.21.15.164:0/499526948 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.105+0000 7fbbbe322640 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929bdb7b0 con 0x55e929bdbca0 2024-09-14T10:57:11.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbbbe322640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00012f0 tx=0x7fbbb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbaaae05640 1 -- 172.21.15.164:0/499526948 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb000f9d0 con 0x55e929bdbca0 2024-09-14T10:57:11.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbaaae05640 1 -- 172.21.15.164:0/499526948 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb000fb70 con 0x55e929bdbca0 2024-09-14T10:57:11.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e929cd6d60 con 0x55e929bdbca0 2024-09-14T10:57:11.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbaaae05640 1 -- 172.21.15.164:0/499526948 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb000fe50 con 0x55e929bdbca0 2024-09-14T10:57:11.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.106+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e929cd7320 con 0x55e929bdbca0 2024-09-14T10:57:11.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbaaae05640 1 -- 172.21.15.164:0/499526948 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbbb0017040 con 0x55e929bdbca0 2024-09-14T10:57:11.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbaaae05640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 0x7fbaa403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbaaae05640 1 -- 172.21.15.164:0/499526948 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbbb0015020 con 0x55e929bdbca0 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 0x7fbaa403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 0x55e929cdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929cdb940 con 0x55e929bdfc40 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 0x55e929cdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.107+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 0x7fbaa403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4057000 tx=0x7fbbb4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 0x55e929cdb2d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbbeb23640 1 -- 172.21.15.164:0/499526948 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb800a4d0 con 0x55e929bdfc40 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929cd8710 con 0x55e929bdfc40 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbbeb23640 1 -- 172.21.15.164:0/499526948 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbb800a4d0 con 0x55e929bdfc40 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 0x55e929ce0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929ce0700 con 0x55e929cddc40 2024-09-14T10:57:11.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbbe322640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 0x55e929ce0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.108+0000 7fbbbe322640 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 0x55e929ce0030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.109+0000 7fbbbe322640 1 -- 172.21.15.164:0/499526948 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbb002d070 con 0x55e929cddc40 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.109+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929cdcae0 con 0x55e929bdfc40 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.109+0000 7fbbbeb23640 1 -- 172.21.15.164:0/499526948 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbb800a4d0 con 0x55e929bdfc40 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.109+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929cdcf80 con 0x55e929bdfc40 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.109+0000 7fbbbeb23640 1 -- 172.21.15.164:0/499526948 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbb800a4d0 con 0x55e929bdfc40 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbc2c0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbc2c0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e929ad34a0 con 0x55e929cef0e0 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57836/0 (socket says 172.21.15.164:57836) 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbbeb23640 1 -- 172.21.15.164:0/2002718321 learned_addr learned my addr 172.21.15.164:0/2002718321 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbbeb23640 1 -- 172.21.15.164:0/2002718321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929cefb40 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.110+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55e929cdbd40 tx=0x7fbbb8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbaa3fff640 1 -- 172.21.15.164:0/2002718321 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8014450 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbaa3fff640 1 -- 172.21.15.164:0/2002718321 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb80145f0 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbaa3fff640 1 -- 172.21.15.164:0/2002718321 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8014910 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e929cf0370 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e929cf0910 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.111+0000 7fbaa3fff640 1 -- 172.21.15.164:0/2002718321 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbbb8011040 con 0x55e929cef0e0 2024-09-14T10:57:11.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbaa3fff640 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 0x7fba9803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbaa3fff640 1 -- 172.21.15.164:0/2002718321 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbbb801e070 con 0x55e929cef0e0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbbe322640 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 0x7fba9803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbbe322640 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 0x7fba9803f320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55e929cdbde0 tx=0x7fbbb001bf60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbc2c0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbc2c0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e929ccbef0 con 0x55e929cd2cf0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57838/0 (socket says 172.21.15.164:57838) 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.112+0000 7fbbbeb23640 1 -- 172.21.15.164:0/1918653030 learned_addr learned my addr 172.21.15.164:0/1918653030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbbbeb23640 1 -- 172.21.15.164:0/1918653030 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929cd36c0 con 0x55e929cd2cf0 2024-09-14T10:57:11.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/1918653030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016620 tx=0x7fbbb8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a185ffc845d590 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbaa1ffb640 1 -- 172.21.15.164:0/1918653030 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8051020 con 0x55e929cd2cf0 2024-09-14T10:57:11.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbaa1ffb640 1 -- 172.21.15.164:0/1918653030 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb80560d0 con 0x55e929cd2cf0 2024-09-14T10:57:11.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbaa1ffb640 1 -- 172.21.15.164:0/1918653030 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8028070 con 0x55e929cd2cf0 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1918653030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 msgr2=0x55e929cd30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.113+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/1918653030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016620 tx=0x7fbbb8011a80 comp rx=0 tx=0).stop 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1918653030 shutdown_connections 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/1918653030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929cd30d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1918653030 >> 172.21.15.164:0/1918653030 conn(0x55e929cf7f40 msgr2=0x55e929cf6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1918653030 shutdown_connections 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/1918653030 wait complete. 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 Processor -- start 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- start start 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929d052f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbc2c0f800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55e929cd3d50 con 0x55e929cd2cf0 2024-09-14T10:57:11.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929d052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbbeb23640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929d052f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57840/0 (socket says 172.21.15.164:57840) 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 learned_addr learned my addr 172.21.15.164:0/3440200536 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.114+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e929d05850 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929d052f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016620 tx=0x7fbbb8054510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fba8ffff640 1 -- 172.21.15.164:0/3440200536 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8031020 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fba8ffff640 1 -- 172.21.15.164:0/3440200536 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb8022de0 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fba8ffff640 1 -- 172.21.15.164:0/3440200536 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb8054cd0 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e929d05ae0 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e929d06460 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.115+0000 7fba8ffff640 1 -- 172.21.15.164:0/3440200536 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbbb8034020 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fba8ffff640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba8803ce10 0x7fba8803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fba8ffff640 1 -- 172.21.15.164:0/3440200536 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbbb800e040 con 0x55e929cd2cf0 2024-09-14T10:57:11.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba8803ce10 0x7fba8803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba8803ce10 0x7fba8803f2d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000f640 tx=0x7fbbb0039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929d110d0 0x55e929d13590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d13ce0 con 0x55e929d110d0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.116+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929d110d0 0x55e929d13590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929d110d0 0x55e929d13590 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 realm 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d14110 con 0x55e929d110d0 2024-09-14T10:57:11.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d149e0 con 0x55e929d110d0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.117+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d14d80 con 0x55e929d110d0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929d15ae0 0x55e929d17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d184e0 con 0x55e929d15ae0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929d15ae0 0x55e929d17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929d15ae0 0x55e929d17ed0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 20 searching for the correct realm 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.118+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbeb23640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbbb8058040 0x7fbbb8001950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbbb8058040 0x7fbbb8001950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbbb8058040 0x7fbbb8001950 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb002d070 con 0x7fbbb8058040 2024-09-14T10:57:11.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbe322640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbbb00541c0 0x7fbbb00545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.119+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbbb00541c0 0x7fbbb00545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbbb00541c0 0x7fbbb00545e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.120+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.134 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb002d070 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.121+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb002d070 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbb002d070 con 0x7fbbb8058040 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.122+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.123+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.124+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb002d070 con 0x7fbbb8058040 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x55e929d110d0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.125+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb4057030 con 0x7fbbb00541c0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d15ae0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb00541c0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.126+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x55e929d110d0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e929d19dd0 con 0x7fbbb8058040 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d18ea0 con 0x55e929d110d0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d196f0 con 0x55e929d110d0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.127+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1a250 con 0x55e929d110d0 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 zone default found 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 4 Realm: () 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 zonegroup default 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1a5f0 con 0x7fbbb00541c0 2024-09-14T10:57:11.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1c3d0 con 0x55e929d15ae0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.128+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1c8e0 con 0x55e929d15ae0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.129+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.129+0000 7fbbc2c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.129+0000 7fbbc2c0f800 20 started sync module instance, tier type = 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.129+0000 7fbbc2c0f800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.141 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.129+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1b870 con 0x7fbbb8058040 2024-09-14T10:57:11.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.130+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.130+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94459917352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1d1f0 con 0x7fbbb8058040 2024-09-14T10:57:11.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.130+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1da40 con 0x55e929d110d0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.131+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94459917352032] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.131+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.131+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94459917356352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1da80 con 0x55e929d110d0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.131+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1e590 con 0x55e929d15ae0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.132+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94459917356352] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.132+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.132+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94459917361216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1e550 con 0x55e929d15ae0 2024-09-14T10:57:11.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.132+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1f020 con 0x7fbbb8058040 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.133+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94459917361216] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.133+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.133+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94459917364048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1f3c0 con 0x7fbbb8058040 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.133+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1fe80 con 0x55e929d110d0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.134+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94459917364048] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.134+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.134+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94459917367632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d20270 con 0x55e929d110d0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.134+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d20c90 con 0x7fbbb00541c0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.135+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.135+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94459917371264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d20c50 con 0x7fbbb00541c0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.135+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d21bf0 con 0x7fbbb00541c0 2024-09-14T10:57:11.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.135+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94459917367632] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.136+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94459917371264] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.136+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.136+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94459917375232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d21080 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.136+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d220a0 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94459917375232] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94459917358480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d220a0 con 0x7fbbb00541c0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=0 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=1 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=2 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=3 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=4 2024-09-14T10:57:11.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=5 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.137+0000 7fbbc2c0f800 20 add_watcher() i=6 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94459917358480] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbc2c0f800 20 add_watcher() i=7 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbc2c0f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d254a0 con 0x55e929d110d0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.139+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94459917376960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d229f0 con 0x55e929d110d0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.140+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94459917376960] v37'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.140+0000 7fba74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.140+0000 7fbbc2c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.140+0000 7fbbc2c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.140+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2de30 con 0x55e929d110d0 2024-09-14T10:57:11.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.142+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.142+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ddf0 con 0x7fbbb00541c0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.142+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.143+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2e870 con 0x55e929d15ae0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.144+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.144+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2e850 con 0x55e929d110d0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.144+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.145+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2eec0 con 0x7fbbb8058040 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.145+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'81 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.146+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2f8e0 con 0x55e929d15ae0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.146+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.146+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2f8e0 con 0x55e929d110d0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.148+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.148+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2f8e0 con 0x7fbbb00541c0 2024-09-14T10:57:11.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.148+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.149+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2f970 con 0x7fbbb8058040 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.150+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.150+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff00 con 0x55e929d15ae0 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.151+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.151+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fc50 con 0x7fbbb8058040 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.151+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'82 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.151+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fcc0 con 0x7fbbb00541c0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.153+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.153+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fdf0 con 0x7fbbb8058040 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.153+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.153+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fdf0 con 0x7fbbb00541c0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.155+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.155+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fdf0 con 0x55e929d110d0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.156+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.156+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fdf0 con 0x55e929d15ae0 2024-09-14T10:57:11.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.157+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.157+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2feb0 con 0x7fbbb8058040 2024-09-14T10:57:11.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.158+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'83 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.158+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2feb0 con 0x55e929d15ae0 2024-09-14T10:57:11.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.159+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.159+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fe80 con 0x55e929d110d0 2024-09-14T10:57:11.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.160+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.160+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fe80 con 0x55e929d110d0 2024-09-14T10:57:11.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.162+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.162+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2fe80 con 0x55e929d15ae0 2024-09-14T10:57:11.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.163+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.163+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x7fbbb8058040 2024-09-14T10:57:11.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.164+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.164+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.165+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.165+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.166+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.166+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.166+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.166+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.167+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.167+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x7fbbb00541c0 2024-09-14T10:57:11.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.168+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.168+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.169+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.169+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x7fbbb00541c0 2024-09-14T10:57:11.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.170+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.170+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d2ff10 con 0x55e929d15ae0 2024-09-14T10:57:11.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.171+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.172+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d30470 con 0x7fbbb00541c0 2024-09-14T10:57:11.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.172+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.172+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d30470 con 0x7fbbb8058040 2024-09-14T10:57:11.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.173+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fb9ef7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 20 Filter name: none 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fb9ed7fa640 20 reqs_thread_entry: start 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5aef0 con 0x55e929d15ae0 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.174+0000 7fbbc2c0f800 20 rados_obj.operate() r=0 bl.length=363 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-14T10:57:11.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5d800 con 0x55e929d15ae0 2024-09-14T10:57:11.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 10 removing key index: true_admin_akey 2024-09-14T10:57:11.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.175+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5b7e0 con 0x55e929d15ae0 2024-09-14T10:57:11.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(96 true_admin_akey [delete] v37'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbc2c0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-14T10:57:11.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94459917615856 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5dcf0 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== watch-notify(notify (1) cookie 94459917371264 notify 158913790001 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55e929d2e740 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbaa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913790001 cookie 94459917371264 notifier 4877 bl.length()=165 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(97 notify.5 [notify cookie 94459917615856 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbaa1ffb640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fba84003d60 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.176+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== watch-notify(notify_complete (2) cookie 94459917615856 notify 158913790001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e929d06460 con 0x7fbbb00541c0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbc2c0f800 10 removing email index: 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbc2c0f800 10 removing user buckets index 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5dc50 con 0x55e929d15ae0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(99 a_user.buckets [delete] v37'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbc2c0f800 10 removing user index: a_user 2024-09-14T10:57:11.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.177+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5dc50 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(100 a_user [call,call,delete] v37'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbc2c0f800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbc2c0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94459917622352 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5c2f0 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== watch-notify(notify (1) cookie 94459917361216 notify 158913789972 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55e929d2f9c0 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbaa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789972 cookie 94459917361216 notifier 4877 bl.length()=155 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(101 notify.2 [notify cookie 94459917622352 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbaa1ffb640 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fba84003d60 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.179+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== watch-notify(notify_complete (2) cookie 94459917622352 notify 158913789972 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbbb8070020 con 0x55e929d15ae0 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.180+0000 7fba74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.180+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94459917376960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d5dc50 con 0x55e929d110d0 2024-09-14T10:57:11.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.181+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94459917376960] v37'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.181+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94459917352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d21d90 con 0x7fbbb8058040 2024-09-14T10:57:11.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.182+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94459917352032] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.182+0000 7fbbc2c0f800 20 remove_watcher() i=0 2024-09-14T10:57:11.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.182+0000 7fbbc2c0f800 2 removed watcher, disabling cache 2024-09-14T10:57:11.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.182+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94459917356352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1bc60 con 0x55e929d110d0 2024-09-14T10:57:11.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.183+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94459917356352] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.183+0000 7fbbc2c0f800 20 remove_watcher() i=1 2024-09-14T10:57:11.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.183+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94459917361216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1bc60 con 0x55e929d15ae0 2024-09-14T10:57:11.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.184+0000 7fbbbeb23640 1 -- 172.21.15.164:0/3440200536 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94459917361216] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb802a070 con 0x55e929d15ae0 2024-09-14T10:57:11.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.184+0000 7fbbc2c0f800 20 remove_watcher() i=2 2024-09-14T10:57:11.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.184+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94459917364048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1bc60 con 0x7fbbb8058040 2024-09-14T10:57:11.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.185+0000 7fbbbe322640 1 -- 172.21.15.164:0/3440200536 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94459917364048] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb0063040 con 0x7fbbb8058040 2024-09-14T10:57:11.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.185+0000 7fbbc2c0f800 20 remove_watcher() i=3 2024-09-14T10:57:11.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.185+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94459917367632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1bc60 con 0x55e929d110d0 2024-09-14T10:57:11.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.186+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94459917367632] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x55e929d110d0 2024-09-14T10:57:11.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.186+0000 7fbbc2c0f800 20 remove_watcher() i=4 2024-09-14T10:57:11.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.186+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94459917371264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1f950 con 0x7fbbb00541c0 2024-09-14T10:57:11.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.187+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94459917371264] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.187+0000 7fbbc2c0f800 20 remove_watcher() i=5 2024-09-14T10:57:11.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.187+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94459917375232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d1f950 con 0x7fbbb00541c0 2024-09-14T10:57:11.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.188+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94459917375232] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.188+0000 7fbbc2c0f800 20 remove_watcher() i=6 2024-09-14T10:57:11.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.188+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94459917358480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e929d21700 con 0x7fbbb00541c0 2024-09-14T10:57:11.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94459917358480] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb407f040 con 0x7fbbb00541c0 2024-09-14T10:57:11.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 20 remove_watcher() i=7 2024-09-14T10:57:11.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbbb00541c0 msgr2=0x7fbbb00545e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbbb00541c0 0x7fbbb00545e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929d110d0 msgr2=0x55e929d13590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929d110d0 0x55e929d13590 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbbb8058040 msgr2=0x7fbbb8001950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbbb8058040 0x7fbbb8001950 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929d15ae0 msgr2=0x55e929d17ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929d15ae0 0x55e929d17ed0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba8803ce10 msgr2=0x7fba8803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba8803ce10 0x7fba8803f2d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000f640 tx=0x7fbbb0039000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 msgr2=0x55e929d052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/3440200536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cd2cf0 0x55e929d052f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8016620 tx=0x7fbbb8054510 comp rx=0 tx=0).stop 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 reap_dead start 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.189+0000 7fbbbdb21640 1 -- 172.21.15.164:0/3440200536 reap_dead start 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 shutdown_connections 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 >> 172.21.15.164:0/3440200536 conn(0x55e929cf7f40 msgr2=0x55e929cf6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 shutdown_connections 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/3440200536 wait complete. 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 msgr2=0x7fba9803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 0x7fba9803f320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55e929cdbde0 tx=0x7fbbb001bf60 comp rx=0 tx=0).stop 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 msgr2=0x55e929cef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x55e929cdbd40 tx=0x7fbbb8018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 shutdown_connections 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fba9803ce60 0x7fba9803f320 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/2002718321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929cef0e0 0x55e929cef500 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 >> 172.21.15.164:0/2002718321 conn(0x55e929ce3490 msgr2=0x55e929ce3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 shutdown_connections 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/2002718321 wait complete. 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 msgr2=0x55e929cdb2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 0x55e929cdb2d0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 msgr2=0x55e929ce0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 0x55e929ce0030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 msgr2=0x7fbaa403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 0x7fbaa403f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4057000 tx=0x7fbbb4052000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 msgr2=0x55e929bdb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.190+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00012f0 tx=0x7fbbb0000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 shutdown_connections 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55e929cddc40 0x55e929ce0030 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55e929bdfc40 0x55e929cdb2d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbaa403cfb0 0x7fbaa403f470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 --2- 172.21.15.164:0/499526948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e929bdbca0 0x55e929bdb250 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 >> 172.21.15.164:0/499526948 conn(0x55e929bd66e0 msgr2=0x55e929ccc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 shutdown_connections 2024-09-14T10:57:11.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.191+0000 7fbbc2c0f800 1 -- 172.21.15.164:0/499526948 wait complete. 2024-09-14T10:57:11.197 ERROR:root:None 2024-09-14T10:57:11.197 ERROR:root:0 2024-09-14T10:57:11.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-14T10:57:11.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-14T10:57:11.198 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-14T10:57:11.244 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.244 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f972a726800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x564bf00fd030 0x564bf018c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f972a726800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564bf01906f0 con 0x564bf018c9f0 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f972a726800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x564bf00147d0 con 0x564bf00fd030 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f9726309640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x564bf00fd030 0x564bf018c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f971db08640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x564bf018c9f0 0x564bf018ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58376/0 (socket says 172.21.15.164:58376) 2024-09-14T10:57:11.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f9726309640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x564bf00fd030 0x564bf018c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57842/0 (socket says 172.21.15.164:57842) 2024-09-14T10:57:11.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.247+0000 7f971db08640 1 -- 172.21.15.164:0/2972925638 learned_addr learned my addr 172.21.15.164:0/2972925638 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:11.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.248+0000 7f9726309640 1 -- 172.21.15.164:0/2972925638 >> v1:172.21.15.116:6789/0 conn(0x564bf018c9f0 legacy=0x564bf018ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.248+0000 7f9726309640 1 -- 172.21.15.164:0/2972925638 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf0191920 con 0x564bf00fd030 2024-09-14T10:57:11.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.249+0000 7f9726309640 1 --2- 172.21.15.164:0/2972925638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf018c3f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f971800a470 tx=0x7f9718045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0ca86675d675bc server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f9725b08640 1 -- 172.21.15.164:0/2972925638 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718053570 con 0x564bf00fd030 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f9725b08640 1 -- 172.21.15.164:0/2972925638 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718058070 con 0x564bf00fd030 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f9725b08640 1 -- 172.21.15.164:0/2972925638 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718053880 con 0x564bf00fd030 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 -- 172.21.15.164:0/2972925638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 msgr2=0x564bf018c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 --2- 172.21.15.164:0/2972925638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf018c3f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f971800a470 tx=0x7f9718045a20 comp rx=0 tx=0).stop 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 -- 172.21.15.164:0/2972925638 shutdown_connections 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 --2- 172.21.15.164:0/2972925638 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf018c3f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 -- 172.21.15.164:0/2972925638 >> 172.21.15.164:0/2972925638 conn(0x564bf0183fa0 msgr2=0x564bf0186400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 -- 172.21.15.164:0/2972925638 shutdown_connections 2024-09-14T10:57:11.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.250+0000 7f972a726800 1 -- 172.21.15.164:0/2972925638 wait complete. 2024-09-14T10:57:11.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f972a726800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f972a726800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564bf0021dd0 con 0x564bf00fd030 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f9726309640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f9726309640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57846/0 (socket says 172.21.15.164:57846) 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f9726309640 1 -- 172.21.15.164:0/2113961885 learned_addr learned my addr 172.21.15.164:0/2113961885 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.264+0000 7f9726309640 1 -- 172.21.15.164:0/2113961885 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf0279e60 con 0x564bf00fd030 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f9726309640 1 --2- 172.21.15.164:0/2113961885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9718025c20 tx=0x7f9718051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6266660c57d350a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f9614608640 1 -- 172.21.15.164:0/2113961885 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718053570 con 0x564bf00fd030 2024-09-14T10:57:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f9614608640 1 -- 172.21.15.164:0/2113961885 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718063070 con 0x564bf00fd030 2024-09-14T10:57:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f9614608640 1 -- 172.21.15.164:0/2113961885 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718053840 con 0x564bf00fd030 2024-09-14T10:57:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 -- 172.21.15.164:0/2113961885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 msgr2=0x564bf0279870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 --2- 172.21.15.164:0/2113961885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9718025c20 tx=0x7f9718051000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 -- 172.21.15.164:0/2113961885 shutdown_connections 2024-09-14T10:57:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 --2- 172.21.15.164:0/2113961885 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf00fd030 0x564bf0279870 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 -- 172.21.15.164:0/2113961885 >> 172.21.15.164:0/2113961885 conn(0x564bf0183fa0 msgr2=0x564bf02751f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.265+0000 7f972a726800 1 -- 172.21.15.164:0/2113961885 shutdown_connections 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f972a726800 1 -- 172.21.15.164:0/2113961885 wait complete. 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f972a726800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f972a726800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564bf0190bc0 con 0x564bf018c9f0 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f9726309640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f9726309640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57856/0 (socket says 172.21.15.164:57856) 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.266+0000 7f9726309640 1 -- 172.21.15.164:0/3532546762 learned_addr learned my addr 172.21.15.164:0/3532546762 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f9726309640 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf0281a20 con 0x564bf018c9f0 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f9726309640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9718025c20 tx=0x7f9718002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f9612e05640 1 -- 172.21.15.164:0/3532546762 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718074480 con 0x564bf018c9f0 2024-09-14T10:57:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f9612e05640 1 -- 172.21.15.164:0/3532546762 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9718074620 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564bf0281cb0 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f9612e05640 1 -- 172.21.15.164:0/3532546762 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9718074900 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.267+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf02828c0 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f9612e05640 1 -- 172.21.15.164:0/3532546762 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9718074aa0 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f9612e05640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 0x7f960c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f9612e05640 1 -- 172.21.15.164:0/3532546762 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f97180988c0 con 0x564bf018c9f0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f971db08640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 0x7f960c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 0x564bf0288ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf0289430 con 0x564bf0286b00 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f9726b0a640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 0x564bf0288ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f971db08640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 0x7f960c03f320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9710001d70 tx=0x7f97100012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.268+0000 7f9726b0a640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 0x564bf0288ef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f9726b0a640 1 -- 172.21.15.164:0/3532546762 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f972000a4d0 con 0x564bf0286b00 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02897d0 con 0x564bf0286b00 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f9726b0a640 1 -- 172.21.15.164:0/3532546762 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f972000a4d0 con 0x564bf0286b00 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 0x564bf028d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf028de80 con 0x564bf028b250 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f9726309640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 0x564bf028d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.269+0000 7f9726309640 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 0x564bf028d6f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.270+0000 7f9726309640 1 -- 172.21.15.164:0/3532546762 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9718094040 con 0x564bf028b250 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.270+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf028a020 con 0x564bf0286b00 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.270+0000 7f9726b0a640 1 -- 172.21.15.164:0/3532546762 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f972000a4d0 con 0x564bf0286b00 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.270+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf028a3c0 con 0x564bf0286b00 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.270+0000 7f9726b0a640 1 -- 172.21.15.164:0/3532546762 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f972000a4d0 con 0x564bf0286b00 2024-09-14T10:57:11.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f972a726800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f972a726800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564bf00804a0 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57862/0 (socket says 172.21.15.164:57862) 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f9726b0a640 1 -- 172.21.15.164:0/2582923537 learned_addr learned my addr 172.21.15.164:0/2582923537 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f9726b0a640 1 -- 172.21.15.164:0/2582923537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf029d2d0 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.271+0000 7f9726b0a640 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x564bf02824c0 tx=0x7f9720018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f960bfff640 1 -- 172.21.15.164:0/2582923537 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9720014450 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f960bfff640 1 -- 172.21.15.164:0/2582923537 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720014610 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f960bfff640 1 -- 172.21.15.164:0/2582923537 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9720014930 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564bf029db00 con 0x564bf029c870 2024-09-14T10:57:11.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf029e0a0 con 0x564bf029c870 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.272+0000 7f960bfff640 1 -- 172.21.15.164:0/2582923537 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9720011040 con 0x564bf029c870 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f960bfff640 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 0x7f960003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f960bfff640 1 -- 172.21.15.164:0/2582923537 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f972001e070 con 0x564bf029c870 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f9726309640 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 0x7f960003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f9726309640 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 0x7f960003f320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f971805db40 tx=0x7f9718074e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f972a726800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f972a726800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564bf027a230 con 0x564bf02a92d0 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57868/0 (socket says 172.21.15.164:57868) 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.273+0000 7f9726b0a640 1 -- 172.21.15.164:0/2246139044 learned_addr learned my addr 172.21.15.164:0/2246139044 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f9726b0a640 1 -- 172.21.15.164:0/2246139044 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf02a9cc0 con 0x564bf02a92d0 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f9726b0a640 1 --2- 172.21.15.164:0/2246139044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9720054580 tx=0x7f972002b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a3435336a6a084 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f9609ffb640 1 -- 172.21.15.164:0/2246139044 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f972004b070 con 0x564bf02a92d0 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f9609ffb640 1 -- 172.21.15.164:0/2246139044 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720051070 con 0x564bf02a92d0 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f9609ffb640 1 -- 172.21.15.164:0/2246139044 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9720011da0 con 0x564bf02a92d0 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 -- 172.21.15.164:0/2246139044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 msgr2=0x564bf02a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 --2- 172.21.15.164:0/2246139044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9720054580 tx=0x7f972002b4c0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 -- 172.21.15.164:0/2246139044 shutdown_connections 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 --2- 172.21.15.164:0/2246139044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02a96d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 -- 172.21.15.164:0/2246139044 >> 172.21.15.164:0/2246139044 conn(0x564bf02a56d0 msgr2=0x564bf02a3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 -- 172.21.15.164:0/2246139044 shutdown_connections 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.274+0000 7f972a726800 1 -- 172.21.15.164:0/2246139044 wait complete. 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f972a726800 1 Processor -- start 2024-09-14T10:57:11.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f972a726800 1 -- start start 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f972a726800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f972a726800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x564bf02aa2e0 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f9726b0a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57884/0 (socket says 172.21.15.164:57884) 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 learned_addr learned my addr 172.21.15.164:0/1556507690 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf02b0e10 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.275+0000 7f9726b0a640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9720049040 tx=0x7f97200544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f95f7fff640 1 -- 172.21.15.164:0/1556507690 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f972004b040 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564bf02b10a0 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf02b1a20 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f95f7fff640 1 -- 172.21.15.164:0/1556507690 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9720031030 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f95f7fff640 1 -- 172.21.15.164:0/1556507690 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f972003c060 con 0x564bf02a92d0 2024-09-14T10:57:11.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.276+0000 7f95f7fff640 1 -- 172.21.15.164:0/1556507690 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9720011330 con 0x564bf02a92d0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f95f7fff640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f95f003ce10 0x7f95f003f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f95f7fff640 1 -- 172.21.15.164:0/1556507690 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f972000e040 con 0x564bf02a92d0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f9726309640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f95f003ce10 0x7f95f003f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f9726309640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f95f003ce10 0x7f95f003f2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x564bf028e280 tx=0x7f971808a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf02bc630 0x564bf02beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02bf240 con 0x564bf02bc630 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.277+0000 7f971db08640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf02bc630 0x564bf02beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f971db08640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf02bc630 0x564bf02beaf0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9710009050 con 0x564bf02bc630 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 realm 2024-09-14T10:57:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02bb980 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9710009050 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02bfd30 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9710009050 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.278+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c0600 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9710009050 con 0x564bf02bc630 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf02c1020 0x564bf02c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c3b50 con 0x564bf02c1020 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f9726b0a640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf02c1020 0x564bf02c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f9726b0a640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf02c1020 0x564bf02c3410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 20 searching for the correct realm 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.279+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c5440 con 0x564bf02c1020 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726b0a640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9720014070 0x7f97200369e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726309640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9720014070 0x7f97200369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726309640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9720014070 0x7f97200369e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726309640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x564bf00fd030 0x7f9718095340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.280+0000 7f971db08640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x564bf00fd030 0x7f9718095340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.281+0000 7f971db08640 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x564bf00fd030 0x7f9718095340 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.281+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710009050 con 0x564bf00fd030 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.281+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.281+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710009050 con 0x564bf02bc630 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.281+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.282+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.283+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.284+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.285+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf02bc630 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.286+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02c1020 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf00fd030 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9710029040 con 0x564bf00fd030 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.287+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x564bf02bc630 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f9720057080 con 0x7f9720014070 2024-09-14T10:57:11.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c4540 con 0x564bf02bc630 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c4d90 con 0x564bf02bc630 2024-09-14T10:57:11.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.288+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c58c0 con 0x564bf02bc630 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 zone default found 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 4 Realm: () 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 zonegroup default 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c5c60 con 0x564bf00fd030 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c7a70 con 0x564bf02c1020 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.289+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c7f90 con 0x564bf02c1020 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.290+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.290+0000 7f972a726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.290+0000 7f972a726800 20 started sync module instance, tier type = 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.290+0000 7f972a726800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.290+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c6f10 con 0x7f9720014070 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.291+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.291+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94884151978592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c83f0 con 0x7f9720014070 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.291+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c8c40 con 0x564bf02bc630 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.292+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94884151978592] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.292+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.292+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94884151986064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c9060 con 0x564bf02bc630 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.292+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c98b0 con 0x564bf02c1020 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.293+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94884151986064] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.293+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.293+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94884151987600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02c97c0 con 0x564bf02c1020 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.293+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02ca2c0 con 0x7f9720014070 2024-09-14T10:57:11.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.294+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94884151987600] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.294+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.294+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94884151991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02ca6e0 con 0x7f9720014070 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.295+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cb0e0 con 0x564bf02bc630 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.295+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94884151991728] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.296+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.296+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94884151988752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cb0a0 con 0x564bf02bc630 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.296+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cbb60 con 0x564bf00fd030 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.296+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.297+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94884151998064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cbad0 con 0x564bf00fd030 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.297+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02ccb30 con 0x564bf00fd030 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.297+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94884151988752] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.297+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94884151998064] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.298+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.298+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94884152000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cabf0 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.298+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02ccfa0 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.298+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94884152000336] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94884152002080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02ccfa0 con 0x564bf00fd030 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=0 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=1 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=2 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=3 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=4 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=5 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.299+0000 7f972a726800 20 add_watcher() i=6 2024-09-14T10:57:11.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94884152002080] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f972a726800 20 add_watcher() i=7 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f972a726800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf02d03c0 con 0x564bf02bc630 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.300+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94884152003776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf02cd8d0 con 0x564bf02bc630 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94884152003776] v37'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f95dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f972a726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f972a726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f972a726800 5 note: GC not initialized 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f95577fe640 20 reqs_thread_entry: start 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.301+0000 7f972a726800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.314 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 20 Filter name: none 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f95557fa640 20 reqs_thread_entry: start 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf0303760 con 0x564bf00fd030 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.302+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0309cd0 con 0x564bf00fd030 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.303+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.303+0000 7f972a726800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.303+0000 7f972a726800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.315 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.303+0000 7f972a726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94884152252048 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564bf03052d0 con 0x564bf02bc630 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94884151988752 notify 158913789976 ret 0) ==== 708+0+0 (crc 0 0 0) 0x564bf01906f0 con 0x564bf02bc630 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f9609ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789976 cookie 94884151988752 notifier 4884 bl.length()=666 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94884152252048 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f9609ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f9609ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f9609ffb640 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f95ec003ea0 con 0x564bf02bc630 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.316 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.304+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94884152252048 notify 158913789976 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f971003abb0 con 0x564bf02bc630 2024-09-14T10:57:11.317 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.305+0000 7f95dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.305+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94884152003776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf02bc630 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.306+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94884152003776] v37'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.306+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94884151978592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x7f9720014070 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.307+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94884151978592] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.307+0000 7f972a726800 20 remove_watcher() i=0 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.307+0000 7f972a726800 2 removed watcher, disabling cache 2024-09-14T10:57:11.322 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.307+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94884151986064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf02bc630 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.308+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94884151986064] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.308+0000 7f972a726800 20 remove_watcher() i=1 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.308+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94884151987600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf02c1020 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.310+0000 7f9726b0a640 1 -- 172.21.15.164:0/1556507690 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94884151987600] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f972003e070 con 0x564bf02c1020 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.310+0000 7f972a726800 20 remove_watcher() i=2 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.310+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94884151991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x7f9720014070 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.311+0000 7f9726309640 1 -- 172.21.15.164:0/1556507690 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94884151991728] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9718094040 con 0x7f9720014070 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.311+0000 7f972a726800 20 remove_watcher() i=3 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.311+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94884151988752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf02bc630 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.312+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94884151988752] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf02bc630 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.312+0000 7f972a726800 20 remove_watcher() i=4 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.312+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94884151998064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf00fd030 2024-09-14T10:57:11.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.313+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94884151998064] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.313+0000 7f972a726800 20 remove_watcher() i=5 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.313+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94884152000336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf00fd030 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.314+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94884152000336] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.314+0000 7f972a726800 20 remove_watcher() i=6 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.314+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94884152002080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564bf0301540 con 0x564bf00fd030 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94884152002080] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9710039040 con 0x564bf00fd030 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 20 remove_watcher() i=7 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x564bf00fd030 msgr2=0x7f9718095340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x564bf00fd030 0x7f9718095340 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf02bc630 msgr2=0x564bf02beaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf02bc630 0x564bf02beaf0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9720014070 msgr2=0x7f97200369e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f9720014070 0x7f97200369e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf02c1020 msgr2=0x564bf02c3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf02c1020 0x564bf02c3410 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f95f003ce10 msgr2=0x7f95f003f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f95f003ce10 0x7f95f003f2d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x564bf028e280 tx=0x7f971808a000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 msgr2=0x564bf02b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f971db08640 1 -- 172.21.15.164:0/1556507690 reap_dead start 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9720049040 tx=0x7f97200544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 shutdown_connections 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 --2- 172.21.15.164:0/1556507690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf02a92d0 0x564bf02b08b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.315+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 >> 172.21.15.164:0/1556507690 conn(0x564bf02a56d0 msgr2=0x564bf02a38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 shutdown_connections 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/1556507690 wait complete. 2024-09-14T10:57:11.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 msgr2=0x7f960003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 0x7f960003f320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f971805db40 tx=0x7f9718074e70 comp rx=0 tx=0).stop 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 msgr2=0x564bf029cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x564bf02824c0 tx=0x7f9720018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 shutdown_connections 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960003ce60 0x7f960003f320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/2582923537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf029c870 0x564bf029cc90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 >> 172.21.15.164:0/2582923537 conn(0x564bf0290c20 msgr2=0x564bf0291000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 shutdown_connections 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/2582923537 wait complete. 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 msgr2=0x564bf0288ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 0x564bf0288ef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 msgr2=0x564bf028d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 0x564bf028d6f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 msgr2=0x7f960c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 0x7f960c03f320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9710001d70 tx=0x7f97100012d0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 msgr2=0x564bf02814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9718025c20 tx=0x7f9718002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 shutdown_connections 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x564bf028b250 0x564bf028d6f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x564bf0286b00 0x564bf0288ef0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f960c03ce60 0x7f960c03f320 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 --2- 172.21.15.164:0/3532546762 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564bf018c9f0 0x564bf02814c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 >> 172.21.15.164:0/3532546762 conn(0x564bf0183fa0 msgr2=0x564bf02739e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 shutdown_connections 2024-09-14T10:57:11.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.316+0000 7f972a726800 1 -- 172.21.15.164:0/3532546762 wait complete. 2024-09-14T10:57:11.329 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.329 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.329 ERROR:root:0 2024-09-14T10:57:11.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:11.333 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:11.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-14T10:57:11.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-14T10:57:11.334 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-14T10:57:11.380 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.380 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2f90c800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c95de429b0 0x55c95de42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2f90c800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c95de44550 con 0x55c95de43990 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2f90c800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55c95dccd7d0 con 0x55c95de429b0 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2d3f6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c95de429b0 0x55c95de42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2cbf5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x55c95de43990 0x55c95de43e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58390/0 (socket says 172.21.15.164:58390) 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2d3f6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55c95de429b0 0x55c95de42db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57886/0 (socket says 172.21.15.164:57886) 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.383+0000 7fae2cbf5640 1 -- 172.21.15.164:0/3928226197 learned_addr learned my addr 172.21.15.164:0/3928226197 (peer_addr_for_me v1:172.21.15.164:0/0) 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.384+0000 7fae2d3f6640 1 -- 172.21.15.164:0/3928226197 >> v1:172.21.15.116:6789/0 conn(0x55c95de43990 legacy=0x55c95de43e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.384+0000 7fae2d3f6640 1 -- 172.21.15.164:0/3928226197 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95de44720 con 0x55c95de429b0 2024-09-14T10:57:11.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.385+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/3928226197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95de42db0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fae28005fd0 tx=0x7fae28045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ee307957ac0119 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.385+0000 7fae27fff640 1 -- 172.21.15.164:0/3928226197 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28058530 con 0x55c95de429b0 2024-09-14T10:57:11.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae27fff640 1 -- 172.21.15.164:0/3928226197 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae280586d0 con 0x55c95de429b0 2024-09-14T10:57:11.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae27fff640 1 -- 172.21.15.164:0/3928226197 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae280589d0 con 0x55c95de429b0 2024-09-14T10:57:11.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 -- 172.21.15.164:0/3928226197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 msgr2=0x55c95de42db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 --2- 172.21.15.164:0/3928226197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95de42db0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fae28005fd0 tx=0x7fae28045c30 comp rx=0 tx=0).stop 2024-09-14T10:57:11.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 -- 172.21.15.164:0/3928226197 shutdown_connections 2024-09-14T10:57:11.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 --2- 172.21.15.164:0/3928226197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95de42db0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 -- 172.21.15.164:0/3928226197 >> 172.21.15.164:0/3928226197 conn(0x55c95de3e1a0 msgr2=0x55c95de40600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 -- 172.21.15.164:0/3928226197 shutdown_connections 2024-09-14T10:57:11.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.386+0000 7fae2f90c800 1 -- 172.21.15.164:0/3928226197 wait complete. 2024-09-14T10:57:11.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2f90c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2f90c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c95dcdadd0 con 0x55c95de429b0 2024-09-14T10:57:11.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2d3f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2d3f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57892/0 (socket says 172.21.15.164:57892) 2024-09-14T10:57:11.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.400+0000 7fae2d3f6640 1 -- 172.21.15.164:0/320984196 learned_addr learned my addr 172.21.15.164:0/320984196 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.401+0000 7fae2d3f6640 1 -- 172.21.15.164:0/320984196 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95df32e00 con 0x55c95de429b0 2024-09-14T10:57:11.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.401+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/320984196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fae28025a60 tx=0x7fae28051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a10b25b743c93c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.401+0000 7fad1b606640 1 -- 172.21.15.164:0/320984196 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae280589b0 con 0x55c95de429b0 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.401+0000 7fad1b606640 1 -- 172.21.15.164:0/320984196 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae28068070 con 0x55c95de429b0 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.401+0000 7fad1b606640 1 -- 172.21.15.164:0/320984196 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28058c80 con 0x55c95de429b0 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- 172.21.15.164:0/320984196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 msgr2=0x55c95df32810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 --2- 172.21.15.164:0/320984196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fae28025a60 tx=0x7fae28051000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- 172.21.15.164:0/320984196 shutdown_connections 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 --2- 172.21.15.164:0/320984196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95df32810 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- 172.21.15.164:0/320984196 >> 172.21.15.164:0/320984196 conn(0x55c95de3e1a0 msgr2=0x55c95df2e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- 172.21.15.164:0/320984196 shutdown_connections 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- 172.21.15.164:0/320984196 wait complete. 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2f90c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c95de49e80 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.402+0000 7fae2d3f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2d3f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57902/0 (socket says 172.21.15.164:57902) 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2d3f6640 1 -- 172.21.15.164:0/2801310314 learned_addr learned my addr 172.21.15.164:0/2801310314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2d3f6640 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95ddb8bb0 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fae28025a60 tx=0x7fae28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fad19e03640 1 -- 172.21.15.164:0/2801310314 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28063650 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fad19e03640 1 -- 172.21.15.164:0/2801310314 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae280637f0 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c95ddb6f60 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fad19e03640 1 -- 172.21.15.164:0/2801310314 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae28063af0 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.403+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95ddb7580 con 0x55c95de429b0 2024-09-14T10:57:11.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fad19e03640 1 -- 172.21.15.164:0/2801310314 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae28063c90 con 0x55c95de429b0 2024-09-14T10:57:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fad19e03640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 0x7fad1403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fad19e03640 1 -- 172.21.15.164:0/2801310314 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fae28098650 con 0x55c95de429b0 2024-09-14T10:57:11.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 0x7fad1403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 0x55c95df43730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.404+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df43cb0 con 0x55c95de43990 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 0x55c95df43730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 0x7fad1403f320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fae18001d70 tx=0x7fae180012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 0x55c95df43730 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2dbf7640 1 -- 172.21.15.164:0/2801310314 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae200083e0 con 0x55c95de43990 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df44550 con 0x55c95de43990 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2dbf7640 1 -- 172.21.15.164:0/2801310314 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae200083e0 con 0x55c95de43990 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 0x55c95df482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df48a40 con 0x55c95df45e10 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.405+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 0x55c95df482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.406+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 0x55c95df482b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.406+0000 7fae2d3f6640 1 -- 172.21.15.164:0/2801310314 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae280743e0 con 0x55c95df45e10 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.406+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df44da0 con 0x55c95de43990 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.406+0000 7fae2dbf7640 1 -- 172.21.15.164:0/2801310314 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae200083e0 con 0x55c95de43990 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.406+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df45180 con 0x55c95de43990 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2dbf7640 1 -- 172.21.15.164:0/2801310314 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae200083e0 con 0x55c95de43990 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2f90c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2f90c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c95dd394a0 con 0x55c95df574d0 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57910/0 (socket says 172.21.15.164:57910) 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.407+0000 7fae2dbf7640 1 -- 172.21.15.164:0/142981954 learned_addr learned my addr 172.21.15.164:0/142981954 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fae2dbf7640 1 -- 172.21.15.164:0/142981954 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95df57f30 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fae20005fd0 tx=0x7fae2000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fad12ffd640 1 -- 172.21.15.164:0/142981954 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae20007d60 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fad12ffd640 1 -- 172.21.15.164:0/142981954 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2001e020 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c95df58760 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fad12ffd640 1 -- 172.21.15.164:0/142981954 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae20019590 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.408+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95df58d00 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fad12ffd640 1 -- 172.21.15.164:0/142981954 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae20016040 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fad12ffd640 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 0x7fad0403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fad12ffd640 1 -- 172.21.15.164:0/142981954 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fae2001f030 con 0x55c95df574d0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 0x7fad0403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 0x7fad0403f320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55c95ddb7b60 tx=0x7fae28098040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.409+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2f90c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2f90c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c95df33170 con 0x55c95df63f50 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57924/0 (socket says 172.21.15.164:57924) 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1282855702 learned_addr learned my addr 172.21.15.164:0/1282855702 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1282855702 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95df64940 con 0x55c95df63f50 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/1282855702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fae20054330 tx=0x7fae2002af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943c9b9add27af67 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fad10ff9640 1 -- 172.21.15.164:0/1282855702 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae20052030 con 0x55c95df63f50 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fad10ff9640 1 -- 172.21.15.164:0/1282855702 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae20045130 con 0x55c95df63f50 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.410+0000 7fad10ff9640 1 -- 172.21.15.164:0/1282855702 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae2001d070 con 0x55c95df63f50 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- 172.21.15.164:0/1282855702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 msgr2=0x55c95df64350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1282855702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fae20054330 tx=0x7fae2002af50 comp rx=0 tx=0).stop 2024-09-14T10:57:11.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- 172.21.15.164:0/1282855702 shutdown_connections 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1282855702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df64350 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- 172.21.15.164:0/1282855702 >> 172.21.15.164:0/1282855702 conn(0x55c95df60350 msgr2=0x55c95df5e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- 172.21.15.164:0/1282855702 shutdown_connections 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- 172.21.15.164:0/1282855702 wait complete. 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 Processor -- start 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- start start 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df6b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2f90c800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55c95df64f60 con 0x55c95df63f50 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.411+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df6b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2dbf7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df6b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57930/0 (socket says 172.21.15.164:57930) 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 learned_addr learned my addr 172.21.15.164:0/1920382285 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95df6ba90 con 0x55c95df63f50 2024-09-14T10:57:11.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df6b530 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fae200186c0 tx=0x7fae20054290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fad02ffd640 1 -- 172.21.15.164:0/1920382285 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae20052030 con 0x55c95df63f50 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fad02ffd640 1 -- 172.21.15.164:0/1920382285 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae20031020 con 0x55c95df63f50 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c95df6bd20 con 0x55c95df63f50 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fad02ffd640 1 -- 172.21.15.164:0/1920382285 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae2004b040 con 0x55c95df63f50 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.412+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95df6c6a0 con 0x55c95df63f50 2024-09-14T10:57:11.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.413+0000 7fad02ffd640 1 -- 172.21.15.164:0/1920382285 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fae20019730 con 0x55c95df63f50 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.413+0000 7fad02ffd640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7facf803ce10 0x7facf803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.413+0000 7fad02ffd640 1 -- 172.21.15.164:0/1920382285 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fae20032030 con 0x55c95df63f50 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.413+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7facf803ce10 0x7facf803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.413+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7facf803ce10 0x7facf803f2d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae2804ea70 tx=0x7fae28084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95df770a0 0x55c95df79560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df79cb0 con 0x55c95df770a0 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95df770a0 0x55c95df79560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95df770a0 0x55c95df79560 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae18009050 con 0x55c95df770a0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 20 realm 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.414+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df763f0 con 0x55c95df770a0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae18009050 con 0x55c95df770a0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7a7a0 con 0x55c95df770a0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae18009050 con 0x55c95df770a0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7b070 con 0x55c95df770a0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae18009050 con 0x55c95df770a0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df7ba90 0x55c95df7de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7e5c0 con 0x55c95df7ba90 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df7ba90 0x55c95df7de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.415+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df7ba90 0x55c95df7de80 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2f90c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2f90c800 20 searching for the correct realm 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x55c95df7ba90 2024-09-14T10:57:11.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2dbf7640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae20019040 0x7fae20039ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x7fae20019040 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae20019040 0x7fae20039ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.416+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae20019040 0x7fae20039ae0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2d3f6640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae2804f5d0 0x7fae2808f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x7fae2804f5d0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae2804f5d0 0x7fae2808f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2cbf5640 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae2804f5d0 0x7fae2808f180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18009050 con 0x7fae2804f5d0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.417+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x55c95df770a0 2024-09-14T10:57:11.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18009050 con 0x55c95df770a0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x55c95df770a0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x7fae2804f5d0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x7fae2804f5d0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.418+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x7fae20019040 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7feb0 con 0x55c95df7ba90 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae20019040 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.419+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae20019040 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.420+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae2804f5d0 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.421+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae2804f5d0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae20019040 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.422+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x55c95df770a0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae2804f5d0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae2804f5d0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.423+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae20019040 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df7ba90 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae2804f5d0 2024-09-14T10:57:11.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae18029040 con 0x7fae2804f5d0 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x55c95df770a0 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.424+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fae20063040 con 0x7fae20019040 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7ee80 con 0x55c95df770a0 2024-09-14T10:57:11.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7f220 con 0x55c95df770a0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df7f640 con 0x55c95df770a0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 zone default found 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 4 Realm: () 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 zonegroup default 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.425+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df80330 con 0x7fae2804f5d0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df821d0 con 0x55c95df7ba90 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df82570 con 0x55c95df7ba90 2024-09-14T10:57:11.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 started sync module instance, tier type = 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.426+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df81610 con 0x7fae20019040 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.428+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.428+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94323353325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df829b0 con 0x7fae20019040 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.428+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df83200 con 0x55c95df770a0 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.429+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.429+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94323353333344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df83930 con 0x55c95df770a0 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.429+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df84450 con 0x55c95df7ba90 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.430+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94323353325920] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.430+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94323353333344] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.431+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.431+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94323353337632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df84410 con 0x55c95df7ba90 2024-09-14T10:57:11.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.431+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df84cf0 con 0x7fae20019040 2024-09-14T10:57:11.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.432+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94323353337632] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.432+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.432+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94323353339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df84410 con 0x7fae20019040 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.432+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df85780 con 0x55c95df770a0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.433+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.433+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94323353342608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df86020 con 0x55c95df770a0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.433+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df86ae0 con 0x7fae2804f5d0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.435+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.435+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94323353347504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df86aa0 con 0x7fae2804f5d0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.435+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df87a10 con 0x7fae2804f5d0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.436+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94323353339968] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.436+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94323353342608] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.436+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94323353347504] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.437+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.437+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94323353351456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df85b40 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.437+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df87a10 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.437+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94323353351456] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94323353349664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df87a10 con 0x7fae2804f5d0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=0 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=1 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=2 2024-09-14T10:57:11.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=3 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=4 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=5 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.438+0000 7fae2f90c800 20 add_watcher() i=6 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94323353349664] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2f90c800 20 add_watcher() i=7 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2f90c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95df8aef0 con 0x55c95df770a0 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.439+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94323353352720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95df88320 con 0x55c95df770a0 2024-09-14T10:57:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.440+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94323353352720] v37'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.440+0000 7face3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 5 note: GC not initialized 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7face2fe5640 20 reqs_thread_entry: start 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 20 Filter name: none 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7face0fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.441+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbe040 con 0x7fae2804f5d0 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2f90c800 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2f90c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2f90c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2f90c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.445+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfc46e0 con 0x7fae2804f5d0 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2f90c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2f90c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2f90c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94323353600160 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbfcc0 con 0x55c95df770a0 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94323353342608 notify 158913789977 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55c95de44550 con 0x55c95df770a0 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fad10ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 94323353342608 notifier 4891 bl.length()=666 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94323353600160 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fad10ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fad10ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.446+0000 7fad10ff9640 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7facf0003ea0 con 0x55c95df770a0 2024-09-14T10:57:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.447+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.447+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94323353600160 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fae1803abb0 con 0x55c95df770a0 2024-09-14T10:57:11.451 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.448+0000 7face3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.448+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94323353352720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x55c95df770a0 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.449+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94323353352720] v37'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.449+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94323353325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x7fae20019040 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.450+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94323353325920] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.450+0000 7fae2f90c800 20 remove_watcher() i=0 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.450+0000 7fae2f90c800 2 removed watcher, disabling cache 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.450+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94323353333344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x55c95df770a0 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.451+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94323353333344] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.451+0000 7fae2f90c800 20 remove_watcher() i=1 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.451+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94323353337632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x55c95df7ba90 2024-09-14T10:57:11.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.452+0000 7fae2dbf7640 1 -- 172.21.15.164:0/1920382285 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94323353337632] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae2005d040 con 0x55c95df7ba90 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.452+0000 7fae2f90c800 20 remove_watcher() i=2 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.452+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94323353339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x7fae20019040 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.453+0000 7fae2d3f6640 1 -- 172.21.15.164:0/1920382285 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94323353339968] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae280743e0 con 0x7fae20019040 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.453+0000 7fae2f90c800 20 remove_watcher() i=3 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.453+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94323353342608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x55c95df770a0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.454+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94323353342608] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x55c95df770a0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.454+0000 7fae2f90c800 20 remove_watcher() i=4 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.454+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94323353347504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x7fae2804f5d0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.455+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94323353347504] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.455+0000 7fae2f90c800 20 remove_watcher() i=5 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.455+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94323353351456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x7fae2804f5d0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.456+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94323353351456] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.456+0000 7fae2f90c800 20 remove_watcher() i=6 2024-09-14T10:57:11.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.456+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94323353349664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c95dfbbdc0 con 0x7fae2804f5d0 2024-09-14T10:57:11.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94323353349664] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae18039040 con 0x7fae2804f5d0 2024-09-14T10:57:11.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 20 remove_watcher() i=7 2024-09-14T10:57:11.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae2804f5d0 msgr2=0x7fae2808f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fae2804f5d0 0x7fae2808f180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95df770a0 msgr2=0x55c95df79560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95df770a0 0x55c95df79560 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae20019040 msgr2=0x7fae20039ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fae20019040 0x7fae20039ae0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df7ba90 msgr2=0x55c95df7de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df7ba90 0x55c95df7de80 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7facf803ce10 msgr2=0x7facf803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7facf803ce10 0x7facf803f2d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae2804ea70 tx=0x7fae28084000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 msgr2=0x55c95df6b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 --2- 172.21.15.164:0/1920382285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df63f50 0x55c95df6b530 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fae200186c0 tx=0x7fae20054290 comp rx=0 tx=0).stop 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 reap_dead start 2024-09-14T10:57:11.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2cbf5640 1 -- 172.21.15.164:0/1920382285 reap_dead start 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 shutdown_connections 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 >> 172.21.15.164:0/1920382285 conn(0x55c95df60350 msgr2=0x55c95df5e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 shutdown_connections 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.457+0000 7fae2f90c800 1 -- 172.21.15.164:0/1920382285 wait complete. 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 msgr2=0x7fad0403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 0x7fad0403f320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55c95ddb7b60 tx=0x7fae28098040 comp rx=0 tx=0).stop 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 msgr2=0x55c95df578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fae20005fd0 tx=0x7fae2000af20 comp rx=0 tx=0).stop 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 shutdown_connections 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad0403ce60 0x7fad0403f320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/142981954 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95df574d0 0x55c95df578f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 >> 172.21.15.164:0/142981954 conn(0x55c95df4b880 msgr2=0x55c95df4bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 shutdown_connections 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/142981954 wait complete. 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 msgr2=0x55c95df43730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 0x55c95df43730 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 msgr2=0x55c95df482b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 0x55c95df482b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 msgr2=0x7fad1403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 0x7fad1403f320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fae18001d70 tx=0x7fae180012d0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 msgr2=0x55c95ddb8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fae28025a60 tx=0x7fae28003330 comp rx=0 tx=0).stop 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 shutdown_connections 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55c95df45e10 0x55c95df482b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55c95de43990 0x55c95df43730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fad1403ce60 0x7fad1403f320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 --2- 172.21.15.164:0/2801310314 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55c95de429b0 0x55c95ddb8650 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 >> 172.21.15.164:0/2801310314 conn(0x55c95de3e1a0 msgr2=0x55c95df2c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 shutdown_connections 2024-09-14T10:57:11.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.458+0000 7fae2f90c800 1 -- 172.21.15.164:0/2801310314 wait complete. 2024-09-14T10:57:11.464 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.465 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.465 ERROR:root:0 2024-09-14T10:57:11.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:11.469 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:11.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:11.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:11.470 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:57:11.516 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.516 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.519+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.519+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.519+0000 7fe6bbc11800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55af6be8f6f0 0x55af6bf208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.519+0000 7fe6bbc11800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55af6bf24930 con 0x55af6bf20e20 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.519+0000 7fe6bbc11800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55af6bda67d0 con 0x55af6be8f6f0 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.520+0000 7fe6b7392640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55af6be8f6f0 0x55af6bf208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.520+0000 7fe6b7392640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55af6be8f6f0 0x55af6bf208e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57946/0 (socket says 172.21.15.164:57946) 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.520+0000 7fe6b7392640 1 -- 172.21.15.164:0/593240537 learned_addr learned my addr 172.21.15.164:0/593240537 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.520+0000 7fe6b7392640 1 -- 172.21.15.164:0/593240537 >> v1:172.21.15.116:6789/0 conn(0x55af6bf20e20 legacy=0x55af6bf23210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.520+0000 7fe6b7392640 1 -- 172.21.15.164:0/593240537 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6bf25b40 con 0x55af6be8f6f0 2024-09-14T10:57:11.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.522+0000 7fe6b7392640 1 --2- 172.21.15.164:0/593240537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6bf208e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc20a4d7d5cda0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.522+0000 7fe6b6390640 1 -- 172.21.15.164:0/593240537 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a804e600 con 0x55af6be8f6f0 2024-09-14T10:57:11.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.522+0000 7fe6b6390640 1 -- 172.21.15.164:0/593240537 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a804e7a0 con 0x55af6be8f6f0 2024-09-14T10:57:11.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.522+0000 7fe6b6390640 1 -- 172.21.15.164:0/593240537 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a804eaa0 con 0x55af6be8f6f0 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 -- 172.21.15.164:0/593240537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 msgr2=0x55af6bf208e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/593240537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6bf208e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8045cf0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 -- 172.21.15.164:0/593240537 shutdown_connections 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/593240537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6bf208e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 -- 172.21.15.164:0/593240537 >> 172.21.15.164:0/593240537 conn(0x55af6bf15fd0 msgr2=0x55af6bf18410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 -- 172.21.15.164:0/593240537 shutdown_connections 2024-09-14T10:57:11.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.523+0000 7fe6bbc11800 1 -- 172.21.15.164:0/593240537 wait complete. 2024-09-14T10:57:11.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6bbc11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6bbc11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af6bdb3dd0 con 0x55af6be8f6f0 2024-09-14T10:57:11.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6b7392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6b7392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57958/0 (socket says 172.21.15.164:57958) 2024-09-14T10:57:11.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.537+0000 7fe6b7392640 1 -- 172.21.15.164:0/2885003008 learned_addr learned my addr 172.21.15.164:0/2885003008 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.538+0000 7fe6b7392640 1 -- 172.21.15.164:0/2885003008 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6c00dff0 con 0x55af6be8f6f0 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.538+0000 7fe6b7392640 1 --2- 172.21.15.164:0/2885003008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f45ec7c123bdc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.538+0000 7fe5a560a640 1 -- 172.21.15.164:0/2885003008 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a804eb40 con 0x55af6be8f6f0 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.538+0000 7fe5a560a640 1 -- 172.21.15.164:0/2885003008 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a8066070 con 0x55af6be8f6f0 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.538+0000 7fe5a560a640 1 -- 172.21.15.164:0/2885003008 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a804ee50 con 0x55af6be8f6f0 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2885003008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 msgr2=0x55af6c00da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2885003008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8050000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2885003008 shutdown_connections 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2885003008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c00da00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2885003008 >> 172.21.15.164:0/2885003008 conn(0x55af6bf15fd0 msgr2=0x55af6c009380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2885003008 shutdown_connections 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2885003008 wait complete. 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6bbc11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af6bf24e00 con 0x55af6be8f6f0 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.539+0000 7fe6b7392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6b7392640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57968/0 (socket says 172.21.15.164:57968) 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6b7392640 1 -- 172.21.15.164:0/1087592626 learned_addr learned my addr 172.21.15.164:0/1087592626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6b7392640 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6c015930 con 0x55af6be8f6f0 2024-09-14T10:57:11.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6b7392640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe5a3e07640 1 -- 172.21.15.164:0/1087592626 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a806d420 con 0x55af6be8f6f0 2024-09-14T10:57:11.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe5a3e07640 1 -- 172.21.15.164:0/1087592626 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a8071030 con 0x55af6be8f6f0 2024-09-14T10:57:11.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af6c015bc0 con 0x55af6be8f6f0 2024-09-14T10:57:11.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe5a3e07640 1 -- 172.21.15.164:0/1087592626 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6a806d6f0 con 0x55af6be8f6f0 2024-09-14T10:57:11.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.540+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af6c0165c0 con 0x55af6be8f6f0 2024-09-14T10:57:11.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe5a3e07640 1 -- 172.21.15.164:0/1087592626 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe6a806d9a0 con 0x55af6be8f6f0 2024-09-14T10:57:11.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe5a3e07640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 0x7fe59c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe5a3e07640 1 -- 172.21.15.164:0/1087592626 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6a8098ca0 con 0x55af6be8f6f0 2024-09-14T10:57:11.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 0x7fe59c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 0x55af6c01ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.541+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c01cf60 con 0x55af6bf20e20 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 0x55af6c01ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 0x7fe59c03f320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0001e50 tx=0x7fe6a00013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 0x55af6c01ca20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6b7b93640 1 -- 172.21.15.164:0/1087592626 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6bf20e20 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c01d300 con 0x55af6bf20e20 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6b7b93640 1 -- 172.21.15.164:0/1087592626 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6bf20e20 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 0x55af6c021260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.542+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0219f0 con 0x55af6c01edc0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6b7392640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 0x55af6c021260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6b7392640 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 0x55af6c021260 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6b7392640 1 -- 172.21.15.164:0/1087592626 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6a807d070 con 0x55af6c01edc0 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c01db50 con 0x55af6bf20e20 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6b7b93640 1 -- 172.21.15.164:0/1087592626 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6bf20e20 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.543+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c01df30 con 0x55af6bf20e20 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6b7b93640 1 -- 172.21.15.164:0/1087592626 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6bf20e20 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6bbc11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6bbc11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af6be124a0 con 0x55af6c030430 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57970/0 (socket says 172.21.15.164:57970) 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.544+0000 7fe6b7b93640 1 -- 172.21.15.164:0/2162940735 learned_addr learned my addr 172.21.15.164:0/2162940735 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe6b7b93640 1 -- 172.21.15.164:0/2162940735 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6c030e90 con 0x55af6c030430 2024-09-14T10:57:11.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55af6c0172c0 tx=0x7fe6b000af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe5a1602640 1 -- 172.21.15.164:0/2162940735 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0007d60 con 0x55af6c030430 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe5a1602640 1 -- 172.21.15.164:0/2162940735 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b001e020 con 0x55af6c030430 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe5a1602640 1 -- 172.21.15.164:0/2162940735 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0019590 con 0x55af6c030430 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af6c0316c0 con 0x55af6c030430 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.545+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af6c031c60 con 0x55af6c030430 2024-09-14T10:57:11.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe5a1602640 1 -- 172.21.15.164:0/2162940735 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe6b0016040 con 0x55af6c030430 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe5a1602640 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 0x7fe59003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe5a1602640 1 -- 172.21.15.164:0/2162940735 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6b001f030 con 0x55af6c030430 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6b7392640 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 0x7fe59003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6b7392640 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 0x7fe59003f320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55af6c0174a0 tx=0x7fe6a806b940 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6bbc11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.546+0000 7fe6bbc11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af6c00e360 con 0x55af6c03cef0 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57972/0 (socket says 172.21.15.164:57972) 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe6b7b93640 1 -- 172.21.15.164:0/2963446843 learned_addr learned my addr 172.21.15.164:0/2963446843 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe6b7b93640 1 -- 172.21.15.164:0/2963446843 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6c03d8e0 con 0x55af6c03cef0 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/2963446843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00543d0 tx=0x7fe6b0018680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aab44e959efd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe59affd640 1 -- 172.21.15.164:0/2963446843 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b001d040 con 0x55af6c03cef0 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe59affd640 1 -- 172.21.15.164:0/2963446843 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b004b070 con 0x55af6c03cef0 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.547+0000 7fe59affd640 1 -- 172.21.15.164:0/2963446843 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0017c30 con 0x55af6c03cef0 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2963446843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 msgr2=0x55af6c03d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2963446843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00543d0 tx=0x7fe6b0018680 comp rx=0 tx=0).stop 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2963446843 shutdown_connections 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2963446843 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c03d2f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2963446843 >> 172.21.15.164:0/2963446843 conn(0x55af6c0392f0 msgr2=0x55af6c037530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2963446843 shutdown_connections 2024-09-14T10:57:11.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2963446843 wait complete. 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 Processor -- start 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- start start 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6bbc11800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55af6c03df00 con 0x55af6c03cef0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6b7b93640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57986/0 (socket says 172.21.15.164:57986) 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.548+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 learned_addr learned my addr 172.21.15.164:0/743143337 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6c044a50 con 0x55af6c03cef0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0007fd0 tx=0x7fe6b0054360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe5997fa640 1 -- 172.21.15.164:0/743143337 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b001d070 con 0x55af6c03cef0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe5997fa640 1 -- 172.21.15.164:0/743143337 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b00176f0 con 0x55af6c03cef0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af6c044ce0 con 0x55af6c03cef0 2024-09-14T10:57:11.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe5997fa640 1 -- 172.21.15.164:0/743143337 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0019730 con 0x55af6c03cef0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.549+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af6c045870 con 0x55af6c03cef0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.550+0000 7fe5997fa640 1 -- 172.21.15.164:0/743143337 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe6b00198d0 con 0x55af6c03cef0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.550+0000 7fe5997fa640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe58003ce60 0x7fe58003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.550+0000 7fe5997fa640 1 -- 172.21.15.164:0/743143337 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe6b0033030 con 0x55af6c03cef0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.550+0000 7fe6b7392640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe58003ce60 0x7fe58003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.550+0000 7fe6b7392640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe58003ce60 0x7fe58003f320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8061fd0 tx=0x7fe6a8089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6c050090 0x55af6c052550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c052ca0 con 0x55af6c050090 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6c050090 0x55af6c052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6c050090 0x55af6c052550 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a0010580 con 0x55af6c050090 2024-09-14T10:57:11.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 realm 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c04f3e0 con 0x55af6c050090 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a0010580 con 0x55af6c050090 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.551+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c053790 con 0x55af6c050090 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a0010580 con 0x55af6c050090 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c054060 con 0x55af6c050090 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6a0010580 con 0x55af6c050090 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c054a80 0x55af6c056e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0575b0 con 0x55af6c054a80 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c054a80 0x55af6c056e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c054a80 0x55af6c056e70 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6c054a80 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.552+0000 7fe6bbc11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6bbc11800 20 searching for the correct realm 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6c054a80 2024-09-14T10:57:11.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7b93640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe6b0019040 0x7fe6b0023410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7392640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe6b0019040 0x7fe6b0023410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7392640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe6b0019040 0x7fe6b0023410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7392640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe6a80a5040 0x7fe6a806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.553+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.554+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe6a80a5040 0x7fe6a806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.554+0000 7fe6b6b91640 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe6a80a5040 0x7fe6a806a890 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.554+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0010580 con 0x7fe6a80a5040 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.554+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a0010580 con 0x55af6c050090 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.555+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6c054a80 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.556+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b00083e0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.557+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.558+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.559+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.560+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c054a80 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x55af6c050090 2024-09-14T10:57:11.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058ec0 con 0x7fe6b0019040 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.561+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c057fa0 con 0x55af6c050090 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c058840 con 0x55af6c050090 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c059340 con 0x55af6c050090 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 zone default found 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 4 Realm: () 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 zonegroup default 2024-09-14T10:57:11.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0596e0 con 0x7fe6a80a5040 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.562+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05b4c0 con 0x55af6c054a80 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05b9a0 con 0x55af6c054a80 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 20 started sync module instance, tier type = 2024-09-14T10:57:11.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.563+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05a960 con 0x7fe6b0019040 2024-09-14T10:57:11.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.564+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.564+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94211919946928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05be00 con 0x7fe6b0019040 2024-09-14T10:57:11.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.564+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05c650 con 0x55af6c050090 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.565+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94211919946928] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.565+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.565+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94211919949136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05c730 con 0x55af6c050090 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.565+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05d250 con 0x55af6c054a80 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.566+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94211919949136] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.566+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.566+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94211919957280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05d210 con 0x55af6c054a80 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.566+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05dcd0 con 0x7fe6b0019040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.567+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94211919957280] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.567+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.567+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94211919960032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05e0c0 con 0x7fe6b0019040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.567+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05eb20 con 0x55af6c050090 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.569+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.569+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94211919963648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05f3c0 con 0x55af6c050090 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.569+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05fea0 con 0x7fe6a80a5040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.570+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94211919960032] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.570+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94211919963648] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.571+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.571+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94211919968688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05ee40 con 0x7fe6a80a5040 2024-09-14T10:57:11.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.571+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c060740 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.573+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94211919968688] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.573+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.573+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94211919954336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c05ee40 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.573+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c060d20 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94211919954336] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94211919972368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c060ce0 con 0x7fe6a80a5040 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=0 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=1 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=2 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=3 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=4 2024-09-14T10:57:11.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=5 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.574+0000 7fe6bbc11800 20 add_watcher() i=6 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.575+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94211919972368] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.575+0000 7fe6bbc11800 20 add_watcher() i=7 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.575+0000 7fe6bbc11800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.575+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0641a0 con 0x55af6c050090 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.576+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.576+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94211919970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0616c0 con 0x55af6c050090 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94211919970624] v37'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe56dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6bbc11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6bbc11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6bbc11800 5 note: GC not initialized 2024-09-14T10:57:11.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe56cfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6bbc11800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.577+0000 7fe6bbc11800 20 Filter name: none 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.578+0000 7fe4e67fc640 20 reqs_thread_entry: start 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.578+0000 7fe6bbc11800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.578+0000 7fe6bbc11800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.578+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0974f0 con 0x7fe6a80a5040 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6bbc11800 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6bbc11800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6bbc11800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6bbc11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.581+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c09db00 con 0x7fe6a80a5040 2024-09-14T10:57:11.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.582+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v37'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.582+0000 7fe6bbc11800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.582+0000 7fe6bbc11800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.582+0000 7fe6bbc11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.582+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94211920221376 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0990e0 con 0x55af6c050090 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94211919963648 notify 158913789978 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55af6bf24930 con 0x55af6c050090 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94211920221376 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe59affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 94211919963648 notifier 4898 bl.length()=679 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe59affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe59affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe59affd640 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe57c003ea0 con 0x55af6c050090 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.583+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94211920221376 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe6a003bbc0 con 0x55af6c050090 2024-09-14T10:57:11.587 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.584+0000 7fe56dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.584+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94211919970624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x55af6c050090 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.585+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94211919970624] v37'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.585+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94211919946928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x7fe6b0019040 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.586+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94211919946928] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.586+0000 7fe6bbc11800 20 remove_watcher() i=0 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.586+0000 7fe6bbc11800 2 removed watcher, disabling cache 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.586+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94211919949136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x55af6c050090 2024-09-14T10:57:11.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.587+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94211919949136] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.587+0000 7fe6bbc11800 20 remove_watcher() i=1 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.587+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94211919957280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x55af6c054a80 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.588+0000 7fe6b7b93640 1 -- 172.21.15.164:0/743143337 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94211919957280] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b0067040 con 0x55af6c054a80 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.588+0000 7fe6bbc11800 20 remove_watcher() i=2 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.588+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94211919960032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x7fe6b0019040 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.589+0000 7fe6b7392640 1 -- 172.21.15.164:0/743143337 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94211919960032] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a807d070 con 0x7fe6b0019040 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.589+0000 7fe6bbc11800 20 remove_watcher() i=3 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.589+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94211919963648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x55af6c050090 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.590+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94211919963648] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x55af6c050090 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.590+0000 7fe6bbc11800 20 remove_watcher() i=4 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.590+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94211919968688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x7fe6a80a5040 2024-09-14T10:57:11.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.591+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94211919968688] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.591+0000 7fe6bbc11800 20 remove_watcher() i=5 2024-09-14T10:57:11.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.591+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94211919954336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x7fe6a80a5040 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.592+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94211919954336] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.592+0000 7fe6bbc11800 20 remove_watcher() i=6 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.592+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94211919972368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55af6c0952d0 con 0x7fe6a80a5040 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94211919972368] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002a040 con 0x7fe6a80a5040 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 20 remove_watcher() i=7 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe6a80a5040 msgr2=0x7fe6a806a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fe6a80a5040 0x7fe6a806a890 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6c050090 msgr2=0x55af6c052550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6c050090 0x55af6c052550 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe6b0019040 msgr2=0x7fe6b0023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fe6b0019040 0x7fe6b0023410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c054a80 msgr2=0x55af6c056e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c054a80 0x55af6c056e70 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe58003ce60 msgr2=0x7fe58003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe58003ce60 0x7fe58003f320 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8061fd0 tx=0x7fe6a8089000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 msgr2=0x55af6c0444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6b6b91640 1 -- 172.21.15.164:0/743143337 reap_dead start 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.593+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0007fd0 tx=0x7fe6b0054360 comp rx=0 tx=0).stop 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 shutdown_connections 2024-09-14T10:57:11.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/743143337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c03cef0 0x55af6c0444f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 >> 172.21.15.164:0/743143337 conn(0x55af6c0392f0 msgr2=0x55af6c037500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 shutdown_connections 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/743143337 wait complete. 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 msgr2=0x7fe59003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 0x7fe59003f320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55af6c0174a0 tx=0x7fe6a806b940 comp rx=0 tx=0).stop 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 msgr2=0x55af6c030850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55af6c0172c0 tx=0x7fe6b000af20 comp rx=0 tx=0).stop 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 shutdown_connections 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59003ce60 0x7fe59003f320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/2162940735 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6c030430 0x55af6c030850 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 >> 172.21.15.164:0/2162940735 conn(0x55af6c0247e0 msgr2=0x55af6c024bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 shutdown_connections 2024-09-14T10:57:11.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/2162940735 wait complete. 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 msgr2=0x55af6c01ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 0x55af6c01ca20 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 msgr2=0x55af6c021260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 0x55af6c021260 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.594+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 msgr2=0x7fe59c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 0x7fe59c03f320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0001e50 tx=0x7fe6a00013d0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 msgr2=0x55af6c0153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a8003330 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 shutdown_connections 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55af6c01edc0 0x55af6c021260 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55af6bf20e20 0x55af6c01ca20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe59c03ce60 0x7fe59c03f320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 --2- 172.21.15.164:0/1087592626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55af6be8f6f0 0x55af6c0153d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 >> 172.21.15.164:0/1087592626 conn(0x55af6bf15fd0 msgr2=0x55af6c00edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 shutdown_connections 2024-09-14T10:57:11.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.595+0000 7fe6bbc11800 1 -- 172.21.15.164:0/1087592626 wait complete. 2024-09-14T10:57:11.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.601 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.601 ERROR:root:0 2024-09-14T10:57:11.601 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:11.606 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:11.606 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-14T10:57:11.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-14T10:57:11.606 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-14T10:57:11.653 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.653 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04a2330800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x565150ff3c20 0x565150ff6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04a2330800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565150ff66b0 con 0x565150fef9b0 2024-09-14T10:57:11.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04a2330800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x565150e7a7d0 con 0x565150ff3c20 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04958af640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x565150ff3c20 0x565150ff6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04958af640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x565150ff3c20 0x565150ff6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:57996/0 (socket says 172.21.15.164:57996) 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f049e0b0640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x565150fef9b0 0x565150fefdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58398/0 (socket says 172.21.15.164:58398) 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.656+0000 7f04958af640 1 -- 172.21.15.164:0/4102250997 learned_addr learned my addr 172.21.15.164:0/4102250997 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.657+0000 7f04958af640 1 -- 172.21.15.164:0/4102250997 >> v1:172.21.15.116:6789/0 conn(0x565150fef9b0 legacy=0x565150fefdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.657+0000 7f049d8af640 1 -- 172.21.15.164:0/4102250997 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679247620 0 0) 0x565150ff66b0 con 0x565150fef9b0 2024-09-14T10:57:11.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.657+0000 7f04958af640 1 -- 172.21.15.164:0/4102250997 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565150ff78e0 con 0x565150ff3c20 2024-09-14T10:57:11.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.658+0000 7f04958af640 1 --2- 172.21.15.164:0/4102250997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150ff3c20 0x565150ff6030 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f048800a520 tx=0x7f0488045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7266e084b6a2b30a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.658+0000 7f049d8af640 1 -- 172.21.15.164:0/4102250997 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488055070 con 0x565150ff3c20 2024-09-14T10:57:11.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f049d8af640 1 -- 172.21.15.164:0/4102250997 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04880515b0 con 0x565150ff3c20 2024-09-14T10:57:11.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f049d8af640 1 -- 172.21.15.164:0/4102250997 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04880518d0 con 0x565150ff3c20 2024-09-14T10:57:11.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 -- 172.21.15.164:0/4102250997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150ff3c20 msgr2=0x565150ff6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 --2- 172.21.15.164:0/4102250997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150ff3c20 0x565150ff6030 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f048800a520 tx=0x7f0488045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 -- 172.21.15.164:0/4102250997 shutdown_connections 2024-09-14T10:57:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 --2- 172.21.15.164:0/4102250997 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150ff3c20 0x565150ff6030 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 -- 172.21.15.164:0/4102250997 >> 172.21.15.164:0/4102250997 conn(0x565150feb1a0 msgr2=0x565150fed600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 -- 172.21.15.164:0/4102250997 shutdown_connections 2024-09-14T10:57:11.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.659+0000 7f04a2330800 1 -- 172.21.15.164:0/4102250997 wait complete. 2024-09-14T10:57:11.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.673+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.673+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.673+0000 7f04a2330800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.673+0000 7f04a2330800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565150e87dd0 con 0x565150fef9b0 2024-09-14T10:57:11.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f049e0b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f049e0b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58008/0 (socket says 172.21.15.164:58008) 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f049e0b0640 1 -- 172.21.15.164:0/2723521888 learned_addr learned my addr 172.21.15.164:0/2723521888 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f049e0b0640 1 -- 172.21.15.164:0/2723521888 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565150f65cb0 con 0x565150fef9b0 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f049e0b0640 1 --2- 172.21.15.164:0/2723521888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0490001ea0 tx=0x7f049000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5335af4d063a6f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f038c608640 1 -- 172.21.15.164:0/2723521888 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490008070 con 0x565150fef9b0 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f038c608640 1 -- 172.21.15.164:0/2723521888 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049000d500 con 0x565150fef9b0 2024-09-14T10:57:11.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.674+0000 7f038c608640 1 -- 172.21.15.164:0/2723521888 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049000d880 con 0x565150fef9b0 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 -- 172.21.15.164:0/2723521888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 msgr2=0x565150f656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 --2- 172.21.15.164:0/2723521888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0490001ea0 tx=0x7f049000b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 -- 172.21.15.164:0/2723521888 shutdown_connections 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 --2- 172.21.15.164:0/2723521888 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x565150f656c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 -- 172.21.15.164:0/2723521888 >> 172.21.15.164:0/2723521888 conn(0x565150feb1a0 msgr2=0x5651510daf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 -- 172.21.15.164:0/2723521888 shutdown_connections 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 -- 172.21.15.164:0/2723521888 wait complete. 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.675+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f04a2330800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f04a2330800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565150ff6b80 con 0x565150fef9b0 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f049e0b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f049e0b0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58022/0 (socket says 172.21.15.164:58022) 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f049e0b0640 1 -- 172.21.15.164:0/3575654580 learned_addr learned my addr 172.21.15.164:0/3575654580 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f049e0b0640 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651510e9840 con 0x565150fef9b0 2024-09-14T10:57:11.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f04900012f0 tx=0x7f0490000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f038ae05640 1 -- 172.21.15.164:0/3575654580 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049000f9d0 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f038ae05640 1 -- 172.21.15.164:0/3575654580 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049000fb70 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f038ae05640 1 -- 172.21.15.164:0/3575654580 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049000fe50 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651510e9ad0 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.676+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651510ea4d0 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.677+0000 7f038ae05640 1 -- 172.21.15.164:0/3575654580 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0490017040 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.677+0000 7f038ae05640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 0x7f038403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f038ae05640 1 -- 172.21.15.164:0/3575654580 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0490015020 con 0x565150fef9b0 2024-09-14T10:57:11.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f04958af640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 0x7f038403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 0x5651510f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651510f0e70 con 0x565150ff3c20 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 0x5651510f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f04958af640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 0x7f038403f470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0488057000 tx=0x7f0488052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 0x5651510f0930 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f049e8b1640 1 -- 172.21.15.164:0/3575654580 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f049800a4d0 con 0x565150ff3c20 2024-09-14T10:57:11.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.678+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651510f1210 con 0x565150ff3c20 2024-09-14T10:57:11.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f049e8b1640 1 -- 172.21.15.164:0/3575654580 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f049800a4d0 con 0x565150ff3c20 2024-09-14T10:57:11.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 0x5651510f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651510f58d0 con 0x5651510f2cd0 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 0x5651510f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 0x5651510f5140 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f049e0b0640 1 -- 172.21.15.164:0/3575654580 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f049002d070 con 0x5651510f2cd0 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.679+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651510f1a60 con 0x565150ff3c20 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f049e8b1640 1 -- 172.21.15.164:0/3575654580 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f049800a4d0 con 0x565150ff3c20 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651510f1e40 con 0x565150ff3c20 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f049e8b1640 1 -- 172.21.15.164:0/3575654580 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f049800a4d0 con 0x565150ff3c20 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f04a2330800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.680+0000 7f04a2330800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565150ee64a0 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58036/0 (socket says 172.21.15.164:58036) 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f049e8b1640 1 -- 172.21.15.164:0/3580687758 learned_addr learned my addr 172.21.15.164:0/3580687758 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f049e8b1640 1 -- 172.21.15.164:0/3580687758 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565151104d40 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x5651510ea2e0 tx=0x7f0498018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f0383fff640 1 -- 172.21.15.164:0/3580687758 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498014450 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f0383fff640 1 -- 172.21.15.164:0/3580687758 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498014610 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565151105570 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f0383fff640 1 -- 172.21.15.164:0/3580687758 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0498014930 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.681+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565151105b10 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.682+0000 7f0383fff640 1 -- 172.21.15.164:0/3580687758 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0498011040 con 0x5651511042e0 2024-09-14T10:57:11.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.682+0000 7f0383fff640 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 0x7f037803f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.682+0000 7f0383fff640 1 -- 172.21.15.164:0/3580687758 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f049801e070 con 0x5651511042e0 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.682+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 0x7f037803f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.682+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 0x7f037803f320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5651510eb380 tx=0x7f049001bf60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f04a2330800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f04a2330800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565150f64110 con 0x565151110d60 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58048/0 (socket says 172.21.15.164:58048) 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e8b1640 1 -- 172.21.15.164:0/39854265 learned_addr learned my addr 172.21.15.164:0/39854265 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e8b1640 1 -- 172.21.15.164:0/39854265 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565151111730 con 0x565151110d60 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f049e8b1640 1 --2- 172.21.15.164:0/39854265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0498018430 tx=0x7f0498014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f4e38e153bc72b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.693 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f0381ffb640 1 -- 172.21.15.164:0/39854265 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049804b070 con 0x565151110d60 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f0381ffb640 1 -- 172.21.15.164:0/39854265 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498051070 con 0x565151110d60 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.683+0000 7f0381ffb640 1 -- 172.21.15.164:0/39854265 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04980167c0 con 0x565151110d60 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- 172.21.15.164:0/39854265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 msgr2=0x565151111140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 --2- 172.21.15.164:0/39854265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0498018430 tx=0x7f0498014ea0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- 172.21.15.164:0/39854265 shutdown_connections 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 --2- 172.21.15.164:0/39854265 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151111140 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- 172.21.15.164:0/39854265 >> 172.21.15.164:0/39854265 conn(0x56515110d160 msgr2=0x56515110b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- 172.21.15.164:0/39854265 shutdown_connections 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- 172.21.15.164:0/39854265 wait complete. 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 Processor -- start 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- start start 2024-09-14T10:57:11.694 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.684+0000 7f04a2330800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x565151111d70 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f049e8b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58054/0 (socket says 172.21.15.164:58054) 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 learned_addr learned my addr 172.21.15.164:0/3430837125 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651511188b0 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f049802bfd0 tx=0x7f04980544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f036ffff640 1 -- 172.21.15.164:0/3430837125 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049804b040 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f036ffff640 1 -- 172.21.15.164:0/3430837125 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0498031030 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565151118b40 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f036ffff640 1 -- 172.21.15.164:0/3430837125 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04980167c0 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.685+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651511194c0 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.686+0000 7f036ffff640 1 -- 172.21.15.164:0/3430837125 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0498045720 con 0x565151110d60 2024-09-14T10:57:11.695 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.686+0000 7f036ffff640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f036803ce10 0x7f036803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.686+0000 7f036ffff640 1 -- 172.21.15.164:0/3430837125 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f049800e040 con 0x565151110d60 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.686+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f036803ce10 0x7f036803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.686+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f036803ce10 0x7f036803f2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f049001bfd0 tx=0x7f0490039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5651511240c0 0x565151126580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565151126cd0 con 0x5651511240c0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04958af640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5651511240c0 0x565151126580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04958af640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5651511240c0 0x565151126580 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 20 realm 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.687+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565151127100 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5651511279d0 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565151127d70 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x565151128ad0 0x56515112aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112b4d0 con 0x565151128ad0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.688+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x565151128ad0 0x56515112aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x565151128ad0 0x56515112aec0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f049803e070 con 0x565151128ad0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f04a2330800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f04a2330800 20 searching for the correct realm 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f049803e070 con 0x565151128ad0 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e8b1640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0498059040 0x7f04980363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.689+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0498059040 0x7f04980363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0498059040 0x7f04980363e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049002d070 con 0x7f0498059040 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f049e0b0640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f04900183d0 0x7f049002e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f04958af640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f04900183d0 0x7f049002e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.690+0000 7f04958af640 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f04900183d0 0x7f049002e550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.691+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049002d070 con 0x7f0498059040 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049803e070 con 0x565151128ad0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049002d070 con 0x7f0498059040 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.692+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f049002d070 con 0x7f0498059040 2024-09-14T10:57:11.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049803e070 con 0x565151128ad0 2024-09-14T10:57:11.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049803e070 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.693+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.694+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049002d070 con 0x7f0498059040 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.695+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x5651511240c0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0488057030 con 0x7f04900183d0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.696+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x565151128ad0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f04900183d0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x5651511240c0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.697+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56515112cdc0 con 0x7f0498059040 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112be90 con 0x5651511240c0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112c6e0 con 0x5651511240c0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112d240 con 0x5651511240c0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 zone default found 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 4 Realm: () 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 zonegroup default 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.698+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112d5e0 con 0x7f04900183d0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112f3c0 con 0x565151128ad0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515112f8d0 con 0x565151128ad0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 started sync module instance, tier type = 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.699+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112e860 con 0x7f0498059040 2024-09-14T10:57:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.700+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.700+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907252534352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511301e0 con 0x7f0498059040 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.700+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151130a30 con 0x5651511240c0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.701+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907252534352] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.701+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.702+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907252538672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151130a70 con 0x5651511240c0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.702+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151131580 con 0x565151128ad0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.703+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907252538672] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.703+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.703+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907252543536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151131540 con 0x565151128ad0 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.703+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151132010 con 0x7f0498059040 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.704+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.704+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907252546368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511328e0 con 0x7f0498059040 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.704+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511333b0 con 0x5651511240c0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.704+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907252543536] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.705+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907252546368] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.705+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.705+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907252548656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151132e70 con 0x5651511240c0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.705+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151133dc0 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.706+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.706+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907252548656] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.706+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907252554000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511341e0 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.706+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151130580 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.707+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907252554000] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.707+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.707+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907252555056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151134150 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.707+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511350d0 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(58 notify.7 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907252555056] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907252558752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151135540 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=1 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=2 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=3 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=4 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=5 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.708+0000 7f04a2330800 20 add_watcher() i=6 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.709+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907252558752] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.709+0000 7f04a2330800 20 add_watcher() i=7 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.709+0000 7f04a2330800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.709+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565151135540 con 0x5651511240c0 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.710+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.710+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907252560016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511354b0 con 0x5651511240c0 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907252560016] v37'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f0354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 5 note: GC not initialized 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f02cf7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 20 Filter name: none 2024-09-14T10:57:11.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f02cd7fa640 20 reqs_thread_entry: start 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.711+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515116b840 con 0x7f04900183d0 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04a2330800 20 rados_obj.operate() r=0 bl.length=503 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04a2330800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04a2330800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04a2330800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.712+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511720d0 con 0x7f04900183d0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04a2330800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04a2330800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04a2330800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94907252808368 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56515116d770 con 0x5651511240c0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94907252548656 notify 158913789979 ret 0) ==== 678+0+0 (crc 0 0 0) 0x565150ff78e0 con 0x5651511240c0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f0381ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789979 cookie 94907252548656 notifier 4905 bl.length()=636 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94907252808368 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f0381ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f0381ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f0381ffb640 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f0364003ea0 con 0x5651511240c0 2024-09-14T10:57:11.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.714+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94907252808368 notify 158913789979 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f048806a430 con 0x5651511240c0 2024-09-14T10:57:11.726 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.715+0000 7f0354fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.715+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907252560016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511695b0 con 0x5651511240c0 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.716+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94907252560016] v37'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.716+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907252534352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5651511695b0 con 0x7f0498059040 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.717+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94907252534352] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.717+0000 7f04a2330800 20 remove_watcher() i=0 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.717+0000 7f04a2330800 2 removed watcher, disabling cache 2024-09-14T10:57:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.717+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907252538672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112ec50 con 0x5651511240c0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.718+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94907252538672] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.718+0000 7f04a2330800 20 remove_watcher() i=1 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.718+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907252543536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112ec50 con 0x565151128ad0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.719+0000 7f049e8b1640 1 -- 172.21.15.164:0/3430837125 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94907252543536] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498066040 con 0x565151128ad0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.719+0000 7f04a2330800 20 remove_watcher() i=2 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.719+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907252546368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112ec50 con 0x7f0498059040 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.720+0000 7f049e0b0640 1 -- 172.21.15.164:0/3430837125 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94907252546368] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0490063040 con 0x7f0498059040 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.720+0000 7f04a2330800 20 remove_watcher() i=3 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.720+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907252548656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112ec50 con 0x5651511240c0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.721+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94907252548656] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x5651511240c0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.721+0000 7f04a2330800 20 remove_watcher() i=4 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.721+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907252554000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151132430 con 0x7f04900183d0 2024-09-14T10:57:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.722+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94907252554000] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.722+0000 7f04a2330800 20 remove_watcher() i=5 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.722+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907252555056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565151133910 con 0x7f04900183d0 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.723+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94907252555056] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.723+0000 7f04a2330800 20 remove_watcher() i=6 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.723+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907252558752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56515112fd30 con 0x7f04900183d0 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.724+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94907252558752] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807f040 con 0x7f04900183d0 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.724+0000 7f04a2330800 20 remove_watcher() i=7 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f04900183d0 msgr2=0x7f049002e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f04900183d0 0x7f049002e550 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5651511240c0 msgr2=0x565151126580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5651511240c0 0x565151126580 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0498059040 msgr2=0x7f04980363e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f0498059040 0x7f04980363e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x565151128ad0 msgr2=0x56515112aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x565151128ad0 0x56515112aec0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f036803ce10 msgr2=0x7f036803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f036803ce10 0x7f036803f2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f049001bfd0 tx=0x7f0490039000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 msgr2=0x565151118350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04958af640 1 -- 172.21.15.164:0/3430837125 reap_dead start 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f049802bfd0 tx=0x7f04980544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 shutdown_connections 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3430837125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565151110d60 0x565151118350 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 >> 172.21.15.164:0/3430837125 conn(0x56515110d160 msgr2=0x56515110b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 shutdown_connections 2024-09-14T10:57:11.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3430837125 wait complete. 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 msgr2=0x7f037803f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 0x7f037803f320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5651510eb380 tx=0x7f049001bf60 comp rx=0 tx=0).stop 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 msgr2=0x565151104700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x5651510ea2e0 tx=0x7f0498018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 shutdown_connections 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f037803ce60 0x7f037803f320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 --2- 172.21.15.164:0/3580687758 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5651511042e0 0x565151104700 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 >> 172.21.15.164:0/3580687758 conn(0x5651510f8690 msgr2=0x5651510f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 shutdown_connections 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.725+0000 7f04a2330800 1 -- 172.21.15.164:0/3580687758 wait complete. 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 msgr2=0x5651510f0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 0x5651510f0930 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 msgr2=0x5651510f5140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 0x5651510f5140 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 msgr2=0x7f038403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 0x7f038403f470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0488057000 tx=0x7f0488052000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 msgr2=0x5651510e92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f04900012f0 tx=0x7f0490000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 shutdown_connections 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5651510f2cd0 0x5651510f5140 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x565150ff3c20 0x5651510f0930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f038403cfb0 0x7f038403f470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 --2- 172.21.15.164:0/3575654580 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565150fef9b0 0x5651510e92e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 >> 172.21.15.164:0/3575654580 conn(0x565150feb1a0 msgr2=0x5651510daab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 shutdown_connections 2024-09-14T10:57:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.726+0000 7f04a2330800 1 -- 172.21.15.164:0/3575654580 wait complete. 2024-09-14T10:57:11.737 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.738 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.738 ERROR:root:0 2024-09-14T10:57:11.738 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:57:11.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:57:11.738 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-14T10:57:11.785 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.785 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f940e414800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5623bb808fc0 0x5623bb80b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f940e414800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623bb80b980 con 0x5623bb776730 2024-09-14T10:57:11.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f940e414800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x5623bb68d7d0 con 0x5623bb808fc0 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f94092ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5623bb808fc0 0x5623bb80b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f94092ca640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x5623bb808fc0 0x5623bb80b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58060/0 (socket says 172.21.15.164:58060) 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f94092ca640 1 -- 172.21.15.164:0/2865632560 learned_addr learned my addr 172.21.15.164:0/2865632560 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.788+0000 7f9409acb640 1 --1- 172.21.15.164:0/2865632560 >> v1:172.21.15.116:6789/0 conn(0x5623bb776730 0x5623bb8078a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58404/0 (socket says 172.21.15.164:58404) 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.789+0000 7f94092ca640 1 -- 172.21.15.164:0/2865632560 >> v1:172.21.15.116:6789/0 conn(0x5623bb776730 legacy=0x5623bb8078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.789+0000 7f9408ac9640 1 -- 172.21.15.164:0/2865632560 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543694144 0 0) 0x5623bb80b980 con 0x5623bb776730 2024-09-14T10:57:11.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.789+0000 7f94092ca640 1 -- 172.21.15.164:0/2865632560 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb80cb60 con 0x5623bb808fc0 2024-09-14T10:57:11.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.790+0000 7f94092ca640 1 --2- 172.21.15.164:0/2865632560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb808fc0 0x5623bb80b3b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f93f400a520 tx=0x7f93f4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b82a34aed53449c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f9408ac9640 1 -- 172.21.15.164:0/2865632560 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f4055070 con 0x5623bb808fc0 2024-09-14T10:57:11.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f9408ac9640 1 -- 172.21.15.164:0/2865632560 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f40515b0 con 0x5623bb808fc0 2024-09-14T10:57:11.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f9408ac9640 1 -- 172.21.15.164:0/2865632560 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f40518d0 con 0x5623bb808fc0 2024-09-14T10:57:11.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 -- 172.21.15.164:0/2865632560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb808fc0 msgr2=0x5623bb80b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 --2- 172.21.15.164:0/2865632560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb808fc0 0x5623bb80b3b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f93f400a520 tx=0x7f93f4045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 -- 172.21.15.164:0/2865632560 shutdown_connections 2024-09-14T10:57:11.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 --2- 172.21.15.164:0/2865632560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb808fc0 0x5623bb80b3b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 -- 172.21.15.164:0/2865632560 >> 172.21.15.164:0/2865632560 conn(0x5623bb7fcfd0 msgr2=0x5623bb7ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 -- 172.21.15.164:0/2865632560 shutdown_connections 2024-09-14T10:57:11.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.791+0000 7f940e414800 1 -- 172.21.15.164:0/2865632560 wait complete. 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f940e414800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f940e414800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5623bb69add0 con 0x5623bb776730 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f9409acb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.805+0000 7f9409acb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58068/0 (socket says 172.21.15.164:58068) 2024-09-14T10:57:11.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f9409acb640 1 -- 172.21.15.164:0/2604690178 learned_addr learned my addr 172.21.15.164:0/2604690178 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f9409acb640 1 -- 172.21.15.164:0/2604690178 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb8f4e60 con 0x5623bb776730 2024-09-14T10:57:11.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f9409acb640 1 --2- 172.21.15.164:0/2604690178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9404001ea0 tx=0x7f940400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40937fb22525501 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f92f7e07640 1 -- 172.21.15.164:0/2604690178 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9404008070 con 0x5623bb776730 2024-09-14T10:57:11.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f92f7e07640 1 -- 172.21.15.164:0/2604690178 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940400d500 con 0x5623bb776730 2024-09-14T10:57:11.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.806+0000 7f92f7e07640 1 -- 172.21.15.164:0/2604690178 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f940400d880 con 0x5623bb776730 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- 172.21.15.164:0/2604690178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 msgr2=0x5623bb8f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 --2- 172.21.15.164:0/2604690178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9404001ea0 tx=0x7f940400b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- 172.21.15.164:0/2604690178 shutdown_connections 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 --2- 172.21.15.164:0/2604690178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8f4870 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- 172.21.15.164:0/2604690178 >> 172.21.15.164:0/2604690178 conn(0x5623bb7fcfd0 msgr2=0x5623bb8f01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- 172.21.15.164:0/2604690178 shutdown_connections 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- 172.21.15.164:0/2604690178 wait complete. 2024-09-14T10:57:11.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.807+0000 7f940e414800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5623bb80be50 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f9409acb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f9409acb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58084/0 (socket says 172.21.15.164:58084) 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f9409acb640 1 -- 172.21.15.164:0/2123710973 learned_addr learned my addr 172.21.15.164:0/2123710973 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f9409acb640 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb8fc8b0 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f9409acb640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f94040012f0 tx=0x7f9404000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f92f6604640 1 -- 172.21.15.164:0/2123710973 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f940400f9d0 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f92f6604640 1 -- 172.21.15.164:0/2123710973 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940400fb70 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623bb8fcb40 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f92f6604640 1 -- 172.21.15.164:0/2123710973 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f940400fe50 con 0x5623bb776730 2024-09-14T10:57:11.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.808+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bb8fd540 con 0x5623bb776730 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f92f6604640 1 -- 172.21.15.164:0/2123710973 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9404017040 con 0x5623bb776730 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f92f6604640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 0x7f92f003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f92f6604640 1 -- 172.21.15.164:0/2123710973 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9404015020 con 0x5623bb776730 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f94092ca640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 0x7f92f003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 0x5623bb9039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.809+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb903ee0 con 0x5623bb808fc0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 0x5623bb9039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f94092ca640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 0x7f92f003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f93f4057000 tx=0x7f93f4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 0x5623bb9039a0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940a2cc640 1 -- 172.21.15.164:0/2123710973 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93fc00a4d0 con 0x5623bb808fc0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb904280 con 0x5623bb808fc0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940a2cc640 1 -- 172.21.15.164:0/2123710973 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93fc00a4d0 con 0x5623bb808fc0 2024-09-14T10:57:11.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 0x5623bb908200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.810+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb908990 con 0x5623bb905d80 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f9409acb640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 0x5623bb908200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f9409acb640 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 0x5623bb908200 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f9409acb640 1 -- 172.21.15.164:0/2123710973 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f940402d070 con 0x5623bb905d80 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb904ad0 con 0x5623bb808fc0 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f940a2cc640 1 -- 172.21.15.164:0/2123710973 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93fc00a4d0 con 0x5623bb808fc0 2024-09-14T10:57:11.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.811+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb904f20 con 0x5623bb808fc0 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940a2cc640 1 -- 172.21.15.164:0/2123710973 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f93fc00a4d0 con 0x5623bb808fc0 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940e414800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940e414800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5623bb6f94a0 con 0x5623bb917370 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58094/0 (socket says 172.21.15.164:58094) 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.812+0000 7f940a2cc640 1 -- 172.21.15.164:0/3679831892 learned_addr learned my addr 172.21.15.164:0/3679831892 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f940a2cc640 1 -- 172.21.15.164:0/3679831892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb917dd0 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f940a2cc640 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00a2a0 tx=0x7f93fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f92ef7fe640 1 -- 172.21.15.164:0/3679831892 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc014450 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f92ef7fe640 1 -- 172.21.15.164:0/3679831892 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc0145f0 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f92ef7fe640 1 -- 172.21.15.164:0/3679831892 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc014910 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623bb918600 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.813+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bb918ba0 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.814+0000 7f92ef7fe640 1 -- 172.21.15.164:0/3679831892 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f93fc011040 con 0x5623bb917370 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.814+0000 7f92ef7fe640 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 0x7f92e403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.814+0000 7f92ef7fe640 1 -- 172.21.15.164:0/3679831892 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f93fc01e070 con 0x5623bb917370 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.814+0000 7f9409acb640 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 0x7f92e403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.814+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f9409acb640 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 0x7f92e403f2d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5623bb8fe440 tx=0x7f94040011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940e414800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940e414800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5623bb8f5290 con 0x5623bb923e10 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58098/0 (socket says 172.21.15.164:58098) 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940a2cc640 1 -- 172.21.15.164:0/2386719239 learned_addr learned my addr 172.21.15.164:0/2386719239 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940a2cc640 1 -- 172.21.15.164:0/2386719239 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb924800 con 0x5623bb923e10 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2386719239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f93fc016fd0 tx=0x7f93fc022f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da66568d7ffc412 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f92ed7fa640 1 -- 172.21.15.164:0/2386719239 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc04b070 con 0x5623bb923e10 2024-09-14T10:57:11.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f92ed7fa640 1 -- 172.21.15.164:0/2386719239 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc051070 con 0x5623bb923e10 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.815+0000 7f92ed7fa640 1 -- 172.21.15.164:0/2386719239 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc056070 con 0x5623bb923e10 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- 172.21.15.164:0/2386719239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 msgr2=0x5623bb924210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 --2- 172.21.15.164:0/2386719239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f93fc016fd0 tx=0x7f93fc022f30 comp rx=0 tx=0).stop 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- 172.21.15.164:0/2386719239 shutdown_connections 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 --2- 172.21.15.164:0/2386719239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb924210 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- 172.21.15.164:0/2386719239 >> 172.21.15.164:0/2386719239 conn(0x5623bb920210 msgr2=0x5623bb91e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- 172.21.15.164:0/2386719239 shutdown_connections 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- 172.21.15.164:0/2386719239 wait complete. 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 Processor -- start 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- start start 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940e414800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x5623bb924e20 con 0x5623bb923e10 2024-09-14T10:57:11.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.816+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940a2cc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58108/0 (socket says 172.21.15.164:58108) 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 learned_addr learned my addr 172.21.15.164:0/2662020049 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bb92b8e0 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f93fc049040 tx=0x7f93fc054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f92db7fe640 1 -- 172.21.15.164:0/2662020049 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc04b040 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f92db7fe640 1 -- 172.21.15.164:0/2662020049 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc0167c0 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623bb92bb70 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f92db7fe640 1 -- 172.21.15.164:0/2662020049 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93fc011330 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.817+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bb92c4f0 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.818+0000 7f92db7fe640 1 -- 172.21.15.164:0/2662020049 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f93fc0457c0 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.818+0000 7f92db7fe640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92d403ce10 0x7f92d403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.818+0000 7f92db7fe640 1 -- 172.21.15.164:0/2662020049 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f93fc00e040 con 0x5623bb923e10 2024-09-14T10:57:11.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.818+0000 7f9409acb640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92d403ce10 0x7f92d403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f9409acb640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92d403ce10 0x7f92d403f2d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94040189e0 tx=0x7f9404041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb937120 0x5623bb9395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb939d30 con 0x5623bb937120 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f94092ca640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb937120 0x5623bb9395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f94092ca640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb937120 0x5623bb9395e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 20 realm 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.819+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93a160 con 0x5623bb937120 2024-09-14T10:57:11.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93aa30 con 0x5623bb937120 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93add0 con 0x5623bb937120 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb93bb30 0x5623bb93df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93e530 con 0x5623bb93bb30 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.820+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb93bb30 0x5623bb93df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb93bb30 0x5623bb93df20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940e414800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940e414800 20 searching for the correct realm 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940a2cc640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f93fc037070 0x7f93fc045140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.821+0000 7f9409acb640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f93fc037070 0x7f93fc045140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f9409acb640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f93fc037070 0x7f93fc045140 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f9409acb640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f940403c040 0x7f940401a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f94092ca640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f940403c040 0x7f940401a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.822+0000 7f94092ca640 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f940403c040 0x7f940401a750 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.823+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.824+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.832 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.825+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.826+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.827+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x5623bb937120 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f4057030 con 0x7f940403c040 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.828+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb93bb30 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f940403c040 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x5623bb937120 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.829+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93fe20 con 0x7f93fc037070 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93ef20 con 0x5623bb937120 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb93f770 con 0x5623bb937120 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb9402a0 con 0x5623bb937120 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 zone default found 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 4 Realm: () 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 zonegroup default 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.830+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb940640 con 0x7f940403c040 2024-09-14T10:57:11.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb942420 con 0x5623bb93bb30 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb942960 con 0x5623bb93bb30 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 started sync module instance, tier type = 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.831+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb9418c0 con 0x7f93fc037070 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.832+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.832+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94711470890160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943270 con 0x7f93fc037070 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.832+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943ac0 con 0x5623bb937120 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.833+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94711470890160] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.834+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.834+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94711470894528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943ac0 con 0x5623bb937120 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.834+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb944570 con 0x5623bb93bb30 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.835+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94711470894528] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.835+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.835+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94711470899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943ac0 con 0x5623bb93bb30 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.835+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb945040 con 0x7f93fc037070 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.836+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94711470899328] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.836+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.836+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94711470896656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943a30 con 0x7f93fc037070 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.836+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb945f00 con 0x5623bb937120 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.837+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94711470896656] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.837+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.837+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94711470905936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb945e70 con 0x5623bb937120 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.837+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb946dc0 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.838+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94711470905936] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.838+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.838+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94711470908000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb946dc0 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.838+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb947780 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.839+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94711470908000] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.840+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.840+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94711470910192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb947780 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.840+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb948140 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.840+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94711470910192] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.840+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94711470912688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb948140 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=0 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=1 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=2 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=3 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=4 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=5 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=6 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94711470912688] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 20 add_watcher() i=7 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.841+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb94b450 con 0x5623bb937120 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.842+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.842+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94711470915072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb9486d0 con 0x5623bb937120 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94711470915072] v37'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f92bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f940e414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f940e414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f940e414800 5 note: GC not initialized 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f92ba7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f940e414800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.843+0000 7f940e414800 20 Filter name: none 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f922bfff640 20 reqs_thread_entry: start 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb97e6f0 con 0x7f940403c040 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.844+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb984c50 con 0x7f940403c040 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.845+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f940e414800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f940e414800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f940e414800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94711471162896 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5623bb980230 con 0x5623bb937120 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94711470905936 notify 158913789980 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5623bb80cb60 con 0x5623bb937120 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f92ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789980 cookie 94711470905936 notifier 4912 bl.length()=666 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94711471162896 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f92ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f92ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f92ed7fa640 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f92cc003ea0 con 0x5623bb937120 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.846+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94711471162896 notify 158913789980 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f93f406a430 con 0x5623bb937120 2024-09-14T10:57:11.856 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.847+0000 7f92bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.847+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94711470915072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb97c490 con 0x5623bb937120 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.848+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94711470915072] v37'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.848+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94711470890160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb97c490 con 0x7f93fc037070 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.849+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94711470890160] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.849+0000 7f940e414800 20 remove_watcher() i=0 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.849+0000 7f940e414800 2 removed watcher, disabling cache 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.849+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94711470894528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb941cb0 con 0x5623bb937120 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.850+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94711470894528] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.850+0000 7f940e414800 20 remove_watcher() i=1 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.850+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94711470899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb942dc0 con 0x5623bb93bb30 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.852+0000 7f940a2cc640 1 -- 172.21.15.164:0/2662020049 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94711470899328] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93fc02a070 con 0x5623bb93bb30 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.852+0000 7f940e414800 20 remove_watcher() i=2 2024-09-14T10:57:11.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.852+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94711470896656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb941cb0 con 0x7f93fc037070 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.853+0000 7f9409acb640 1 -- 172.21.15.164:0/2662020049 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94711470896656] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9404039070 con 0x7f93fc037070 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.853+0000 7f940e414800 20 remove_watcher() i=3 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.853+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94711470905936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb944080 con 0x5623bb937120 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.854+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94711470905936] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x5623bb937120 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.854+0000 7f940e414800 20 remove_watcher() i=4 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.854+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94711470908000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb942dc0 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.855+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94711470908000] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.855+0000 7f940e414800 20 remove_watcher() i=5 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.855+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94711470910192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb943610 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.856+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94711470910192] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.856+0000 7f940e414800 20 remove_watcher() i=6 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.856+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94711470912688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5623bb941cb0 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94711470912688] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f407f040 con 0x7f940403c040 2024-09-14T10:57:11.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 20 remove_watcher() i=7 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f940403c040 msgr2=0x7f940401a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f940403c040 0x7f940401a750 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb937120 msgr2=0x5623bb9395e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb937120 0x5623bb9395e0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f93fc037070 msgr2=0x7f93fc045140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f93fc037070 0x7f93fc045140 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb93bb30 msgr2=0x5623bb93df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb93bb30 0x5623bb93df20 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92d403ce10 msgr2=0x7f92d403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92d403ce10 0x7f92d403f2d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f94040189e0 tx=0x7f9404041000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 msgr2=0x5623bb92b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f93fc049040 tx=0x7f93fc054580 comp rx=0 tx=0).stop 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f94092ca640 1 -- 172.21.15.164:0/2662020049 reap_dead start 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 shutdown_connections 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/2662020049 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb923e10 0x5623bb92b380 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 >> 172.21.15.164:0/2662020049 conn(0x5623bb920210 msgr2=0x5623bb91e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 shutdown_connections 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/2662020049 wait complete. 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 msgr2=0x7f92e403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 0x7f92e403f2d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x5623bb8fe440 tx=0x7f94040011b0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 msgr2=0x5623bb917790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00a2a0 tx=0x7f93fc018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 shutdown_connections 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92e403ce10 0x7f92e403f2d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 --2- 172.21.15.164:0/3679831892 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb917370 0x5623bb917790 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.857+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 >> 172.21.15.164:0/3679831892 conn(0x5623bb90b720 msgr2=0x5623bb90bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 shutdown_connections 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/3679831892 wait complete. 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 msgr2=0x5623bb9039a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 0x5623bb9039a0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 msgr2=0x5623bb908200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 0x5623bb908200 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 msgr2=0x7f92f003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 0x7f92f003f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f93f4057000 tx=0x7f93f4052000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 msgr2=0x5623bb8fc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f94040012f0 tx=0x7f9404000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 shutdown_connections 2024-09-14T10:57:11.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x5623bb905d80 0x5623bb908200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x5623bb808fc0 0x5623bb9039a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f92f003d000 0x7f92f003f4c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 --2- 172.21.15.164:0/2123710973 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5623bb776730 0x5623bb8fc350 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 >> 172.21.15.164:0/2123710973 conn(0x5623bb7fcfd0 msgr2=0x5623bb8f5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 shutdown_connections 2024-09-14T10:57:11.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.858+0000 7f940e414800 1 -- 172.21.15.164:0/2123710973 wait complete. 2024-09-14T10:57:11.867 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.867 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:11.867 ERROR:root:0 2024-09-14T10:57:11.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:11.871 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000008e43039c6a3a7e34-0066e56c07-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:57:11.872 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:57:11.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-14T10:57:11.872 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-14T10:57:11.919 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:11.919 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:11.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10a1339800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559ea7337fb0 0x559ea733a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10a1339800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ea733a970 con 0x559ea72a4f10 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10a1339800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x559ea71bc7d0 con 0x559ea7337fb0 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10947c6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559ea7337fb0 0x559ea733a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10947c6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x559ea7337fb0 0x559ea733a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58116/0 (socket says 172.21.15.164:58116) 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f109cfc7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x559ea72a4f10 0x559ea7336890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58406/0 (socket says 172.21.15.164:58406) 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10947c6640 1 -- 172.21.15.164:0/1308004563 learned_addr learned my addr 172.21.15.164:0/1308004563 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10947c6640 1 -- 172.21.15.164:0/1308004563 >> v1:172.21.15.116:6789/0 conn(0x559ea72a4f10 legacy=0x559ea7336890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f1097fff640 1 -- 172.21.15.164:0/1308004563 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274364852 0 0) 0x559ea733a970 con 0x559ea72a4f10 2024-09-14T10:57:11.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.922+0000 7f10947c6640 1 -- 172.21.15.164:0/1308004563 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea733bb50 con 0x559ea7337fb0 2024-09-14T10:57:11.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.924+0000 7f10947c6640 1 --2- 172.21.15.164:0/1308004563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7337fb0 0x559ea733a3a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f108400a520 tx=0x7f1084045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430638650ea9478b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.924+0000 7f1097fff640 1 -- 172.21.15.164:0/1308004563 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1084055070 con 0x559ea7337fb0 2024-09-14T10:57:11.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.924+0000 7f1097fff640 1 -- 172.21.15.164:0/1308004563 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840515b0 con 0x559ea7337fb0 2024-09-14T10:57:11.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.924+0000 7f1097fff640 1 -- 172.21.15.164:0/1308004563 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10840518d0 con 0x559ea7337fb0 2024-09-14T10:57:11.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 -- 172.21.15.164:0/1308004563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7337fb0 msgr2=0x559ea733a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 --2- 172.21.15.164:0/1308004563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7337fb0 0x559ea733a3a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f108400a520 tx=0x7f1084045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 -- 172.21.15.164:0/1308004563 shutdown_connections 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 --2- 172.21.15.164:0/1308004563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7337fb0 0x559ea733a3a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 -- 172.21.15.164:0/1308004563 >> 172.21.15.164:0/1308004563 conn(0x559ea732bfa0 msgr2=0x559ea732e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 -- 172.21.15.164:0/1308004563 shutdown_connections 2024-09-14T10:57:11.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.925+0000 7f10a1339800 1 -- 172.21.15.164:0/1308004563 wait complete. 2024-09-14T10:57:11.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f10a1339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f10a1339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ea71c9dd0 con 0x559ea72a4f10 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f109cfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f109cfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58122/0 (socket says 172.21.15.164:58122) 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f109cfc7640 1 -- 172.21.15.164:0/3607158626 learned_addr learned my addr 172.21.15.164:0/3607158626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.939+0000 7f109cfc7640 1 -- 172.21.15.164:0/3607158626 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea7423ec0 con 0x559ea72a4f10 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f109cfc7640 1 --2- 172.21.15.164:0/3607158626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f108c001ea0 tx=0x7f108c00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c75bf6b9b063d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f0f8ae0d640 1 -- 172.21.15.164:0/3607158626 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c008070 con 0x559ea72a4f10 2024-09-14T10:57:11.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f0f8ae0d640 1 -- 172.21.15.164:0/3607158626 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c00d500 con 0x559ea72a4f10 2024-09-14T10:57:11.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f0f8ae0d640 1 -- 172.21.15.164:0/3607158626 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c00d880 con 0x559ea72a4f10 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 -- 172.21.15.164:0/3607158626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 msgr2=0x559ea74238d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 --2- 172.21.15.164:0/3607158626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f108c001ea0 tx=0x7f108c00b6a0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 -- 172.21.15.164:0/3607158626 shutdown_connections 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 --2- 172.21.15.164:0/3607158626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea74238d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 -- 172.21.15.164:0/3607158626 >> 172.21.15.164:0/3607158626 conn(0x559ea732bfa0 msgr2=0x559ea741f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 -- 172.21.15.164:0/3607158626 shutdown_connections 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.940+0000 7f10a1339800 1 -- 172.21.15.164:0/3607158626 wait complete. 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f10a1339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f10a1339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ea733ae40 con 0x559ea72a4f10 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f109cfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f109cfc7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58134/0 (socket says 172.21.15.164:58134) 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f109cfc7640 1 -- 172.21.15.164:0/1637415013 learned_addr learned my addr 172.21.15.164:0/1637415013 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f109cfc7640 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea742b930 con 0x559ea72a4f10 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.941+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f108c0012f0 tx=0x7f108c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.942+0000 7f0f8960a640 1 -- 172.21.15.164:0/1637415013 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c00f9d0 con 0x559ea72a4f10 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.942+0000 7f0f8960a640 1 -- 172.21.15.164:0/1637415013 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c00fb70 con 0x559ea72a4f10 2024-09-14T10:57:11.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.942+0000 7f0f8960a640 1 -- 172.21.15.164:0/1637415013 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c00fe50 con 0x559ea72a4f10 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.942+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ea742bbc0 con 0x559ea72a4f10 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.942+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ea742c5c0 con 0x559ea72a4f10 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f0f8960a640 1 -- 172.21.15.164:0/1637415013 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f108c017040 con 0x559ea72a4f10 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f0f8960a640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 0x7f0f8403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f0f8960a640 1 -- 172.21.15.164:0/1637415013 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f108c015020 con 0x559ea72a4f10 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f10947c6640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 0x7f0f8403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 0x559ea7432a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7432f60 con 0x559ea7337fb0 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 0x559ea7432a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f10947c6640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 0x7f0f8403f4c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1084057000 tx=0x7f1084052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.943+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 0x559ea7432a20 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f109d7c8640 1 -- 172.21.15.164:0/1637415013 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f109800a4d0 con 0x559ea7337fb0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7433300 con 0x559ea7337fb0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f109d7c8640 1 -- 172.21.15.164:0/1637415013 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f109800a4d0 con 0x559ea7337fb0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 0x559ea7437280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7437a10 con 0x559ea7434e00 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 0x559ea7437280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.944+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 0x559ea7437280 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.945+0000 7f109cfc7640 1 -- 172.21.15.164:0/1637415013 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f108c02d070 con 0x559ea7434e00 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.945+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7433b50 con 0x559ea7337fb0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.945+0000 7f109d7c8640 1 -- 172.21.15.164:0/1637415013 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f109800a4d0 con 0x559ea7337fb0 2024-09-14T10:57:11.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.945+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7433fa0 con 0x559ea7337fb0 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.945+0000 7f109d7c8640 1 -- 172.21.15.164:0/1637415013 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f109800a4d0 con 0x559ea7337fb0 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f10a1339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f10a1339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ea72284a0 con 0x559ea74463f0 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58140/0 (socket says 172.21.15.164:58140) 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f109d7c8640 1 -- 172.21.15.164:0/4195407553 learned_addr learned my addr 172.21.15.164:0/4195407553 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f109d7c8640 1 -- 172.21.15.164:0/4195407553 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea7446e50 con 0x559ea74463f0 2024-09-14T10:57:11.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.946+0000 7f109d7c8640 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f109800a2a0 tx=0x7f1098018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f0f827fc640 1 -- 172.21.15.164:0/4195407553 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098014450 con 0x559ea74463f0 2024-09-14T10:57:11.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f0f827fc640 1 -- 172.21.15.164:0/4195407553 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10980145f0 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f0f827fc640 1 -- 172.21.15.164:0/4195407553 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098014910 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ea7447680 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ea7447c20 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.947+0000 7f0f827fc640 1 -- 172.21.15.164:0/4195407553 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1098011040 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f0f827fc640 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 0x7f0f7403f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f0f827fc640 1 -- 172.21.15.164:0/4195407553 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f109801e070 con 0x559ea74463f0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f109cfc7640 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 0x7f0f7403f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f109cfc7640 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 0x7f0f7403f320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x559ea742d4c0 tx=0x7f108c0011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f10a1339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f10a1339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ea74242f0 con 0x559ea7452e30 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58148/0 (socket says 172.21.15.164:58148) 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.948+0000 7f109d7c8640 1 -- 172.21.15.164:0/1052183472 learned_addr learned my addr 172.21.15.164:0/1052183472 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f109d7c8640 1 -- 172.21.15.164:0/1052183472 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea7453820 con 0x559ea7452e30 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1052183472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1098016fd0 tx=0x7f1098011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d0e841433cfa56 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f0f73fff640 1 -- 172.21.15.164:0/1052183472 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098051020 con 0x559ea7452e30 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f0f73fff640 1 -- 172.21.15.164:0/1052183472 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098022de0 con 0x559ea7452e30 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f0f73fff640 1 -- 172.21.15.164:0/1052183472 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098028070 con 0x559ea7452e30 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 -- 172.21.15.164:0/1052183472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 msgr2=0x559ea7453230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 --2- 172.21.15.164:0/1052183472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1098016fd0 tx=0x7f1098011a80 comp rx=0 tx=0).stop 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 -- 172.21.15.164:0/1052183472 shutdown_connections 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 --2- 172.21.15.164:0/1052183472 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea7453230 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 -- 172.21.15.164:0/1052183472 >> 172.21.15.164:0/1052183472 conn(0x559ea744f230 msgr2=0x559ea744d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 -- 172.21.15.164:0/1052183472 shutdown_connections 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.949+0000 7f10a1339800 1 -- 172.21.15.164:0/1052183472 wait complete. 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f10a1339800 1 Processor -- start 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f10a1339800 1 -- start start 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f10a1339800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f10a1339800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x559ea7453e40 con 0x559ea7452e30 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f109d7c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58158/0 (socket says 172.21.15.164:58158) 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 learned_addr learned my addr 172.21.15.164:0/1793614399 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.950+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ea745a970 con 0x559ea7452e30 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1098022f90 tx=0x7f1098054580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f0f727fc640 1 -- 172.21.15.164:0/1793614399 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098016440 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f0f727fc640 1 -- 172.21.15.164:0/1793614399 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1098045130 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ea745ac00 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f0f727fc640 1 -- 172.21.15.164:0/1793614399 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1098045410 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ea745b580 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.951+0000 7f0f727fc640 1 -- 172.21.15.164:0/1793614399 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f1098034030 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f0f727fc640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f6803ce10 0x7f0f6803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f0f727fc640 1 -- 172.21.15.164:0/1793614399 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f1098032070 con 0x559ea7452e30 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f6803ce10 0x7f0f6803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f6803ce10 0x7f0f6803f2d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f108c0189e0 tx=0x7f108c041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.952+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7466190 0x559ea7468650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7468da0 con 0x559ea7466190 2024-09-14T10:57:11.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10947c6640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7466190 0x559ea7468650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10947c6640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7466190 0x559ea7468650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 20 realm 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea74691d0 con 0x559ea7466190 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.953+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7469aa0 con 0x559ea7466190 2024-09-14T10:57:11.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7469e40 con 0x559ea7466190 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea746aba0 0x559ea746cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea746d5a0 con 0x559ea746aba0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea746aba0 0x559ea746cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.954+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea746aba0 0x559ea746cf90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f10a1339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:11.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f10a1339800 20 searching for the correct realm 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x559ea746aba0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109d7c8640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f109804dc20 0x7f109802ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f109804dc20 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f109804dc20 0x7f109802ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.955+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f109804dc20 0x7f109802ca50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f109cfc7640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f108c04b430 0x7f108c0540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f108c04b430 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f10947c6640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f108c04b430 0x7f108c0540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f10947c6640 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f108c04b430 0x7f108c0540f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.956+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x559ea7466190 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x559ea7466190 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f108c04b430 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f108c04b430 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.957+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f109804dc20 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x559ea746aba0 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x559ea7466190 2024-09-14T10:57:11.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559ea746ee90 con 0x7f109804dc20 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.958+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea7466190 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f109804dc20 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.959+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f108c04b430 2024-09-14T10:57:11.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea7466190 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea7466190 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.960+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f108c04b430 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f109804dc20 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea7466190 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x559ea7466190 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.961+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f108c04b430 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f108c04b430 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1084057030 con 0x7f108c04b430 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f109804dc20 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.962+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea746aba0 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f108c04b430 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x559ea7466190 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.963+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f108c061040 con 0x7f109804dc20 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:11.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea746df60 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea746e7b0 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea746f310 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:11.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 zone default found 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 4 Realm: () 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 zonegroup default 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.964+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea746f6b0 con 0x7f108c04b430 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7471490 con 0x559ea746aba0 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea7471970 con 0x559ea746aba0 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 started sync module instance, tier type = 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.965+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7470930 con 0x7f109804dc20 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.966+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.966+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139899645216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7470590 con 0x7f109804dc20 2024-09-14T10:57:11.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.966+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74728a0 con 0x559ea7466190 2024-09-14T10:57:11.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.968+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.968+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94139899651568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7473140 con 0x559ea7466190 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.968+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94139899645216] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.968+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7473c30 con 0x559ea746aba0 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.969+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94139899651568] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.969+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.969+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94139899655936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7473140 con 0x559ea746aba0 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.969+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7474210 con 0x7f109804dc20 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.970+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.970+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94139899655936] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.970+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94139899657568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7474a60 con 0x7f109804dc20 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.970+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7472cd0 con 0x559ea7466190 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.971+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94139899657568] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.971+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.971+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94139899659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74749d0 con 0x559ea7466190 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.971+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7475ac0 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.972+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.972+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94139899663888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7475a30 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.972+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94139899659696] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.972+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74764d0 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.973+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94139899663888] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.973+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.973+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94139899662320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74764d0 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.973+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7476e90 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94139899662320] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94139899666096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7476e90 con 0x7f108c04b430 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=0 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=1 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=2 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=3 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=4 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=5 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.974+0000 7f10a1339800 20 add_watcher() i=6 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.975+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94139899666096] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.975+0000 7f10a1339800 20 add_watcher() i=7 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.975+0000 7f10a1339800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.975+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea747a1d0 con 0x559ea7466190 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.976+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.976+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94139899669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea7477420 con 0x559ea7466190 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94139899669328] v37'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f0f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 5 note: GC not initialized 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f0f51fe3640 20 reqs_thread_entry: start 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 20 Filter name: none 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f0ec37fe640 20 reqs_thread_entry: start 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 20 rados->read ofs=0 len=0 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.977+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ad490 con 0x7f108c04b430 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10a1339800 20 rados_obj.operate() r=0 bl.length=490 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10a1339800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10a1339800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10a1339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.978+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74b3ae0 con 0x7f108c04b430 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10a1339800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10a1339800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10a1339800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94139899917472 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559ea74af0c0 con 0x559ea7466190 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94139899659696 notify 158913789981 ret 0) ==== 678+0+0 (crc 0 0 0) 0x559ea733bb50 con 0x559ea7466190 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f0f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789981 cookie 94139899659696 notifier 4919 bl.length()=636 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f0f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:11.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f0f73fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:11.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f0f73fff640 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f0f60003ea0 con 0x559ea7466190 2024-09-14T10:57:11.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.979+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94139899917472 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.980+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.980+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 94139899917472 notify 158913789981 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f108406a430 con 0x559ea7466190 2024-09-14T10:57:11.990 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.981+0000 7f0f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.981+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94139899669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x559ea7466190 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.982+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94139899669328] v37'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.982+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94139899645216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x7f109804dc20 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.983+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94139899645216] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.983+0000 7f10a1339800 20 remove_watcher() i=0 2024-09-14T10:57:11.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.983+0000 7f10a1339800 2 removed watcher, disabling cache 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.983+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94139899651568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x559ea7466190 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.984+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94139899651568] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.984+0000 7f10a1339800 20 remove_watcher() i=1 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.984+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94139899655936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x559ea746aba0 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.985+0000 7f109d7c8640 1 -- 172.21.15.164:0/1793614399 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94139899655936] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109802a070 con 0x559ea746aba0 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.985+0000 7f10a1339800 20 remove_watcher() i=2 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.985+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94139899657568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x7f109804dc20 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.986+0000 7f109cfc7640 1 -- 172.21.15.164:0/1793614399 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94139899657568] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c055d70 con 0x7f109804dc20 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.986+0000 7f10a1339800 20 remove_watcher() i=3 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.986+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94139899659696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x559ea7466190 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.987+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94139899659696] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x559ea7466190 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.987+0000 7f10a1339800 20 remove_watcher() i=4 2024-09-14T10:57:11.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.987+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94139899663888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.988+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94139899663888] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.988+0000 7f10a1339800 20 remove_watcher() i=5 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.988+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94139899662320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.989+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94139899662320] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.989+0000 7f10a1339800 20 remove_watcher() i=6 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.989+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94139899666096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559ea74ab270 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.990+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94139899666096] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108407f040 con 0x7f108c04b430 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.990+0000 7f10a1339800 20 remove_watcher() i=7 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f108c04b430 msgr2=0x7f108c0540f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f108c04b430 0x7f108c0540f0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7466190 msgr2=0x559ea7468650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7466190 0x559ea7468650 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f109804dc20 msgr2=0x7f109802ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f109804dc20 0x7f109802ca50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea746aba0 msgr2=0x559ea746cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea746aba0 0x559ea746cf90 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f6803ce10 msgr2=0x7f0f6803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f6803ce10 0x7f0f6803f2d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f108c0189e0 tx=0x7f108c041000 comp rx=0 tx=0).stop 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 msgr2=0x559ea745a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10947c6640 1 -- 172.21.15.164:0/1793614399 reap_dead start 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1098022f90 tx=0x7f1098054580 comp rx=0 tx=0).stop 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 shutdown_connections 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/1793614399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea7452e30 0x559ea745a410 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 >> 172.21.15.164:0/1793614399 conn(0x559ea744f230 msgr2=0x559ea744d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 shutdown_connections 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/1793614399 wait complete. 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 msgr2=0x7f0f7403f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 0x7f0f7403f320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x559ea742d4c0 tx=0x7f108c0011b0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 msgr2=0x559ea7446810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f109800a2a0 tx=0x7f1098018830 comp rx=0 tx=0).stop 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 shutdown_connections 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f7403ce60 0x7f0f7403f320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 --2- 172.21.15.164:0/4195407553 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea74463f0 0x559ea7446810 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 >> 172.21.15.164:0/4195407553 conn(0x559ea743a7a0 msgr2=0x559ea743ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 shutdown_connections 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.991+0000 7f10a1339800 1 -- 172.21.15.164:0/4195407553 wait complete. 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 msgr2=0x559ea7432a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:11.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 0x559ea7432a20 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 msgr2=0x559ea7437280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 0x559ea7437280 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 msgr2=0x7f0f8403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 0x7f0f8403f4c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1084057000 tx=0x7f1084052000 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 msgr2=0x559ea742b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f108c0012f0 tx=0x7f108c000ed0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 shutdown_connections 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x559ea7434e00 0x559ea7437280 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x559ea7337fb0 0x559ea7432a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0f8403d000 0x7f0f8403f4c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 --2- 172.21.15.164:0/1637415013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559ea72a4f10 0x559ea742b3d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 >> 172.21.15.164:0/1637415013 conn(0x559ea732bfa0 msgr2=0x559ea7424dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 shutdown_connections 2024-09-14T10:57:12.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:11.992+0000 7f10a1339800 1 -- 172.21.15.164:0/1637415013 wait complete. 2024-09-14T10:57:12.002 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.002 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.003 ERROR:root:0 2024-09-14T10:57:12.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:12.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:12.003 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:57:12.049 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:12.049 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:12.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.052+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.052+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.052+0000 7f231bc98800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bb6c727b0 0x555bb6c72bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.052+0000 7f231bc98800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555bb6c74490 con 0x555bb6c738d0 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.052+0000 7f231bc98800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x555bb6afe7d0 con 0x555bb6c727b0 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.053+0000 7f2319782640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bb6c727b0 0x555bb6c72bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.053+0000 7f2319782640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x555bb6c727b0 0x555bb6c72bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58168/0 (socket says 172.21.15.164:58168) 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.053+0000 7f2319782640 1 -- 172.21.15.164:0/3366760626 learned_addr learned my addr 172.21.15.164:0/3366760626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.053+0000 7f2319782640 1 -- 172.21.15.164:0/3366760626 >> v1:172.21.15.116:6789/0 conn(0x555bb6c738d0 legacy=0x555bb6c73d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.053+0000 7f2319782640 1 -- 172.21.15.164:0/3366760626 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6c74660 con 0x555bb6c727b0 2024-09-14T10:57:12.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f2319782640 1 --2- 172.21.15.164:0/3366760626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6c72bb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f230c00a520 tx=0x7f230c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2afdc8344b01f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f2313fff640 1 -- 172.21.15.164:0/3366760626 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c055070 con 0x555bb6c727b0 2024-09-14T10:57:12.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f2313fff640 1 -- 172.21.15.164:0/3366760626 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c0515b0 con 0x555bb6c727b0 2024-09-14T10:57:12.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f2313fff640 1 -- 172.21.15.164:0/3366760626 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c0518d0 con 0x555bb6c727b0 2024-09-14T10:57:12.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 -- 172.21.15.164:0/3366760626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 msgr2=0x555bb6c72bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 --2- 172.21.15.164:0/3366760626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6c72bb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f230c00a520 tx=0x7f230c045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 -- 172.21.15.164:0/3366760626 shutdown_connections 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 --2- 172.21.15.164:0/3366760626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6c72bb0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 -- 172.21.15.164:0/3366760626 >> 172.21.15.164:0/3366760626 conn(0x555bb6c6dfa0 msgr2=0x555bb6c70400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 -- 172.21.15.164:0/3366760626 shutdown_connections 2024-09-14T10:57:12.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.055+0000 7f231bc98800 1 -- 172.21.15.164:0/3366760626 wait complete. 2024-09-14T10:57:12.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.069+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.069+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.069+0000 7f231bc98800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.069+0000 7f231bc98800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bb6b0bdd0 con 0x555bb6c727b0 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.070+0000 7f2319782640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.070+0000 7f2319782640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58172/0 (socket says 172.21.15.164:58172) 2024-09-14T10:57:12.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.070+0000 7f2319782640 1 -- 172.21.15.164:0/2685692912 learned_addr learned my addr 172.21.15.164:0/2685692912 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.070+0000 7f2319782640 1 -- 172.21.15.164:0/2685692912 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6be7200 con 0x555bb6c727b0 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.070+0000 7f2319782640 1 --2- 172.21.15.164:0/2685692912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f230c0460d0 tx=0x7f230c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5100ff7d6d086c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f2207606640 1 -- 172.21.15.164:0/2685692912 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c0519d0 con 0x555bb6c727b0 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f2207606640 1 -- 172.21.15.164:0/2685692912 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c051b70 con 0x555bb6c727b0 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f2207606640 1 -- 172.21.15.164:0/2685692912 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c051e50 con 0x555bb6c727b0 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 -- 172.21.15.164:0/2685692912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 msgr2=0x555bb6be6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 --2- 172.21.15.164:0/2685692912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f230c0460d0 tx=0x7f230c051000 comp rx=0 tx=0).stop 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 -- 172.21.15.164:0/2685692912 shutdown_connections 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 --2- 172.21.15.164:0/2685692912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6be6cc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 -- 172.21.15.164:0/2685692912 >> 172.21.15.164:0/2685692912 conn(0x555bb6c6dfa0 msgr2=0x555bb6d5e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 -- 172.21.15.164:0/2685692912 shutdown_connections 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.071+0000 7f231bc98800 1 -- 172.21.15.164:0/2685692912 wait complete. 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f231bc98800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f231bc98800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bb6c79dc0 con 0x555bb6c727b0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2319782640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2319782640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58174/0 (socket says 172.21.15.164:58174) 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2319782640 1 -- 172.21.15.164:0/1428897804 learned_addr learned my addr 172.21.15.164:0/1428897804 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2319782640 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6d6d9a0 con 0x555bb6c727b0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2319782640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f230c0460d0 tx=0x7f230c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2205e03640 1 -- 172.21.15.164:0/1428897804 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c073020 con 0x555bb6c727b0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f2205e03640 1 -- 172.21.15.164:0/1428897804 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230c06f580 con 0x555bb6c727b0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.072+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bb6d6dc30 con 0x555bb6c727b0 2024-09-14T10:57:12.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.073+0000 7f2205e03640 1 -- 172.21.15.164:0/1428897804 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230c06f8a0 con 0x555bb6c727b0 2024-09-14T10:57:12.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.073+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bb6d6e840 con 0x555bb6c727b0 2024-09-14T10:57:12.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.073+0000 7f2205e03640 1 -- 172.21.15.164:0/1428897804 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f230c076020 con 0x555bb6c727b0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2205e03640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 0x7f220003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2205e03640 1 -- 172.21.15.164:0/1428897804 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f230c06b040 con 0x555bb6c727b0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2318f81640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 0x7f220003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 0x555bb6d74a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6d74fd0 con 0x555bb6c738d0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2319f83640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 0x555bb6d74a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2318f81640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 0x7f220003f320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2304001e50 tx=0x7f23040013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2319f83640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 0x555bb6d74a90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f2319f83640 1 -- 172.21.15.164:0/1428897804 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f231400a4d0 con 0x555bb6c738d0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.074+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6d75370 con 0x555bb6c738d0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f2319f83640 1 -- 172.21.15.164:0/1428897804 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f231400a4d0 con 0x555bb6c738d0 2024-09-14T10:57:12.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 0x555bb6d79320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6d79ab0 con 0x555bb6d76eb0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f2319782640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 0x555bb6d79320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f2319782640 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 0x555bb6d79320 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f2319782640 1 -- 172.21.15.164:0/1428897804 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f230c057030 con 0x555bb6d76eb0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.075+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6d75bc0 con 0x555bb6c738d0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.076+0000 7f2319f83640 1 -- 172.21.15.164:0/1428897804 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f231400a4d0 con 0x555bb6c738d0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.076+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6d76020 con 0x555bb6c738d0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.076+0000 7f2319f83640 1 -- 172.21.15.164:0/1428897804 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f231400a4d0 con 0x555bb6c738d0 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.076+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.076+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f231bc98800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f231bc98800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bb6b6a4a0 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58176/0 (socket says 172.21.15.164:58176) 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f2319f83640 1 -- 172.21.15.164:0/199216607 learned_addr learned my addr 172.21.15.164:0/199216607 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f2319f83640 1 -- 172.21.15.164:0/199216607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6d88f20 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f2319f83640 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x555bb6d6e440 tx=0x7f2314018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f21feffd640 1 -- 172.21.15.164:0/199216607 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2314014450 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f21feffd640 1 -- 172.21.15.164:0/199216607 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314014610 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f21feffd640 1 -- 172.21.15.164:0/199216607 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2314014930 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.077+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bb6d89750 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.078+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bb6d89cf0 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.078+0000 7f21feffd640 1 -- 172.21.15.164:0/199216607 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2314011040 con 0x555bb6d884c0 2024-09-14T10:57:12.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.078+0000 7f21feffd640 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 0x7f21f003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f21feffd640 1 -- 172.21.15.164:0/199216607 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f231401e070 con 0x555bb6d884c0 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f2319782640 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 0x7f21f003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f2319782640 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 0x7f21f003f320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x555bb6d6f560 tx=0x7f230c067040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f231bc98800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f231bc98800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bb6d68890 con 0x555bb6d94f00 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58188/0 (socket says 172.21.15.164:58188) 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.079+0000 7f2319f83640 1 -- 172.21.15.164:0/1494578018 learned_addr learned my addr 172.21.15.164:0/1494578018 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f2319f83640 1 -- 172.21.15.164:0/1494578018 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6d958f0 con 0x555bb6d94f00 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f2319f83640 1 --2- 172.21.15.164:0/1494578018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2314018430 tx=0x7f2314014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6cffe19475bcd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f21fcff9640 1 -- 172.21.15.164:0/1494578018 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f231404b070 con 0x555bb6d94f00 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f21fcff9640 1 -- 172.21.15.164:0/1494578018 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314051070 con 0x555bb6d94f00 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f21fcff9640 1 -- 172.21.15.164:0/1494578018 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2314011da0 con 0x555bb6d94f00 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 -- 172.21.15.164:0/1494578018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 msgr2=0x555bb6d95300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 --2- 172.21.15.164:0/1494578018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2314018430 tx=0x7f2314014ea0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 -- 172.21.15.164:0/1494578018 shutdown_connections 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 --2- 172.21.15.164:0/1494578018 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d95300 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 -- 172.21.15.164:0/1494578018 >> 172.21.15.164:0/1494578018 conn(0x555bb6d91320 msgr2=0x555bb6d8f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 -- 172.21.15.164:0/1494578018 shutdown_connections 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.080+0000 7f231bc98800 1 -- 172.21.15.164:0/1494578018 wait complete. 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f231bc98800 1 Processor -- start 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f231bc98800 1 -- start start 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f231bc98800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f231bc98800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x555bb6d95f10 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f2319f83640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58204/0 (socket says 172.21.15.164:58204) 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 learned_addr learned my addr 172.21.15.164:0/698562529 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bb6d9ca90 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f2319f83640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2314053420 tx=0x7f23140544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.081+0000 7f21eeffd640 1 -- 172.21.15.164:0/698562529 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f231404b040 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f21eeffd640 1 -- 172.21.15.164:0/698562529 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314031030 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bb6d9cd20 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f21eeffd640 1 -- 172.21.15.164:0/698562529 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23140168f0 con 0x555bb6d94f00 2024-09-14T10:57:12.085 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bb6d9d6a0 con 0x555bb6d94f00 2024-09-14T10:57:12.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f21eeffd640 1 -- 172.21.15.164:0/698562529 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f2314011330 con 0x555bb6d94f00 2024-09-14T10:57:12.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.082+0000 7f21eeffd640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21e403cdc0 0x7f21e403f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f21eeffd640 1 -- 172.21.15.164:0/698562529 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f231400e040 con 0x555bb6d94f00 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f2319782640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21e403cdc0 0x7f21e403f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f2319782640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21e403cdc0 0x7f21e403f280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f230c0514a0 tx=0x7f230c06ff90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6da82f0 0x555bb6daa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6daaf00 con 0x555bb6da82f0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.083+0000 7f2318f81640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6da82f0 0x555bb6daa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f2318f81640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6da82f0 0x555bb6daa7b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304010580 con 0x555bb6da82f0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 realm 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6da7640 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304010580 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6dab9f0 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2304010580 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.084+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6dac2c0 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2304010580 con 0x555bb6da82f0 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:12.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6dacce0 0x555bb6daf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6daf810 con 0x555bb6dacce0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f2319f83640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6dacce0 0x555bb6daf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f2319f83640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6dacce0 0x555bb6daf0d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f231403e070 con 0x555bb6dacce0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 20 searching for the correct realm 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.085+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f231403e070 con 0x555bb6dacce0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319f83640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2314059040 0x7f2314001770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319782640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2314059040 0x7f2314001770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319782640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2314059040 0x7f2314001770 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319782640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f230c08f070 0x7f230c077590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.086+0000 7f2318f81640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f230c08f070 0x7f230c077590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f230c08f070 0x7f230c077590 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304010580 con 0x7f230c08f070 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2304010580 con 0x555bb6da82f0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.087+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f231403e070 con 0x555bb6dacce0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.088+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f231403e070 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.089+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f231403e070 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.090+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.091+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.092+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6dacce0 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f230c08f070 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.093+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x555bb6da82f0 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1120 con 0x7f2314059040 2024-09-14T10:57:12.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.094+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db01d0 con 0x555bb6da82f0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db0a70 con 0x555bb6da82f0 2024-09-14T10:57:12.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db15a0 con 0x555bb6da82f0 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 zone default found 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 4 Realm: () 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 zonegroup default 2024-09-14T10:57:12.108 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.095+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db1940 con 0x7f230c08f070 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db37e0 con 0x555bb6dacce0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db3b80 con 0x555bb6dacce0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.109 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 started sync module instance, tier type = 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.096+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db2c70 con 0x7f2314059040 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.097+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.097+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93852398202976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db28d0 con 0x7f2314059040 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.097+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db4ab0 con 0x555bb6da82f0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.098+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93852398202976] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.099+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.099+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93852398208512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db4ed0 con 0x555bb6da82f0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.099+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db5890 con 0x555bb6dacce0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.100+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.100+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93852398212064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db5cf0 con 0x555bb6dacce0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.100+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db6810 con 0x7f2314059040 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.100+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93852398208512] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.101+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93852398212064] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.101+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.101+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93852398215904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db5800 con 0x7f2314059040 2024-09-14T10:57:12.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.101+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db7220 con 0x555bb6da82f0 2024-09-14T10:57:12.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.102+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93852398215904] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.102+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.102+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93852398218608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db7640 con 0x555bb6da82f0 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.102+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db8000 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.103+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.103+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93852398222160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db8420 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.103+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db8e50 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.103+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93852398218608] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.104+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93852398222160] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.104+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.104+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93852398225760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db7f70 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.104+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db9470 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93852398225760] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93852398219664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db9470 con 0x7f230c08f070 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=0 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=1 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=2 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=3 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=4 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=5 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.105+0000 7f231bc98800 20 add_watcher() i=6 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93852398219664] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f231bc98800 20 add_watcher() i=7 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f231bc98800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6dbc6e0 con 0x555bb6da82f0 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.106+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93852398227760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6db9a00 con 0x555bb6da82f0 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.107+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93852398227760] v37'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f21cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 5 note: GC not initialized 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f21ce7e4640 20 reqs_thread_entry: start 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 20 Filter name: none 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f213ffff640 20 reqs_thread_entry: start 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.108+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6defa40 con 0x7f230c08f070 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.118 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f231bc98800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f231bc98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f231bc98800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f231bc98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.109+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6df5f60 con 0x7f230c08f070 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f231bc98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f231bc98800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f231bc98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93852398475552 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bb6df1580 con 0x555bb6da82f0 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 93852398218608 notify 158913789982 ret 0) ==== 691+0+0 (crc 0 0 0) 0x555bb6c74490 con 0x555bb6da82f0 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f21fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789982 cookie 93852398218608 notifier 4926 bl.length()=649 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f21fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:12.119 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f21fcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 93852398475552 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f21fcff9640 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f21dc003ea0 con 0x555bb6da82f0 2024-09-14T10:57:12.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.110+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.111+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== watch-notify(notify_complete (2) cookie 93852398475552 notify 158913789982 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f230403bbe0 con 0x555bb6da82f0 2024-09-14T10:57:12.120 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.111+0000 7f21cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.111+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93852398227760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x555bb6da82f0 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.112+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93852398227760] v37'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.113+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93852398202976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x7f2314059040 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.113+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93852398202976] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.114+0000 7f231bc98800 20 remove_watcher() i=0 2024-09-14T10:57:12.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.114+0000 7f231bc98800 2 removed watcher, disabling cache 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.114+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93852398208512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x555bb6da82f0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.115+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93852398208512] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.115+0000 7f231bc98800 20 remove_watcher() i=1 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.115+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93852398212064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x555bb6dacce0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.116+0000 7f2319f83640 1 -- 172.21.15.164:0/698562529 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93852398212064] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2314066040 con 0x555bb6dacce0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.116+0000 7f231bc98800 20 remove_watcher() i=2 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.116+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93852398215904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x7f2314059040 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.117+0000 7f2319782640 1 -- 172.21.15.164:0/698562529 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93852398215904] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230c057030 con 0x7f2314059040 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.117+0000 7f231bc98800 20 remove_watcher() i=3 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.117+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93852398218608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x555bb6da82f0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.118+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93852398218608] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x555bb6da82f0 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.118+0000 7f231bc98800 20 remove_watcher() i=4 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.118+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93852398222160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x7f230c08f070 2024-09-14T10:57:12.126 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.119+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93852398222160] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.119+0000 7f231bc98800 20 remove_watcher() i=5 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.119+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93852398225760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x7f230c08f070 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.120+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93852398225760] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.120+0000 7f231bc98800 20 remove_watcher() i=6 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.120+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93852398219664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bb6ded7c0 con 0x7f230c08f070 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93852398219664] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f230402a040 con 0x7f230c08f070 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 20 remove_watcher() i=7 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f230c08f070 msgr2=0x7f230c077590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f230c08f070 0x7f230c077590 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6da82f0 msgr2=0x555bb6daa7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6da82f0 0x555bb6daa7b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2314059040 msgr2=0x7f2314001770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f2314059040 0x7f2314001770 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.127 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6dacce0 msgr2=0x555bb6daf0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.121+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6dacce0 0x555bb6daf0d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21e403cdc0 msgr2=0x7f21e403f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21e403cdc0 0x7f21e403f280 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f230c0514a0 tx=0x7f230c06ff90 comp rx=0 tx=0).stop 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 msgr2=0x555bb6d9c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2314053420 tx=0x7f23140544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f2318f81640 1 -- 172.21.15.164:0/698562529 reap_dead start 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 shutdown_connections 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/698562529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d94f00 0x555bb6d9c530 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 >> 172.21.15.164:0/698562529 conn(0x555bb6d91320 msgr2=0x555bb6d8f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 shutdown_connections 2024-09-14T10:57:12.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/698562529 wait complete. 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 msgr2=0x7f21f003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 0x7f21f003f320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x555bb6d6f560 tx=0x7f230c067040 comp rx=0 tx=0).stop 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 msgr2=0x555bb6d888e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x555bb6d6e440 tx=0x7f2314018830 comp rx=0 tx=0).stop 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 shutdown_connections 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f21f003ce60 0x7f21f003f320 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/199216607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6d884c0 0x555bb6d888e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 >> 172.21.15.164:0/199216607 conn(0x555bb6d7c870 msgr2=0x555bb6d7cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 shutdown_connections 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/199216607 wait complete. 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 msgr2=0x555bb6d74a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 0x555bb6d74a90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 msgr2=0x555bb6d79320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.122+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 0x555bb6d79320 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 msgr2=0x7f220003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 0x7f220003f320 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2304001e50 tx=0x7f23040013d0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 msgr2=0x555bb6d6d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f230c0460d0 tx=0x7f230c002fb0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 shutdown_connections 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x555bb6d76eb0 0x555bb6d79320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x555bb6c738d0 0x555bb6d74a90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f220003ce60 0x7f220003f320 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 --2- 172.21.15.164:0/1428897804 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555bb6c727b0 0x555bb6d6d440 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 >> 172.21.15.164:0/1428897804 conn(0x555bb6c6dfa0 msgr2=0x555bb6d5c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 shutdown_connections 2024-09-14T10:57:12.130 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.123+0000 7f231bc98800 1 -- 172.21.15.164:0/1428897804 wait complete. 2024-09-14T10:57:12.132 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.132 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.132 ERROR:root:0 2024-09-14T10:57:12.132 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:12.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-14T10:57:12.132 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-14T10:57:12.179 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:12.179 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:12.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366a537800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b4182c3030 0x55b4183523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.180 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366a537800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4183566f0 con 0x55b4183529f0 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366a537800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x55b4181da7d0 con 0x55b4182c3030 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366627d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b4182c3030 0x55b4183523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366627d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x55b4182c3030 0x55b4183523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58208/0 (socket says 172.21.15.164:58208) 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f366627d640 1 -- 172.21.15.164:0/3689045820 learned_addr learned my addr 172.21.15.164:0/3689045820 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.182+0000 7f365ffff640 1 --1- 172.21.15.164:0/3689045820 >> v1:172.21.15.116:6789/0 conn(0x55b4183529f0 0x55b418354e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:58416/0 (socket says 172.21.15.164:58416) 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.183+0000 7f366627d640 1 -- 172.21.15.164:0/3689045820 >> v1:172.21.15.116:6789/0 conn(0x55b4183529f0 legacy=0x55b418354e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.183+0000 7f3665a7c640 1 -- 172.21.15.164:0/3689045820 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952610367 0 0) 0x55b4183566f0 con 0x55b4183529f0 2024-09-14T10:57:12.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.183+0000 7f366627d640 1 -- 172.21.15.164:0/3689045820 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418357920 con 0x55b4182c3030 2024-09-14T10:57:12.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.184+0000 7f366627d640 1 --2- 172.21.15.164:0/3689045820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b4183523f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f365800a520 tx=0x7f3658045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faea7ed686c6b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.184+0000 7f3665a7c640 1 -- 172.21.15.164:0/3689045820 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658055070 con 0x55b4182c3030 2024-09-14T10:57:12.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.184+0000 7f3665a7c640 1 -- 172.21.15.164:0/3689045820 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580515b0 con 0x55b4182c3030 2024-09-14T10:57:12.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.184+0000 7f3665a7c640 1 -- 172.21.15.164:0/3689045820 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580518d0 con 0x55b4182c3030 2024-09-14T10:57:12.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 -- 172.21.15.164:0/3689045820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 msgr2=0x55b4183523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 --2- 172.21.15.164:0/3689045820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b4183523f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f365800a520 tx=0x7f3658045ba0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 -- 172.21.15.164:0/3689045820 shutdown_connections 2024-09-14T10:57:12.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 --2- 172.21.15.164:0/3689045820 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b4183523f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 -- 172.21.15.164:0/3689045820 >> 172.21.15.164:0/3689045820 conn(0x55b418349fa0 msgr2=0x55b41834c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 -- 172.21.15.164:0/3689045820 shutdown_connections 2024-09-14T10:57:12.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.185+0000 7f366a537800 1 -- 172.21.15.164:0/3689045820 wait complete. 2024-09-14T10:57:12.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366a537800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366a537800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b4181e7dd0 con 0x55b4182c3030 2024-09-14T10:57:12.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366627d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366627d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58210/0 (socket says 172.21.15.164:58210) 2024-09-14T10:57:12.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.199+0000 7f366627d640 1 -- 172.21.15.164:0/2986976378 learned_addr learned my addr 172.21.15.164:0/2986976378 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.200+0000 7f366627d640 1 -- 172.21.15.164:0/2986976378 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418350160 con 0x55b4182c3030 2024-09-14T10:57:12.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.200+0000 7f366627d640 1 --2- 172.21.15.164:0/2986976378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3658045be0 tx=0x7f3658051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178778a69fe66d6a server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.200+0000 7f3554608640 1 -- 172.21.15.164:0/2986976378 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658051ac0 con 0x55b4182c3030 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.200+0000 7f3554608640 1 -- 172.21.15.164:0/2986976378 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658051c60 con 0x55b4182c3030 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.200+0000 7f3554608640 1 -- 172.21.15.164:0/2986976378 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658066460 con 0x55b4182c3030 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- 172.21.15.164:0/2986976378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 msgr2=0x55b41834fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 --2- 172.21.15.164:0/2986976378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3658045be0 tx=0x7f3658051000 comp rx=0 tx=0).stop 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- 172.21.15.164:0/2986976378 shutdown_connections 2024-09-14T10:57:12.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 --2- 172.21.15.164:0/2986976378 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b41834fb70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- 172.21.15.164:0/2986976378 >> 172.21.15.164:0/2986976378 conn(0x55b418349fa0 msgr2=0x55b41843afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- 172.21.15.164:0/2986976378 shutdown_connections 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- 172.21.15.164:0/2986976378 wait complete. 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366a537800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b418356bc0 con 0x55b4182c3030 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366627d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366627d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58212/0 (socket says 172.21.15.164:58212) 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.201+0000 7f366627d640 1 -- 172.21.15.164:0/2573557524 learned_addr learned my addr 172.21.15.164:0/2573557524 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f366627d640 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418449870 con 0x55b4182c3030 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f366627d640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3658045be0 tx=0x7f3658003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f3552e05640 1 -- 172.21.15.164:0/2573557524 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365805a600 con 0x55b4182c3030 2024-09-14T10:57:12.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f3552e05640 1 -- 172.21.15.164:0/2573557524 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365805a7a0 con 0x55b4182c3030 2024-09-14T10:57:12.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f3552e05640 1 -- 172.21.15.164:0/2573557524 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365805aa80 con 0x55b4182c3030 2024-09-14T10:57:12.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b418449b00 con 0x55b4182c3030 2024-09-14T10:57:12.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.202+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b41844a500 con 0x55b4182c3030 2024-09-14T10:57:12.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f3552e05640 1 -- 172.21.15.164:0/2573557524 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3658058070 con 0x55b4182c3030 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f3552e05640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 0x7f354c03f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f3552e05640 1 -- 172.21.15.164:0/2573557524 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f3658062070 con 0x55b4182c3030 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f365ffff640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 0x7f354c03f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 0x55b418450960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418450ea0 con 0x55b4183529f0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 0x55b418450960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.203+0000 7f365ffff640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 0x7f354c03f320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3650000c00 tx=0x7f36500013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 0x55b418450960 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f3666a7e640 1 -- 172.21.15.164:0/2573557524 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f366000a4d0 con 0x55b4183529f0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418451240 con 0x55b4183529f0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f3666a7e640 1 -- 172.21.15.164:0/2573557524 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f366000a4d0 con 0x55b4183529f0 2024-09-14T10:57:12.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 0x55b4184551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418455930 con 0x55b418452d00 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f366627d640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 0x55b4184551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.204+0000 7f366627d640 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 0x55b4184551a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.205+0000 7f366627d640 1 -- 172.21.15.164:0/2573557524 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3658057030 con 0x55b418452d00 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.205+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418451a90 con 0x55b4183529f0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.205+0000 7f3666a7e640 1 -- 172.21.15.164:0/2573557524 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f366000a4d0 con 0x55b4183529f0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.205+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418451e70 con 0x55b4183529f0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.205+0000 7f3666a7e640 1 -- 172.21.15.164:0/2573557524 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f366000a4d0 con 0x55b4183529f0 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f366a537800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f366a537800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b4182464a0 con 0x55b418464340 2024-09-14T10:57:12.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58220/0 (socket says 172.21.15.164:58220) 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f3666a7e640 1 -- 172.21.15.164:0/3812625570 learned_addr learned my addr 172.21.15.164:0/3812625570 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f3666a7e640 1 -- 172.21.15.164:0/3812625570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418464da0 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.206+0000 7f3666a7e640 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x55b41844a310 tx=0x7f3660018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f354bfff640 1 -- 172.21.15.164:0/3812625570 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3660014450 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f354bfff640 1 -- 172.21.15.164:0/3812625570 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660014610 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4184655d0 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f354bfff640 1 -- 172.21.15.164:0/3812625570 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3660014930 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b418465b70 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.207+0000 7f354bfff640 1 -- 172.21.15.164:0/3812625570 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3660011040 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f354bfff640 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 0x7f354003f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f354bfff640 1 -- 172.21.15.164:0/3812625570 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f366001e070 con 0x55b418464340 2024-09-14T10:57:12.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366627d640 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 0x7f354003f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366627d640 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 0x7f354003f320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55b41844b3e0 tx=0x7f3658066f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366a537800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f366a537800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b41834e500 con 0x55b418470da0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58224/0 (socket says 172.21.15.164:58224) 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.208+0000 7f3666a7e640 1 -- 172.21.15.164:0/298901931 learned_addr learned my addr 172.21.15.164:0/298901931 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f3666a7e640 1 -- 172.21.15.164:0/298901931 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418471790 con 0x55b418470da0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f3666a7e640 1 --2- 172.21.15.164:0/298901931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3660018430 tx=0x7f3660014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8c0033ae961ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f3549ffb640 1 -- 172.21.15.164:0/298901931 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366004b070 con 0x55b418470da0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f3549ffb640 1 -- 172.21.15.164:0/298901931 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660051070 con 0x55b418470da0 2024-09-14T10:57:12.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f3549ffb640 1 -- 172.21.15.164:0/298901931 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3660011da0 con 0x55b418470da0 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 -- 172.21.15.164:0/298901931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 msgr2=0x55b4184711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 --2- 172.21.15.164:0/298901931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3660018430 tx=0x7f3660014ea0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 -- 172.21.15.164:0/298901931 shutdown_connections 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 --2- 172.21.15.164:0/298901931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184711a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 -- 172.21.15.164:0/298901931 >> 172.21.15.164:0/298901931 conn(0x55b41846d1a0 msgr2=0x55b41846b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 -- 172.21.15.164:0/298901931 shutdown_connections 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.209+0000 7f366a537800 1 -- 172.21.15.164:0/298901931 wait complete. 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f366a537800 1 Processor -- start 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f366a537800 1 -- start start 2024-09-14T10:57:12.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f366a537800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f366a537800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x55b418471db0 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f3666a7e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:58240/0 (socket says 172.21.15.164:58240) 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 learned_addr learned my addr 172.21.15.164:0/2313966658 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b418478910 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.210+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3660053420 tx=0x7f36600544e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.211+0000 7f3537fff640 1 -- 172.21.15.164:0/2313966658 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366004b040 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.211+0000 7f3537fff640 1 -- 172.21.15.164:0/2313966658 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660031030 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.211+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b418478ba0 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.211+0000 7f3537fff640 1 -- 172.21.15.164:0/2313966658 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3660056070 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.211+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b418479520 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f3537fff640 1 -- 172.21.15.164:0/2313966658 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f3660011330 con 0x55b418470da0 2024-09-14T10:57:12.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f3537fff640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f353003cdc0 0x7f353003f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f3537fff640 1 -- 172.21.15.164:0/2313966658 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f366000e040 con 0x55b418470da0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f366627d640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f353003cdc0 0x7f353003f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b418484170 0x55b418486630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418486d80 con 0x55b418484170 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f366627d640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f353003cdc0 0x7f353003f280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3658051fd0 tx=0x7f3658089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.212+0000 7f365ffff640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b418484170 0x55b418486630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f365ffff640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b418484170 0x55b418486630 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f365000f5f0 con 0x55b418484170 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 realm 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b4184834c0 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f365000f5f0 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418487870 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f365000f5f0 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.213+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418488140 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f365000f5f0 con 0x55b418484170 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418488b60 0x55b41848af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848b6c0 con 0x55b418488b60 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418488b60 0x55b41848af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418488b60 0x55b41848af50 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 20 searching for the correct realm 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b41848cfb0 con 0x55b418488b60 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.214+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f3666a7e640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3660014070 0x7f3660045050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f366627d640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3660014070 0x7f3660045050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f366627d640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3660014070 0x7f3660045050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f366627d640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f365805a070 0x7f365808d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.215+0000 7f365ffff640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f365805a070 0x7f365808d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f365805a070 0x7f365808d960 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365000f5f0 con 0x7f365805a070 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365000f5f0 con 0x55b418484170 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.216+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.217+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.218+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.219+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.220+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x55b418484170 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.221+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418488b60 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f365805a070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002b040 con 0x7f365805a070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.222+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x55b418484170 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7f3660057080 con 0x7f3660014070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:57:12.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848c080 con 0x55b418484170 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848c920 con 0x55b418484170 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:12.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.223+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848d430 con 0x55b418484170 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 zone default found 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 4 Realm: () 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 zonegroup default 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848d7d0 con 0x7f365805a070 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848f670 con 0x55b418488b60 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.224+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b41848fa10 con 0x55b418488b60 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.225+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.225+0000 7f366a537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.225+0000 7f366a537800 20 started sync module instance, tier type = 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.225+0000 7f366a537800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.225+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b41848eab0 con 0x7f3660014070 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.226+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.226+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94231989904896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b41848fe00 con 0x7f3660014070 2024-09-14T10:57:12.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.226+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418490650 con 0x55b418484170 2024-09-14T10:57:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.227+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94231989904896] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.227+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.227+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94231989911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418490a70 con 0x55b418484170 2024-09-14T10:57:12.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.227+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418491300 con 0x55b418488b60 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.228+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.228+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94231989914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418490f10 con 0x55b418488b60 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.228+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184922d0 con 0x7f3660014070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.229+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94231989911968] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.229+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94231989914224] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.230+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.230+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94231989917424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184905c0 con 0x7f3660014070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.230+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418492b70 con 0x55b418484170 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.231+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94231989917424] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.231+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.231+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94231989921472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418492ae0 con 0x55b418484170 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.231+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418493a60 con 0x7f365805a070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.232+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.232+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94231989925296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418493e80 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.232+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184948c0 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.232+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94231989921472] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.233+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94231989925296] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.233+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(56 notify.6 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.233+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94231989928848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418492f60 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.233+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418494ea0 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94231989928848] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94231989926352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418494ea0 con 0x7f365805a070 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=0 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=1 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=2 2024-09-14T10:57:12.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=3 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=4 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=5 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.234+0000 7f366a537800 20 add_watcher() i=6 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94231989926352] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f366a537800 20 add_watcher() i=7 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f366a537800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b418498110 con 0x55b418484170 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.235+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94231989930848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b418495430 con 0x55b418484170 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94231989930848] v37'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f365003b040 con 0x55b418484170 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f351cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f366a537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:12.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f366a537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f366a537800 5 note: GC not initialized 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.236+0000 7f34977fe640 20 reqs_thread_entry: start 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f366a537800 20 init_complete bucket index max shards: 11 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f366a537800 20 Filter name: none 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f34957fa640 20 reqs_thread_entry: start 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f366a537800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f366a537800 20 rados->read ofs=0 len=0 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.237+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b4184cb490 con 0x7f365805a070 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f366a537800 20 rados_obj.operate() r=0 bl.length=473 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f366a537800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f366a537800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f366a537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.238+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184d1ce0 con 0x7f365805a070 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.239+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f365003b040 con 0x7f365805a070 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.239+0000 7f366a537800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.239+0000 7f366a537800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.239+0000 7f366a537800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.239+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94231990179488 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b4184cd2c0 con 0x55b418484170 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== watch-notify(notify (1) cookie 94231989921472 notify 158913789983 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f3650018040 con 0x55b418484170 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f3549ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 94231989921472 notifier 4933 bl.length()=649 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f3549ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f3549ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(64 notify.4 [notify cookie 94231990179488 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3650041020 con 0x55b418484170 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f3549ffb640 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f352c003ea0 con 0x55b418484170 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== watch-notify(notify_complete (2) cookie 94231990179488 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f365001e930 con 0x55b418484170 2024-09-14T10:57:12.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.240+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x55b418484170 2024-09-14T10:57:12.248 INFO:teuthology.orchestra.run.smithi164.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-14T10:57:10.357050Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-14T10:57:10.357033Z","tags":[],"group_ids":[]} 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.241+0000 7f351cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.241+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94231989930848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x55b418484170 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.242+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94231989930848] v37'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3650041020 con 0x55b418484170 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.242+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94231989904896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x7f3660014070 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.243+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94231989904896] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.243+0000 7f366a537800 20 remove_watcher() i=0 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.243+0000 7f366a537800 2 removed watcher, disabling cache 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.243+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94231989911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x55b418484170 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.244+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94231989911968] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x55b418484170 2024-09-14T10:57:12.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.244+0000 7f366a537800 20 remove_watcher() i=1 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.244+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94231989914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x55b418488b60 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.245+0000 7f3666a7e640 1 -- 172.21.15.164:0/2313966658 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94231989914224] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f366003e070 con 0x55b418488b60 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.245+0000 7f366a537800 20 remove_watcher() i=2 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.245+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94231989917424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x7f3660014070 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.246+0000 7f366627d640 1 -- 172.21.15.164:0/2313966658 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94231989917424] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3658057030 con 0x7f3660014070 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.246+0000 7f366a537800 20 remove_watcher() i=3 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.246+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94231989921472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x55b418484170 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.247+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94231989921472] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x55b418484170 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.247+0000 7f366a537800 20 remove_watcher() i=4 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.247+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94231989925296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x7f365805a070 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.248+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94231989925296] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x7f365805a070 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.248+0000 7f366a537800 20 remove_watcher() i=5 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.248+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94231989928848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x7f365805a070 2024-09-14T10:57:12.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.249+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94231989928848] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x7f365805a070 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.249+0000 7f366a537800 20 remove_watcher() i=6 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.249+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94231989926352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b4184c9250 con 0x7f365805a070 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94231989926352] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650041020 con 0x7f365805a070 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 20 remove_watcher() i=7 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f365805a070 msgr2=0x7f365808d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f365805a070 0x7f365808d960 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b418484170 msgr2=0x55b418486630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b418484170 0x55b418486630 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3660014070 msgr2=0x7f3660045050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7f3660014070 0x7f3660045050 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418488b60 msgr2=0x55b41848af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418488b60 0x55b41848af50 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f353003cdc0 msgr2=0x7f353003f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f353003cdc0 0x7f353003f280 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3658051fd0 tx=0x7f3658089000 comp rx=0 tx=0).stop 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 msgr2=0x55b4184783b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f365ffff640 1 -- 172.21.15.164:0/2313966658 reap_dead start 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3660053420 tx=0x7f36600544e0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.250+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 shutdown_connections 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/2313966658 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418470da0 0x55b4184783b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 >> 172.21.15.164:0/2313966658 conn(0x55b41846d1a0 msgr2=0x55b41846b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 shutdown_connections 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2313966658 wait complete. 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 msgr2=0x7f354003f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 0x7f354003f320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55b41844b3e0 tx=0x7f3658066f90 comp rx=0 tx=0).stop 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 msgr2=0x55b418464760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x55b41844a310 tx=0x7f3660018830 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 shutdown_connections 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354003ce60 0x7f354003f320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/3812625570 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b418464340 0x55b418464760 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 >> 172.21.15.164:0/3812625570 conn(0x55b4184586f0 msgr2=0x55b418458ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 shutdown_connections 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/3812625570 wait complete. 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 msgr2=0x55b418450960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 0x55b418450960 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 msgr2=0x55b4184551a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 0x55b4184551a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 msgr2=0x7f354c03f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 0x7f354c03f320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3650000c00 tx=0x7f36500013b0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 msgr2=0x55b418449310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.251+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3658045be0 tx=0x7f3658003020 comp rx=0 tx=0).stop 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 shutdown_connections 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x55b418452d00 0x55b4184551a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x55b4183529f0 0x55b418450960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f354c03ce60 0x7f354c03f320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 --2- 172.21.15.164:0/2573557524 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b4182c3030 0x55b418449310 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 >> 172.21.15.164:0/2573557524 conn(0x55b418349fa0 msgr2=0x55b41843ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 shutdown_connections 2024-09-14T10:57:12.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:57:12.252+0000 7f366a537800 1 -- 172.21.15.164:0/2573557524 wait complete. 2024-09-14T10:57:12.259 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.259 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-14T10:57:10.357050Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-14T10:57:10.357033Z', 'tags': [], 'group_ids': []} 2024-09-14T10:57:12.259 ERROR:root:0 2024-09-14T10:57:12.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-14T10:57:12.267 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.267 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.271 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.271 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-14T10:57:12.277 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.280 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-14T10:57:12.289 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-14T10:57:12.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.292 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-14T10:57:12.299 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.303 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-14T10:57:12.310 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-14T10:57:12.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.314 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-14T10:57:12.325 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-14T10:57:12.325 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.329 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-14T10:57:12.337 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.338 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.341 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-14T10:57:12.346 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.347 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.350 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.350 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-14T10:57:12.357 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.358 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.361 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.362 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.365 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:57:12.366 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-14T10:57:12.370 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:57:12.384 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-14T10:57:12.391 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-14T10:57:12.391 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:57:12.395 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:57:12.381829Z', 'creation_time': '2024-09-14T10:57:12.377144Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:57:12.396 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-14T10:57:12.400 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:57:12.381829Z', 'creation_time': '2024-09-14T10:57:12.377144Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-14T10:57:12.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:57:12.409 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:57:12.381829Z', 'creation_time': '2024-09-14T10:57:12.377144Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-14T10:57:12.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-14T10:57:12.413 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000fef79fcdea5e7336-0066e56c08-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:57:12.417 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-14T10:57:12.424 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-14T10:57:12.432 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:57:12.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11'} 2024-09-14T10:57:12.495 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.500 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11'} 2024-09-14T10:57:12.510 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.510 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-14T10:57:12.519 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.528 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-14T10:57:12.535 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:57:12.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-14T10:57:12.540 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'c136da01-f20d-479c-ad02-fc389f5894e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'marker': '4d2cef0f-8511-4251-8070-7385f93096af.4241.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-14T10:57:12.508831Z', 'creation_time': '2024-09-14T10:57:12.377144Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-14T10:58:12.585 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-14T10:58:12.605 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.606 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-14T10:58:12.620 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-14T10:58:12.625 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-14T10:58:12.630 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.630 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-14T10:58:12.634 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.635 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-14T10:58:12.638 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-14T10:58:12.643 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-14T10:00:00.000000Z', 'epoch': 1726308000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-14T10:58:12.643 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-14T10:58:12.650 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:12.650 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-14T10:58:12.655 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-14T10:58:12.655 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-14T10:58:12.664 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:58:12.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-14T10:58:12.678 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:58:12.934 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-14T10:58:12.939 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000a07477277aa6180b-0066e56c44-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.042 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-14T10:58:13.047 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-14T10:58:13.051 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-14T10:58:13.055 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-14T10:58:13.173 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-14T10:58:13.216 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:13.216 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-14T10:58:13.222 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-14T10:58:13.222 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-14T10:58:13.228 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-14T10:58:13.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-14T10:58:13.247 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000009fcd1969a54d0619-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-14T10:58:13.295 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:13.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-14T10:58:13.299 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000c0a35dfbc8543348-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-14T10:58:13.303 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '7b7ae84a-db16-40d6-b8d8-00c489fcd057'}]}} 2024-09-14T10:58:13.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-14T10:58:13.313 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-14T10:58:13.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-14T10:58:13.317 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:58:13.317 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-14T10:58:13.322 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000007b98252995010329-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.322 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-14T10:58:13.325 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fda1779370e0e16e-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.335 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-14T10:58:13.339 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:58:13.340 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-14T10:58:13.343 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000000c96c7a24bbde963-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-14T10:58:13.347 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000cc80cce50617cb73-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.347 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-14T10:58:13.351 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-14T10:58:13.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-14T10:58:13.355 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000a2d675074fe31d3d-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-14T10:58:13.359 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000009ecb0c78ce15f466-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-14T10:58:13.365 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000004bc48000744e95f5-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.365 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-14T10:58:13.369 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fc3b696ad0220eca-0066e56c45-4241-default', 'HostId': '4241-default-default'} 2024-09-14T10:58:13.369 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-14T10:58:13.378 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:13.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-14T10:58:13.383 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-14T10:58:13.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-14T10:58:13.389 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:13.389 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-14T10:58:13.393 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-14T10:58:13.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-14T10:58:13.398 INFO:tasks.radosgw_admin_rest: empty result 2024-09-14T10:58:13.402 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T10:58:13.412 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T10:58:13.412 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T10:58:13.413 INFO:tasks.rgw.client.0.smithi164.stdout:2024-09-14T10:58:13.415+0000 7f64804ed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36290) UID: 0 2024-09-14T10:58:13.413 INFO:tasks.rgw.client.0.smithi164.stdout:2024-09-14T10:58:13.415+0000 7f6483d4d880 -1 shutting down 2024-09-14T10:58:19.513 INFO:tasks.rgw.client.0:Stopped 2024-09-14T10:58:19.514 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T10:58:19.533 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T10:58:19.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T10:58:19.671 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T10:58:19.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T10:58:19.672 DEBUG:teuthology.orchestra.run.smithi164:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T10:58:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:58:19.759 INFO:teuthology.orchestra.run.smithi164.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:58:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe30098800 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562dae914ef0 0x562dae9a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe30098800 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562dae9a86e0 con 0x562dae9a4a30 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe30098800 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x562dae82c7d0 con 0x562dae914ef0 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe2db82640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562dae914ef0 0x562dae9a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe2db82640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x562dae914ef0 0x562dae9a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56910/0 (socket says 172.21.15.164:56910) 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe2db82640 1 -- 172.21.15.164:0/2889764422 learned_addr learned my addr 172.21.15.164:0/2889764422 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.762+0000 7fbe2d381640 1 --1- 172.21.15.164:0/2889764422 >> v1:172.21.15.116:6789/0 conn(0x562dae9a4a30 0x562dae9a6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.164:57702/0 (socket says 172.21.15.164:57702) 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.763+0000 7fbe2db82640 1 -- 172.21.15.164:0/2889764422 >> v1:172.21.15.116:6789/0 conn(0x562dae9a4a30 legacy=0x562dae9a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.763+0000 7fbe2db82640 1 -- 172.21.15.164:0/2889764422 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dae9a9910 con 0x562dae914ef0 2024-09-14T10:58:19.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe2db82640 1 --2- 172.21.15.164:0/2889764422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562dae9a44f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000a520 tx=0x7fbe20045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd552231cb4baba server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe2cb80640 1 -- 172.21.15.164:0/2889764422 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe20055070 con 0x562dae914ef0 2024-09-14T10:58:19.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe2cb80640 1 -- 172.21.15.164:0/2889764422 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200515b0 con 0x562dae914ef0 2024-09-14T10:58:19.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe2cb80640 1 -- 172.21.15.164:0/2889764422 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe200518d0 con 0x562dae914ef0 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 -- 172.21.15.164:0/2889764422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 msgr2=0x562dae9a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 --2- 172.21.15.164:0/2889764422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562dae9a44f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbe2000a520 tx=0x7fbe20045ba0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 -- 172.21.15.164:0/2889764422 shutdown_connections 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 --2- 172.21.15.164:0/2889764422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562dae9a44f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 -- 172.21.15.164:0/2889764422 >> 172.21.15.164:0/2889764422 conn(0x562dae99bf80 msgr2=0x562dae99e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 -- 172.21.15.164:0/2889764422 shutdown_connections 2024-09-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.765+0000 7fbe30098800 1 -- 172.21.15.164:0/2889764422 wait complete. 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.780+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.780+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe30098800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe30098800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562dae839dd0 con 0x562dae914ef0 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe2db82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe2db82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56926/0 (socket says 172.21.15.164:56926) 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe2db82640 1 -- 172.21.15.164:0/1758733566 learned_addr learned my addr 172.21.15.164:0/1758733566 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe2db82640 1 -- 172.21.15.164:0/1758733566 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562daea93fa0 con 0x562dae914ef0 2024-09-14T10:58:19.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.781+0000 7fbe2db82640 1 --2- 172.21.15.164:0/1758733566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbe20025da0 tx=0x7fbe20051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8bc1b642871653 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbd1be07640 1 -- 172.21.15.164:0/1758733566 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe20051ac0 con 0x562dae914ef0 2024-09-14T10:58:19.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbd1be07640 1 -- 172.21.15.164:0/1758733566 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe20051c60 con 0x562dae914ef0 2024-09-14T10:58:19.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbd1be07640 1 -- 172.21.15.164:0/1758733566 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2005a450 con 0x562dae914ef0 2024-09-14T10:58:19.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 -- 172.21.15.164:0/1758733566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 msgr2=0x562daea939b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 --2- 172.21.15.164:0/1758733566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbe20025da0 tx=0x7fbe20051000 comp rx=0 tx=0).stop 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 -- 172.21.15.164:0/1758733566 shutdown_connections 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 --2- 172.21.15.164:0/1758733566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea939b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 -- 172.21.15.164:0/1758733566 >> 172.21.15.164:0/1758733566 conn(0x562dae99bf80 msgr2=0x562daea8f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 -- 172.21.15.164:0/1758733566 shutdown_connections 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.782+0000 7fbe30098800 1 -- 172.21.15.164:0/1758733566 wait complete. 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe30098800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe30098800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562dae9a8b50 con 0x562dae914ef0 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe2db82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe2db82640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56934/0 (socket says 172.21.15.164:56934) 2024-09-14T10:58:19.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe2db82640 1 -- 172.21.15.164:0/2655570805 learned_addr learned my addr 172.21.15.164:0/2655570805 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.783+0000 7fbe2db82640 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562daea9b8b0 con 0x562dae914ef0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbe2db82640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005570 tx=0x7fbe20002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbd1a604640 1 -- 172.21.15.164:0/2655570805 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe20073070 con 0x562dae914ef0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbd1a604640 1 -- 172.21.15.164:0/2655570805 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2005a6c0 con 0x562dae914ef0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbd1a604640 1 -- 172.21.15.164:0/2655570805 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2005a9a0 con 0x562dae914ef0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562daea9bb40 con 0x562dae914ef0 2024-09-14T10:58:19.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.784+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562daea9c750 con 0x562dae914ef0 2024-09-14T10:58:19.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbd1a604640 1 -- 172.21.15.164:0/2655570805 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbe20076070 con 0x562dae914ef0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbd1a604640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 0x7fbd1403f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbd1a604640 1 -- 172.21.15.164:0/2655570805 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbe20062070 con 0x562dae914ef0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbe2d381640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 0x7fbd1403f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 0x562daeaa29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaa2ee0 con 0x562dae9a4a30 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.785+0000 7fbe2e383640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 0x562daeaa29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe2d381640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 0x7fbd1403f2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x562dae9154b0 tx=0x7fbe240013e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe2e383640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 0x562daeaa29a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe2e383640 1 -- 172.21.15.164:0/2655570805 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2800a4d0 con 0x562dae9a4a30 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaa3280 con 0x562dae9a4a30 2024-09-14T10:58:19.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe2e383640 1 -- 172.21.15.164:0/2655570805 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x562dae9a4a30 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.786+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 0x562daeaa7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.787+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:3 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaa79b0 con 0x562daeaa4d80 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.787+0000 7fbe2db82640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 0x562daeaa7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.787+0000 7fbe2db82640 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 0x562daeaa7220 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.787+0000 7fbe2db82640 1 -- 172.21.15.164:0/2655570805 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(3 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe2007f070 con 0x562daeaa4d80 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.787+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaa3ad0 con 0x562dae9a4a30 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe2e383640 1 -- 172.21.15.164:0/2655570805 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe2800a4d0 con 0x562dae9a4a30 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:5 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaa3f20 con 0x562dae9a4a30 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe2e383640 1 -- 172.21.15.164:0/2655570805 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(5 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe2800a4d0 con 0x562dae9a4a30 2024-09-14T10:58:19.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.788+0000 7fbe30098800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe30098800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562dae8984a0 con 0x562daeab6390 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56946/0 (socket says 172.21.15.164:56946) 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe2e383640 1 -- 172.21.15.164:0/1387166491 learned_addr learned my addr 172.21.15.164:0/1387166491 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe2e383640 1 -- 172.21.15.164:0/1387166491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562daeab6df0 con 0x562daeab6390 2024-09-14T10:58:19.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.789+0000 7fbe2e383640 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800a2a0 tx=0x7fbe28018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.790+0000 7fbd137fe640 1 -- 172.21.15.164:0/1387166491 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28014450 con 0x562daeab6390 2024-09-14T10:58:19.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.790+0000 7fbd137fe640 1 -- 172.21.15.164:0/1387166491 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280145f0 con 0x562daeab6390 2024-09-14T10:58:19.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.790+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562daeab7620 con 0x562daeab6390 2024-09-14T10:58:19.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.790+0000 7fbd137fe640 1 -- 172.21.15.164:0/1387166491 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28014910 con 0x562daeab6390 2024-09-14T10:58:19.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.790+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562daeab7bc0 con 0x562daeab6390 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbd137fe640 1 -- 172.21.15.164:0/1387166491 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbe28011040 con 0x562daeab6390 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbd137fe640 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 0x7fbd0803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbd137fe640 1 -- 172.21.15.164:0/1387166491 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbe2801e070 con 0x562daeab6390 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe2db82640 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 0x7fbd0803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.805 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe2db82640 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 0x7fbd0803f2d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x562daea9d460 tx=0x7fbe20006f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe30098800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.791+0000 7fbe30098800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562daea94310 con 0x562daeac2e30 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56962/0 (socket says 172.21.15.164:56962) 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbe2e383640 1 -- 172.21.15.164:0/2321368420 learned_addr learned my addr 172.21.15.164:0/2321368420 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbe2e383640 1 -- 172.21.15.164:0/2321368420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562daeac3820 con 0x562daeac2e30 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbe2e383640 1 --2- 172.21.15.164:0/2321368420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbe28016fd0 tx=0x7fbe28011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d39a7ec9399418d server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbd117fa640 1 -- 172.21.15.164:0/2321368420 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2804b070 con 0x562daeac2e30 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbd117fa640 1 -- 172.21.15.164:0/2321368420 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28051070 con 0x562daeac2e30 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.792+0000 7fbd117fa640 1 -- 172.21.15.164:0/2321368420 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28022dc0 con 0x562daeac2e30 2024-09-14T10:58:19.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- 172.21.15.164:0/2321368420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 msgr2=0x562daeac3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 --2- 172.21.15.164:0/2321368420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbe28016fd0 tx=0x7fbe28011a80 comp rx=0 tx=0).stop 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- 172.21.15.164:0/2321368420 shutdown_connections 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 --2- 172.21.15.164:0/2321368420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeac3230 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- 172.21.15.164:0/2321368420 >> 172.21.15.164:0/2321368420 conn(0x562daeabf230 msgr2=0x562daeabd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- 172.21.15.164:0/2321368420 shutdown_connections 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- 172.21.15.164:0/2321368420 wait complete. 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 Processor -- start 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- start start 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.793+0000 7fbe30098800 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x562daeac3e40 con 0x562daeac2e30 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe2e383640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.164:56974/0 (socket says 172.21.15.164:56974) 2024-09-14T10:58:19.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 learned_addr learned my addr 172.21.15.164:0/3518089243 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562daeaca9d0 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe2e383640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbe28049040 tx=0x7fbe28054560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbcff7fe640 1 -- 172.21.15.164:0/3518089243 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe2804b040 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbcff7fe640 1 -- 172.21.15.164:0/3518089243 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe280167c0 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562daeacac60 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbcff7fe640 1 -- 172.21.15.164:0/3518089243 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe28011330 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.794+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562daeacb5e0 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.795+0000 7fbcff7fe640 1 -- 172.21.15.164:0/3518089243 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fbe280457a0 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.795+0000 7fbcff7fe640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbcf803ce10 0x7fbcf803f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.795+0000 7fbcff7fe640 1 -- 172.21.15.164:0/3518089243 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fbe2800e040 con 0x562daeac2e30 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe2db82640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbcf803ce10 0x7fbcf803f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe2db82640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbcf803ce10 0x7fbcf803f2d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbe2006ffd0 tx=0x7fbe2008c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562daead6170 0x562daead8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daead8d80 con 0x562daead6170 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe2d381640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562daead6170 0x562daead8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.796+0000 7fbe2d381640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562daead6170 0x562daead8630 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2400f610 con 0x562daead6170 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 realm 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daead54c0 con 0x562daead6170 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2400f610 con 0x562daead6170 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.809 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daead9870 con 0x562daead6170 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2400f610 con 0x562daead6170 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeada140 con 0x562daead6170 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe2400f610 con 0x562daead6170 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:58:19.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeadab60 0x562daeadcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:5 5.0 5:0702f560:::zone_info.4d2cef0f-8511-4251-8070-7385f93096af:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeadd650 con 0x562daeadab60 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.797+0000 7fbe2e383640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeadab60 0x562daeadcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2e383640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeadab60 0x562daeadcf50 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== osd_op_reply(5 zone_info.4d2cef0f-8511-4251-8070-7385f93096af [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe2802a070 con 0x562daeadab60 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe30098800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe30098800 20 searching for the correct realm 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== osd_op_reply(6 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe2802a070 con 0x562daeadab60 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2e383640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbe28037070 0x7fbe28045a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.798+0000 7fbe2db82640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbe28037070 0x7fbe28045a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.799+0000 7fbe2db82640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbe28037070 0x7fbe28045a90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.799+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.799+0000 7fbe2db82640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbe20078070 0x7fbe200645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.799+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.799+0000 7fbe2d381640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbe20078070 0x7fbe200645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.800+0000 7fbe2d381640 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbe20078070 0x7fbe200645d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.800+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2400f610 con 0x7fbe20078070 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.800+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.800+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2400f610 con 0x562daead6170 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.800+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 3 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.801+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 3 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 3 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.802+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 4 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 5 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.803+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 4 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 7 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.804+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=137b] v37'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 5 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 8 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 5 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.805+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 6 ==== osd_op_reply(30 [pgnls start_epoch 37 out=82b] v37'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.806+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 7 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 6 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daeadab60 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 10 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.807+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe20078070 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 8 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x562daead6170 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562daeadef60 con 0x7fbe28037070 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got zone_info.4d2cef0f-8511-4251-8070-7385f93096af 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got period_config.default 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:58:19.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeade010 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.808+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeade860 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:40 5.19 5:98eba2d5:::zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeadf3e0 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 15 ==== osd_op_reply(40 zonegroup_info.c136da01-f20d-479c-ad02-fc389f5894e9 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 zone default found 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 4 Realm: () 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 4 ZoneGroup: default (c136da01-f20d-479c-ad02-fc389f5894e9) 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 4 Zone: default (4d2cef0f-8511-4251-8070-7385f93096af) 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 zonegroup default 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.809+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeadf780 con 0x7fbe20078070 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeae1620 con 0x562daeadab60 2024-09-14T10:58:19.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 rados->read ofs=0 len=0 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeae1a40 con 0x562daeadab60 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 started sync module instance, tier type = 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 20 started zone id=4d2cef0f-8511-4251-8070-7385f93096af (name=default) with tier type = 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.810+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae0ab0 con 0x7fbe28037070 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.811+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 8 ==== osd_op_reply(44 notify.0 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.811+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94754204159648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae0710 con 0x7fbe28037070 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.811+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae2970 con 0x562daead6170 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.812+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94754204159648] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.813+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 16 ==== osd_op_reply(46 notify.1 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.813+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94754204165312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae2d90 con 0x562daead6170 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.813+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae3640 con 0x562daeadab60 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.814+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 13 ==== osd_op_reply(48 notify.2 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.814+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94754204165312] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.814+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94754204166368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae31b0 con 0x562daeadab60 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.814+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae4110 con 0x7fbe28037070 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.815+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 10 ==== osd_op_reply(50 notify.3 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.815+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94754204166368] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.815+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94754204171264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae49e0 con 0x7fbe28037070 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.815+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae2d20 con 0x562daead6170 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.816+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94754204171264] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.817+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 18 ==== osd_op_reply(52 notify.4 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.817+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94754204173616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae5420 con 0x562daead6170 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.817+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae5e20 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.818+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94754204173616] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.818+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 10 ==== osd_op_reply(54 notify.5 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.818+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94754204178736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae5420 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.818+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae6830 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.819+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 11 ==== osd_op_reply(56 notify.6 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.819+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94754204181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae6c50 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.819+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae7730 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.819+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94754204178736] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94754204181376] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 14 ==== osd_op_reply(58 notify.7 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94754204185152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae67a0 con 0x7fbe20078070 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=0 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=1 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=2 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=3 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=4 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=5 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.820+0000 7fbe30098800 20 add_watcher() i=6 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.821+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94754204185152] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.821+0000 7fbe30098800 20 add_watcher() i=7 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.821+0000 7fbe30098800 2 all 8 watchers are set, enabling cache 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.821+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeaea830 con 0x562daead6170 2024-09-14T10:58:19.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.822+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.822+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94754204176240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae7cb0 con 0x562daead6170 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.823+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94754204176240] v37'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.823+0000 7fbcdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.823+0000 7fbe30098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.823+0000 7fbe30098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.823+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf2f70 con 0x562daead6170 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.824+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.824+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf3520 con 0x7fbe20078070 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.825+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.825+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf3960 con 0x562daeadab60 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.826+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.826+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf3910 con 0x562daead6170 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.827+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.827+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf39a0 con 0x7fbe28037070 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.828+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'85 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.829+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4420 con 0x562daeadab60 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.829+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.830+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4340 con 0x562daead6170 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.831+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.831+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4340 con 0x7fbe20078070 2024-09-14T10:58:19.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.832+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.832+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf43d0 con 0x7fbe28037070 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.833+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.833+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x562daeadab60 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.834+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.834+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x7fbe28037070 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.835+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'86 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.835+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x7fbe20078070 2024-09-14T10:58:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.836+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.837+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x7fbe28037070 2024-09-14T10:58:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.837+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.838+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x7fbe20078070 2024-09-14T10:58:19.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.839+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.839+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x562daead6170 2024-09-14T10:58:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.840+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.840+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4880 con 0x562daeadab60 2024-09-14T10:58:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.841+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.841+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x7fbe28037070 2024-09-14T10:58:19.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.842+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'87 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.842+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.843+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.843+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daead6170 2024-09-14T10:58:19.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.844+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.844+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daead6170 2024-09-14T10:58:19.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.845+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.845+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.846+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'78 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.846+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4830 con 0x7fbe28037070 2024-09-14T10:58:19.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.847+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.847+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf4830 con 0x562daeadab60 2024-09-14T10:58:19.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.848+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.848+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.849+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.849+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.850+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.850+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.851+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.851+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x7fbe20078070 2024-09-14T10:58:19.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.852+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.852+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.853+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.853+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x7fbe20078070 2024-09-14T10:58:19.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.854+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.854+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x562daeadab60 2024-09-14T10:58:19.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.855+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'79 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.855+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x7fbe20078070 2024-09-14T10:58:19.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.856+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.856+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeaf47f0 con 0x7fbe28037070 2024-09-14T10:58:19.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbcdeffd640 20 reqs_thread_entry: start 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbe30098800 20 init_complete bucket index max shards: 11 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbe30098800 20 Filter name: none 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbcdcff9640 20 reqs_thread_entry: start 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T10:58:19.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.858+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:94 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.859+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 27 ==== osd_op_reply(94 gc.29 [call] v37'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.859+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:95 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 28 ==== osd_op_reply(95 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:96 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daeadab60 2024-09-14T10:58:19.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 29 ==== osd_op_reply(96 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:97 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 30 ==== osd_op_reply(97 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:98 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 31 ==== osd_op_reply(98 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.860+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:99 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.861+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 32 ==== osd_op_reply(99 gc.29 [call] v37'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.861+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T10:58:19.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.861+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:100 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.862+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 23 ==== osd_op_reply(100 gc.30 [call] v37'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.862+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:101 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 24 ==== osd_op_reply(101 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:102 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 25 ==== osd_op_reply(102 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:103 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 26 ==== osd_op_reply(103 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:104 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 27 ==== osd_op_reply(104 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.863 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.863+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:105 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.865+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 28 ==== osd_op_reply(105 gc.30 [call] v37'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.865+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T10:58:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.865+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:106 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 19 ==== osd_op_reply(106 gc.31 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:107 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 20 ==== osd_op_reply(107 gc.31 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:108 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 21 ==== osd_op_reply(108 gc.31 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.866+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:109 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 22 ==== osd_op_reply(109 gc.31 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:110 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 23 ==== osd_op_reply(110 gc.31 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.867+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:111 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.868+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 24 ==== osd_op_reply(111 gc.31 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.868+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.868+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:112 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.869+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 28 ==== osd_op_reply(112 gc.0 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.869+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:113 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.869+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 29 ==== osd_op_reply(113 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.869+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.869+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:114 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 30 ==== osd_op_reply(114 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:115 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 31 ==== osd_op_reply(115 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:116 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 32 ==== osd_op_reply(116 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.870+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:117 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.871+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 33 ==== osd_op_reply(117 gc.0 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.871+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T10:58:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.871+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:118 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.872+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 29 ==== osd_op_reply(118 gc.1 [call] v37'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.872+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:119 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.872+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 30 ==== osd_op_reply(119 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.872+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.872+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:120 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 31 ==== osd_op_reply(120 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:121 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 32 ==== osd_op_reply(121 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:122 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 33 ==== osd_op_reply(122 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.873+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:123 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe20078070 2024-09-14T10:58:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.874+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 34 ==== osd_op_reply(123 gc.1 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.874+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T10:58:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.874+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:124 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.875+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 33 ==== osd_op_reply(124 gc.2 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.875+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:125 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.875+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 34 ==== osd_op_reply(125 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.875+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.875+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:126 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 35 ==== osd_op_reply(126 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:127 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 36 ==== osd_op_reply(127 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:128 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 37 ==== osd_op_reply(128 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.876+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:129 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.877+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 38 ==== osd_op_reply(129 gc.2 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.877+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T10:58:19.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.877+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:130 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.878+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 34 ==== osd_op_reply(130 gc.3 [call] v37'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.878+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:131 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.878+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 35 ==== osd_op_reply(131 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.878+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.878+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:132 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 36 ==== osd_op_reply(132 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:133 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 37 ==== osd_op_reply(133 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:134 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 38 ==== osd_op_reply(134 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.879+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:135 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.880+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 39 ==== osd_op_reply(135 gc.3 [call] v37'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.880+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.880+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:136 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.881+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 25 ==== osd_op_reply(136 gc.4 [call] v37'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.881+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:137 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.881+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 26 ==== osd_op_reply(137 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.881+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.881+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:138 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 27 ==== osd_op_reply(138 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:139 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 28 ==== osd_op_reply(139 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:140 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 29 ==== osd_op_reply(140 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.882+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:141 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x7fbe28037070 2024-09-14T10:58:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.883+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 30 ==== osd_op_reply(141 gc.4 [call] v37'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.883+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T10:58:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.883+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:142 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.884+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 39 ==== osd_op_reply(142 gc.5 [call] v37'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.884+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:143 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.884+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 40 ==== osd_op_reply(143 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.884+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.884+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:144 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 41 ==== osd_op_reply(144 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:145 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 42 ==== osd_op_reply(145 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:146 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 43 ==== osd_op_reply(146 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.885+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:147 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daeadab60 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.886+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 44 ==== osd_op_reply(147 gc.5 [call] v37'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.886+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.886+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:148 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.887+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 40 ==== osd_op_reply(148 gc.6 [call] v37'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.887+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:149 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 41 ==== osd_op_reply(149 gc.6 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:150 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1fa70 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 42 ==== osd_op_reply(150 gc.6 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:151 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 43 ==== osd_op_reply(151 gc.6 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:152 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb20a80 con 0x562daead6170 2024-09-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 44 ==== osd_op_reply(152 gc.6 [call out=1715b] v0'0 uv36 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.888+0000 7fbe30098800 20 garbage collection: RGWGC::process iterating over entry tag='4d2cef0f-8511-4251-8070-7385f93096af.4241.6852107800398288655', time=2024-09-14T10:58:27.936643+0000, chain.objs.size()=7 2024-09-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_1 2024-09-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:153 3.23s0 3:c5064570:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1ed90 con 0x7fbe20078070 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_2 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:154 3.1cs0 3:3a8f8cd7:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb23df0 con 0x562daead6170 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_3 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:155 3.4s0 3:21957ba1:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb266d0 con 0x7fbe20078070 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_4 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:156 3.0s0 3:01d764e6:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb266d0 con 0x7fbe20078070 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_5 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:157 3.1fs0 3:fb610f86:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb2b410 con 0x562daead6170 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_6 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:158 3.31s0 3:8f41091d:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb2dce0 con 0x7fbe20078070 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_7 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.889+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:159 3.37s0 3:ef61ff36:::4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb2dce0 con 0x562daead6170 2024-09-14T10:58:19.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.890+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 45 ==== osd_op_reply(154 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_2 [call] v37'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.891+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 46 ==== osd_op_reply(157 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_5 [call] v37'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.892+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 47 ==== osd_op_reply(159 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_7 [call] v37'8 uv8 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.893+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 35 ==== osd_op_reply(155 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_3 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.893+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 36 ==== osd_op_reply(156 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_4 [call] v37'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.893+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 37 ==== osd_op_reply(153 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_1 [call] v37'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.896+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 38 ==== osd_op_reply(158 4d2cef0f-8511-4251-8070-7385f93096af.4241.11__shadow_.vNAaCRbLVgdAehQZ0mHgOo1IAIp-Soa_6 [call] v37'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.896+0000 7fbe30098800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T10:58:19.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.896+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:160 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x562daead6170 2024-09-14T10:58:19.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.901+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 48 ==== osd_op_reply(160 gc.6 [call] v37'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.899 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.901+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:161 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x562daead6170 2024-09-14T10:58:19.901 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.904+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 49 ==== osd_op_reply(161 gc.6 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.904+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T10:58:19.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.904+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:162 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x7fbe20078070 2024-09-14T10:58:19.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.905+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 39 ==== osd_op_reply(162 gc.7 [call] v37'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.905+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:163 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x7fbe20078070 2024-09-14T10:58:19.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.905+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 40 ==== osd_op_reply(163 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.905+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.905+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:164 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 41 ==== osd_op_reply(164 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:165 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x7fbe20078070 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 42 ==== osd_op_reply(165 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:166 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e7a0 con 0x7fbe20078070 2024-09-14T10:58:19.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 43 ==== osd_op_reply(166 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.906+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:167 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.907+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 44 ==== osd_op_reply(167 gc.7 [call] v37'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.907+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T10:58:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.907+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:168 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.908+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 31 ==== osd_op_reply(168 gc.8 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.908+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:169 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.908+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 32 ==== osd_op_reply(169 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.908+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.908+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:170 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 33 ==== osd_op_reply(170 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:171 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 34 ==== osd_op_reply(171 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:172 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 35 ==== osd_op_reply(172 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.909+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:173 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.910+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 36 ==== osd_op_reply(173 gc.8 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.910+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T10:58:19.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.910+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:174 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.911+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 45 ==== osd_op_reply(174 gc.9 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.911+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:175 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 46 ==== osd_op_reply(175 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:176 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 47 ==== osd_op_reply(176 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:177 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 48 ==== osd_op_reply(177 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:178 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 49 ==== osd_op_reply(178 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.912+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:179 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.913+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 50 ==== osd_op_reply(179 gc.9 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.913+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T10:58:19.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.913+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:180 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.914+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 37 ==== osd_op_reply(180 gc.10 [call] v37'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.914+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:181 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 38 ==== osd_op_reply(181 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:182 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 39 ==== osd_op_reply(182 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:183 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 40 ==== osd_op_reply(183 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:184 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 41 ==== osd_op_reply(184 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.915+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:185 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.916+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 42 ==== osd_op_reply(185 gc.10 [call] v37'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.916+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.916+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:186 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 45 ==== osd_op_reply(186 gc.11 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:187 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 46 ==== osd_op_reply(187 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:188 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 47 ==== osd_op_reply(188 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:189 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 48 ==== osd_op_reply(189 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.918+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:190 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.919+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 49 ==== osd_op_reply(190 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.919+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.919+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:191 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.920+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 50 ==== osd_op_reply(191 gc.11 [call] v37'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.920+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.920+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:192 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 43 ==== osd_op_reply(192 gc.12 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:193 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 44 ==== osd_op_reply(193 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:194 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 45 ==== osd_op_reply(194 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:195 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 46 ==== osd_op_reply(195 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.921+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:196 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.922+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 47 ==== osd_op_reply(196 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.922+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.922+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:197 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.922+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 48 ==== osd_op_reply(197 gc.12 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.923+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T10:58:19.928 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.923+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:198 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.924+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 51 ==== osd_op_reply(198 gc.13 [call] v37'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.924+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:199 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.924+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 52 ==== osd_op_reply(199 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.924+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.924+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:200 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 53 ==== osd_op_reply(200 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:201 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 54 ==== osd_op_reply(201 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:202 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 55 ==== osd_op_reply(202 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.925+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:203 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.926+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 56 ==== osd_op_reply(203 gc.13 [call] v37'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.926+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.926+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:204 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.927+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 50 ==== osd_op_reply(204 gc.14 [call] v37'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.927+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:205 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.927+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 51 ==== osd_op_reply(205 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.927+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.927+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:206 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 52 ==== osd_op_reply(206 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:207 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 53 ==== osd_op_reply(207 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:208 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 54 ==== osd_op_reply(208 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.928+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:209 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.929+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 55 ==== osd_op_reply(209 gc.14 [call] v37'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.929+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.929+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:210 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.930+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 51 ==== osd_op_reply(210 gc.15 [call] v37'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.930+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:211 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 52 ==== osd_op_reply(211 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:212 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 53 ==== osd_op_reply(212 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:213 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 54 ==== osd_op_reply(213 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.931+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:214 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.932+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 55 ==== osd_op_reply(214 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.932+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.932+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:215 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.933+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 56 ==== osd_op_reply(215 gc.15 [call] v37'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.933+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.933+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:216 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 49 ==== osd_op_reply(216 gc.16 [call] v37'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:217 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 50 ==== osd_op_reply(217 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:218 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 51 ==== osd_op_reply(218 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:219 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 52 ==== osd_op_reply(219 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.934+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:220 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.935+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 53 ==== osd_op_reply(220 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.935+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.935+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:221 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.935+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 54 ==== osd_op_reply(221 gc.16 [call] v37'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.935+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.936+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:222 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.936+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 57 ==== osd_op_reply(222 gc.17 [call] v37'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.936+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:223 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 58 ==== osd_op_reply(223 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:224 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 59 ==== osd_op_reply(224 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:225 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 60 ==== osd_op_reply(225 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:226 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 61 ==== osd_op_reply(226 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.937+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:227 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.938+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 62 ==== osd_op_reply(227 gc.17 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.938+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.938+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:228 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.939+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 56 ==== osd_op_reply(228 gc.18 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.939+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:229 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 57 ==== osd_op_reply(229 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:230 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 58 ==== osd_op_reply(230 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:231 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 59 ==== osd_op_reply(231 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:232 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 60 ==== osd_op_reply(232 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.940+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:233 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.942+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 61 ==== osd_op_reply(233 gc.18 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.942+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.942+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:234 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 62 ==== osd_op_reply(234 gc.19 [call] v37'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:235 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 63 ==== osd_op_reply(235 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:236 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 64 ==== osd_op_reply(236 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:237 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 65 ==== osd_op_reply(237 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.943+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:238 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.944+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 66 ==== osd_op_reply(238 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.944+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.944+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:239 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.945+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 67 ==== osd_op_reply(239 gc.19 [call] v37'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.945+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.945+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:240 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 63 ==== osd_op_reply(240 gc.20 [call] v37'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:241 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 64 ==== osd_op_reply(241 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:242 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 65 ==== osd_op_reply(242 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:243 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 66 ==== osd_op_reply(243 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.946+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:244 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.947+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 67 ==== osd_op_reply(244 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.947+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.947+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:245 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.948+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 68 ==== osd_op_reply(245 gc.20 [call] v37'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.948+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.948+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:246 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 55 ==== osd_op_reply(246 gc.21 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:247 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 56 ==== osd_op_reply(247 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:248 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 57 ==== osd_op_reply(248 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:249 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.949+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 58 ==== osd_op_reply(249 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.950+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.950+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:250 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.950+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 59 ==== osd_op_reply(250 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.950+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.950+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:251 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.951+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 60 ==== osd_op_reply(251 gc.21 [call] v37'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.951+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.951+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:252 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 69 ==== osd_op_reply(252 gc.22 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:253 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 70 ==== osd_op_reply(253 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:254 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 71 ==== osd_op_reply(254 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:255 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 72 ==== osd_op_reply(255 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.952+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:256 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 73 ==== osd_op_reply(256 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:257 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 74 ==== osd_op_reply(257 gc.22 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.953+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:258 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.954+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 75 ==== osd_op_reply(258 gc.23 [call] v37'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.954+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:259 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 76 ==== osd_op_reply(259 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:260 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 77 ==== osd_op_reply(260 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:261 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 78 ==== osd_op_reply(261 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:262 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 79 ==== osd_op_reply(262 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.955+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:263 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.956+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 80 ==== osd_op_reply(263 gc.23 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.956+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.956+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:264 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 81 ==== osd_op_reply(264 gc.24 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:265 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 82 ==== osd_op_reply(265 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:266 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 83 ==== osd_op_reply(266 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.957+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:267 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 84 ==== osd_op_reply(267 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:268 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 85 ==== osd_op_reply(268 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.958+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:269 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.959+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 86 ==== osd_op_reply(269 gc.24 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.959+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.959+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:270 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 87 ==== osd_op_reply(270 gc.25 [call] v37'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:271 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 88 ==== osd_op_reply(271 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:272 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 89 ==== osd_op_reply(272 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:273 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 90 ==== osd_op_reply(273 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.960+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:274 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 91 ==== osd_op_reply(274 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:275 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 92 ==== osd_op_reply(275 gc.25 [call] v37'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.961+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:276 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 57 ==== osd_op_reply(276 gc.26 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:277 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 58 ==== osd_op_reply(277 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:278 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 59 ==== osd_op_reply(278 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.963+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:279 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 60 ==== osd_op_reply(279 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:280 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 61 ==== osd_op_reply(280 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.964+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:281 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.965+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 62 ==== osd_op_reply(281 gc.26 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.965+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T10:58:19.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.965+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:282 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 93 ==== osd_op_reply(282 gc.27 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:283 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 94 ==== osd_op_reply(283 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:284 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 95 ==== osd_op_reply(284 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.966+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:285 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 96 ==== osd_op_reply(285 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:286 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 97 ==== osd_op_reply(286 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.967+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:287 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daeadab60 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.968+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 98 ==== osd_op_reply(287 gc.27 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.968+0000 7fbe30098800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.968+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:288 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.969+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 63 ==== osd_op_reply(288 gc.28 [call] v37'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.969+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:289 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.969+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 64 ==== osd_op_reply(289 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.969+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.969+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:290 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 65 ==== osd_op_reply(290 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:291 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 66 ==== osd_op_reply(291 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:292 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562daeb251c0 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 67 ==== osd_op_reply(292 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe30098800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.970+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:293 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.971+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 68 ==== osd_op_reply(293 gc.28 [call] v37'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.972+0000 7fbcdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.972+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94754204176240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.973+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94754204176240] v37'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.973+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94754204159648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x7fbe28037070 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.974+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94754204159648] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.974+0000 7fbe30098800 20 remove_watcher() i=0 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.974+0000 7fbe30098800 2 removed watcher, disabling cache 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.974+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94754204165312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeb1e750 con 0x562daead6170 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.975+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94754204165312] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.975+0000 7fbe30098800 20 remove_watcher() i=1 2024-09-14T10:58:19.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.975+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94754204166368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae24c0 con 0x562daeadab60 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.976+0000 7fbe2e383640 1 -- 172.21.15.164:0/3518089243 <== osd.3 v2:172.21.15.164:6816/3361197980 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94754204166368] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe28060040 con 0x562daeadab60 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.976+0000 7fbe30098800 20 remove_watcher() i=2 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.976+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94754204171264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae0ea0 con 0x7fbe28037070 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.977+0000 7fbe2db82640 1 -- 172.21.15.164:0/3518089243 <== osd.2 v2:172.21.15.164:6800/813620551 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94754204171264] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2007f070 con 0x7fbe28037070 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.977+0000 7fbe30098800 20 remove_watcher() i=3 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.977+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94754204173616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae0ea0 con 0x562daead6170 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.979+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.1 v2:172.21.15.164:6802/3845281611 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94754204173616] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x562daead6170 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.979+0000 7fbe30098800 20 remove_watcher() i=4 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.979+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94754204178736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae0ea0 con 0x7fbe20078070 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.980+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94754204178736] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.980+0000 7fbe30098800 20 remove_watcher() i=5 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.980+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94754204181376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae5930 con 0x7fbe20078070 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.981+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94754204181376] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.981+0000 7fbe30098800 20 remove_watcher() i=6 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.981+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94754204185152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562daeae6380 con 0x7fbe20078070 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 <== osd.0 v2:172.21.15.116:6800/1614093354 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94754204185152] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe2402b040 con 0x7fbe20078070 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 20 remove_watcher() i=7 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbe20078070 msgr2=0x7fbe200645d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7fbe20078070 0x7fbe200645d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562daead6170 msgr2=0x562daead8630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562daead6170 0x562daead8630 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbe28037070 msgr2=0x7fbe28045a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fbe28037070 0x7fbe28045a90 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeadab60 msgr2=0x562daeadcf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeadab60 0x562daeadcf50 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbcf803ce10 msgr2=0x7fbcf803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbcf803ce10 0x7fbcf803f2d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbe2006ffd0 tx=0x7fbe2008c000 comp rx=0 tx=0).stop 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 msgr2=0x562daeaca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbe28049040 tx=0x7fbe28054560 comp rx=0 tx=0).stop 2024-09-14T10:58:19.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe2d381640 1 -- 172.21.15.164:0/3518089243 reap_dead start 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 shutdown_connections 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 --2- 172.21.15.164:0/3518089243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeac2e30 0x562daeaca470 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 >> 172.21.15.164:0/3518089243 conn(0x562daeabf230 msgr2=0x562daeabd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 shutdown_connections 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.982+0000 7fbe30098800 1 -- 172.21.15.164:0/3518089243 wait complete. 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 msgr2=0x7fbd0803f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 0x7fbd0803f2d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x562daea9d460 tx=0x7fbe20006f60 comp rx=0 tx=0).stop 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 msgr2=0x562daeab67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800a2a0 tx=0x7fbe28018830 comp rx=0 tx=0).stop 2024-09-14T10:58:19.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 shutdown_connections 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd0803ce10 0x7fbd0803f2d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/1387166491 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562daeab6390 0x562daeab67b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 >> 172.21.15.164:0/1387166491 conn(0x562daeaaa740 msgr2=0x562daeaaab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 shutdown_connections 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/1387166491 wait complete. 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 msgr2=0x562daeaa29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 0x562daeaa29a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 msgr2=0x562daeaa7220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 0x562daeaa7220 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 msgr2=0x7fbd1403f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 0x7fbd1403f2d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x562dae9154b0 tx=0x7fbe240013e0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 msgr2=0x562daea9b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005570 tx=0x7fbe20002fb0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 shutdown_connections 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x562daeaa4d80 0x562daeaa7220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x562dae9a4a30 0x562daeaa29a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fbd1403ce10 0x7fbd1403f2d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 --2- 172.21.15.164:0/2655570805 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562dae914ef0 0x562daea9b350 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 >> 172.21.15.164:0/2655570805 conn(0x562dae99bf80 msgr2=0x562daea8db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:19.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 shutdown_connections 2024-09-14T10:58:19.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-09-14T10:58:19.983+0000 7fbe30098800 1 -- 172.21.15.164:0/2655570805 wait complete. 2024-09-14T10:58:19.998 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T10:58:20.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:58:20.007 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:58:20.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99392b8640 1 Processor -- start 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99392b8640 1 -- start start 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99392b8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f993412c0b0 0x7f993412c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99392b8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993409a290 con 0x7f993412c9d0 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99392b8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f9934071860 con 0x7f993412c0b0 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f9932ffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f993412c0b0 0x7f993412c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99327fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f993412c9d0 0x7f9934097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40222/0 (socket says 172.21.15.116:40222) 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.111+0000 7f99327fc640 1 -- 172.21.15.116:0/2351911460 learned_addr learned my addr 172.21.15.116:0/2351911460 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9932ffd640 1 -- 172.21.15.116:0/2351911460 >> v1:172.21.15.116:6789/0 conn(0x7f993412c9d0 legacy=0x7f9934097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9932ffd640 1 -- 172.21.15.116:0/2351911460 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934099e20 con 0x7f993412c0b0 2024-09-14T10:58:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9932ffd640 1 --2- 172.21.15.116:0/2351911460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f993412c490 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9924009750 tx=0x7f992402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c6a30038d7dfee server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9931ffb640 1 -- 172.21.15.116:0/2351911460 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924037070 con 0x7f993412c0b0 2024-09-14T10:58:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9931ffb640 1 -- 172.21.15.116:0/2351911460 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992402ad80 con 0x7f993412c0b0 2024-09-14T10:58:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.112+0000 7f9931ffb640 1 -- 172.21.15.116:0/2351911460 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924032590 con 0x7f993412c0b0 2024-09-14T10:58:20.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 -- 172.21.15.116:0/2351911460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 msgr2=0x7f993412c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 --2- 172.21.15.116:0/2351911460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f993412c490 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9924009750 tx=0x7f992402a140 comp rx=0 tx=0).stop 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 -- 172.21.15.116:0/2351911460 shutdown_connections 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 --2- 172.21.15.116:0/2351911460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f993412c490 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 -- 172.21.15.116:0/2351911460 >> 172.21.15.116:0/2351911460 conn(0x7f993409abc0 msgr2=0x7f9934098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 -- 172.21.15.116:0/2351911460 shutdown_connections 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.113+0000 7f99392b8640 1 -- 172.21.15.116:0/2351911460 wait complete. 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f99392b8640 1 Processor -- start 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f99392b8640 1 -- start start 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f99392b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f99392b8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f993412ce00 con 0x7f993412c0b0 2024-09-14T10:58:20.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f9932ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f9932ffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41314/0 (socket says 172.21.15.116:41314) 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.114+0000 7f9932ffd640 1 -- 172.21.15.116:0/4238830083 learned_addr learned my addr 172.21.15.116:0/4238830083 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f9932ffd640 1 -- 172.21.15.116:0/4238830083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9934091070 con 0x7f993412c0b0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f9932ffd640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f992402a180 tx=0x7f99240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924041070 con 0x7f993412c0b0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992403c670 con 0x7f993412c0b0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9934090a00 con 0x7f993412c0b0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9924037040 con 0x7f993412c0b0 2024-09-14T10:58:20.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.115+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341c4ba0 con 0x7f993412c0b0 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.116+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f9924044070 con 0x7f993412c0b0 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.116+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99340907c0 con 0x7f993412c0b0 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.116+0000 7f991b7fe640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 0x7f9920040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.116+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f9924073ff0 con 0x7f993412c0b0 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.116+0000 7f99327fc640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 0x7f9920040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.117+0000 7f99327fc640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 0x7f9920040a30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f9928007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.121+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f9924044c60 con 0x7f993412c0b0 2024-09-14T10:58:20.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.289+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9934074090 con 0x7f992003e570 2024-09-14T10:58:20.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.300+0000 7f991b7fe640 1 -- 172.21.15.116:0/4238830083 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665751 (secure 0 0 0) 0x7f99280058b0 con 0x7f992003e570 2024-09-14T10:58:20.307 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:20.314 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:58:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 msgr2=0x7f9920040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 0x7f9920040a30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9928007fd0 tx=0x7f9928007aa0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 msgr2=0x7f99341c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f992402a180 tx=0x7f99240046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 shutdown_connections 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f992003e570 0x7f9920040a30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 --2- 172.21.15.116:0/4238830083 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f993412c0b0 0x7f99341c4660 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 >> 172.21.15.116:0/4238830083 conn(0x7f993409abc0 msgr2=0x7f993409c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 shutdown_connections 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.305+0000 7f99392b8640 1 -- 172.21.15.116:0/4238830083 wait complete. 2024-09-14T10:58:20.318 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-14T10:58:20.119844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9635600,"num_objects":225,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4978,"num_read_kb":4512,"num_write":2066,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4468,"ondisk_log_size":4468,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186364,"kb_used_data":40828,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377300996,"statfs":{"total":386547056640,"available":386356219904,"internally_reserved":0,"allocated":41807872,"data_stored":40542688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9034471,"num_objects":5,"num_object_clones":0,"num_object_copies":13,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":513,"num_write":402,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004082"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751151+0000","last_change":"2024-09-14T10:55:04.693957+0000","last_active":"2024-09-14T10:55:41.751151+0000","last_peered":"2024-09-14T10:55:41.751151+0000","last_clean":"2024-09-14T10:55:41.751151+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:55:41.751151+0000","last_undegraded":"2024-09-14T10:55:41.751151+0000","last_fullsized":"2024-09-14T10:55:41.751151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.408068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099828+0000","last_change":"2024-09-14T10:55:06.701780+0000","last_active":"2024-09-14T10:57:37.099828+0000","last_peered":"2024-09-14T10:57:37.099828+0000","last_clean":"2024-09-14T10:57:37.099828+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:57:37.099828+0000","last_undegraded":"2024-09-14T10:57:37.099828+0000","last_fullsized":"2024-09-14T10:57:37.099828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:25.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747843+0000","last_change":"2024-09-14T10:55:04.693160+0000","last_active":"2024-09-14T10:55:41.747843+0000","last_peered":"2024-09-14T10:55:41.747843+0000","last_clean":"2024-09-14T10:55:41.747843+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:55:41.747843+0000","last_undegraded":"2024-09-14T10:55:41.747843+0000","last_fullsized":"2024-09-14T10:55:41.747843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:56.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.044322+0000","last_change":"2024-09-14T10:55:41.755184+0000","last_active":"2024-09-14T10:55:47.044322+0000","last_peered":"2024-09-14T10:55:47.044322+0000","last_clean":"2024-09-14T10:55:47.044322+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:55:47.044322+0000","last_undegraded":"2024-09-14T10:55:47.044322+0000","last_fullsized":"2024-09-14T10:55:47.044322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:40.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.486444+0000","last_change":"2024-09-14T10:55:04.710321+0000","last_active":"2024-09-14T10:57:12.486444+0000","last_peered":"2024-09-14T10:57:12.486444+0000","last_clean":"2024-09-14T10:57:12.486444+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:57:12.486444+0000","last_undegraded":"2024-09-14T10:57:12.486444+0000","last_fullsized":"2024-09-14T10:57:12.486444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:23.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.536080+0000","last_change":"2024-09-14T10:55:04.691950+0000","last_active":"2024-09-14T10:57:12.536080+0000","last_peered":"2024-09-14T10:57:12.536080+0000","last_clean":"2024-09-14T10:57:12.536080+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:57:12.536080+0000","last_undegraded":"2024-09-14T10:57:12.536080+0000","last_fullsized":"2024-09-14T10:57:12.536080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065448+0000","last_change":"2024-09-14T10:55:41.752605+0000","last_active":"2024-09-14T10:58:13.065448+0000","last_peered":"2024-09-14T10:58:13.065448+0000","last_clean":"2024-09-14T10:58:13.065448+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:13.065448+0000","last_undegraded":"2024-09-14T10:58:13.065448+0000","last_fullsized":"2024-09-14T10:58:13.065448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.626179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.952023+0000","last_change":"2024-09-14T10:55:04.693896+0000","last_active":"2024-09-14T10:58:12.952023+0000","last_peered":"2024-09-14T10:58:12.952023+0000","last_clean":"2024-09-14T10:58:12.952023+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:12.952023+0000","last_undegraded":"2024-09-14T10:58:12.952023+0000","last_fullsized":"2024-09-14T10:58:12.952023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:25.363300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282107+0000","last_change":"2024-09-14T10:55:06.694032+0000","last_active":"2024-09-14T10:58:13.282107+0000","last_peered":"2024-09-14T10:58:13.282107+0000","last_clean":"2024-09-14T10:58:13.282107+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:13.282107+0000","last_undegraded":"2024-09-14T10:58:13.282107+0000","last_fullsized":"2024-09-14T10:58:13.282107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:52.564428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747657+0000","last_change":"2024-09-14T10:55:04.691521+0000","last_active":"2024-09-14T10:55:41.747657+0000","last_peered":"2024-09-14T10:55:41.747657+0000","last_clean":"2024-09-14T10:55:41.747657+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:55:41.747657+0000","last_undegraded":"2024-09-14T10:55:41.747657+0000","last_fullsized":"2024-09-14T10:55:41.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:36.146379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194738+0000","last_change":"2024-09-14T10:55:04.699709+0000","last_active":"2024-09-14T10:58:13.194738+0000","last_peered":"2024-09-14T10:58:13.194738+0000","last_clean":"2024-09-14T10:58:13.194738+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:13.194738+0000","last_undegraded":"2024-09-14T10:58:13.194738+0000","last_fullsized":"2024-09-14T10:58:13.194738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:53.785449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751899+0000","last_change":"2024-09-14T10:55:06.698420+0000","last_active":"2024-09-14T10:55:41.751899+0000","last_peered":"2024-09-14T10:55:41.751899+0000","last_clean":"2024-09-14T10:55:41.751899+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:55:41.751899+0000","last_undegraded":"2024-09-14T10:55:41.751899+0000","last_fullsized":"2024-09-14T10:55:41.751899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:37.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745255+0000","last_change":"2024-09-14T10:55:04.692677+0000","last_active":"2024-09-14T10:55:41.745255+0000","last_peered":"2024-09-14T10:55:41.745255+0000","last_clean":"2024-09-14T10:55:41.745255+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:55:41.745255+0000","last_undegraded":"2024-09-14T10:55:41.745255+0000","last_fullsized":"2024-09-14T10:55:41.745255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:19.955381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071556+0000","last_change":"2024-09-14T10:55:06.695226+0000","last_active":"2024-09-14T10:56:29.071556+0000","last_peered":"2024-09-14T10:56:29.071556+0000","last_clean":"2024-09-14T10:56:29.071556+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:56:29.071556+0000","last_undegraded":"2024-09-14T10:56:29.071556+0000","last_fullsized":"2024-09-14T10:56:29.071556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:25.288530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'7","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.190959+0000","last_change":"2024-09-14T10:55:04.710323+0000","last_active":"2024-09-14T10:58:13.190959+0000","last_peered":"2024-09-14T10:58:13.190959+0000","last_clean":"2024-09-14T10:58:13.190959+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:13.190959+0000","last_undegraded":"2024-09-14T10:58:13.190959+0000","last_fullsized":"2024-09-14T10:58:13.190959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:30.799795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":7,"num_write":23,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.281969+0000","last_change":"2024-09-14T10:55:06.699438+0000","last_active":"2024-09-14T10:58:13.281969+0000","last_peered":"2024-09-14T10:58:13.281969+0000","last_clean":"2024-09-14T10:58:13.281969+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:13.281969+0000","last_undegraded":"2024-09-14T10:58:13.281969+0000","last_fullsized":"2024-09-14T10:58:13.281969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.481249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751744+0000","last_change":"2024-09-14T10:55:04.699550+0000","last_active":"2024-09-14T10:55:41.751744+0000","last_peered":"2024-09-14T10:55:41.751744+0000","last_clean":"2024-09-14T10:55:41.751744+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:55:41.751744+0000","last_undegraded":"2024-09-14T10:55:41.751744+0000","last_fullsized":"2024-09-14T10:55:41.751744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:02.897364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584049+0000","last_change":"2024-09-14T10:55:06.699540+0000","last_active":"2024-09-14T10:57:12.584049+0000","last_peered":"2024-09-14T10:57:12.584049+0000","last_clean":"2024-09-14T10:57:12.584049+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:57:12.584049+0000","last_undegraded":"2024-09-14T10:57:12.584049+0000","last_fullsized":"2024-09-14T10:57:12.584049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:32.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.410027+0000","last_change":"2024-09-14T10:55:04.710493+0000","last_active":"2024-09-14T10:55:45.410027+0000","last_peered":"2024-09-14T10:55:45.410027+0000","last_clean":"2024-09-14T10:55:45.410027+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:55:45.410027+0000","last_undegraded":"2024-09-14T10:55:45.410027+0000","last_fullsized":"2024-09-14T10:55:45.410027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:11.097667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254829+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:58:13.254829+0000","last_peered":"2024-09-14T10:58:13.254829+0000","last_clean":"2024-09-14T10:58:13.254829+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:13.254829+0000","last_undegraded":"2024-09-14T10:58:13.254829+0000","last_fullsized":"2024-09-14T10:58:13.254829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745936+0000","last_change":"2024-09-14T10:55:04.697066+0000","last_active":"2024-09-14T10:55:41.745936+0000","last_peered":"2024-09-14T10:55:41.745936+0000","last_clean":"2024-09-14T10:55:41.745936+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:55:41.745936+0000","last_undegraded":"2024-09-14T10:55:41.745936+0000","last_fullsized":"2024-09-14T10:55:41.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:54.003676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747047+0000","last_change":"2024-09-14T10:55:06.695487+0000","last_active":"2024-09-14T10:55:41.747047+0000","last_peered":"2024-09-14T10:55:41.747047+0000","last_clean":"2024-09-14T10:55:41.747047+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:55:41.747047+0000","last_undegraded":"2024-09-14T10:55:41.747047+0000","last_fullsized":"2024-09-14T10:55:41.747047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:37.971520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746476+0000","last_change":"2024-09-14T10:55:04.708722+0000","last_active":"2024-09-14T10:55:41.746476+0000","last_peered":"2024-09-14T10:55:41.746476+0000","last_clean":"2024-09-14T10:55:41.746476+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:55:41.746476+0000","last_undegraded":"2024-09-14T10:55:41.746476+0000","last_fullsized":"2024-09-14T10:55:41.746476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:12.437345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071829+0000","last_change":"2024-09-14T10:55:06.697009+0000","last_active":"2024-09-14T10:56:29.071829+0000","last_peered":"2024-09-14T10:56:29.071829+0000","last_clean":"2024-09-14T10:56:29.071829+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:56:29.071829+0000","last_undegraded":"2024-09-14T10:56:29.071829+0000","last_fullsized":"2024-09-14T10:56:29.071829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.649839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.200303+0000","last_change":"2024-09-14T10:55:04.701290+0000","last_active":"2024-09-14T10:58:13.200303+0000","last_peered":"2024-09-14T10:58:13.200303+0000","last_clean":"2024-09-14T10:58:13.200303+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:13.200303+0000","last_undegraded":"2024-09-14T10:58:13.200303+0000","last_fullsized":"2024-09-14T10:58:13.200303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.929907+0000","last_change":"2024-09-14T10:55:06.689207+0000","last_active":"2024-09-14T10:55:45.929907+0000","last_peered":"2024-09-14T10:55:45.929907+0000","last_clean":"2024-09-14T10:55:45.929907+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:55:45.929907+0000","last_undegraded":"2024-09-14T10:55:45.929907+0000","last_fullsized":"2024-09-14T10:55:45.929907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:51.007328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742523+0000","last_change":"2024-09-14T10:55:04.707857+0000","last_active":"2024-09-14T10:55:41.742523+0000","last_peered":"2024-09-14T10:55:41.742523+0000","last_clean":"2024-09-14T10:55:41.742523+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:55:41.742523+0000","last_undegraded":"2024-09-14T10:55:41.742523+0000","last_fullsized":"2024-09-14T10:55:41.742523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.756536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.160376+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:57:11.160376+0000","last_peered":"2024-09-14T10:57:11.160376+0000","last_clean":"2024-09-14T10:57:11.160376+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:57:11.160376+0000","last_undegraded":"2024-09-14T10:57:11.160376+0000","last_fullsized":"2024-09-14T10:57:11.160376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'17","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.982652+0000","last_change":"2024-09-14T10:55:06.692424+0000","last_active":"2024-09-14T10:58:12.982652+0000","last_peered":"2024-09-14T10:58:12.982652+0000","last_clean":"2024-09-14T10:58:12.982652+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:58:12.982652+0000","last_undegraded":"2024-09-14T10:58:12.982652+0000","last_fullsized":"2024-09-14T10:58:12.982652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:34.169033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745404+0000","last_change":"2024-09-14T10:55:04.702312+0000","last_active":"2024-09-14T10:55:41.745404+0000","last_peered":"2024-09-14T10:55:41.745404+0000","last_clean":"2024-09-14T10:55:41.745404+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:55:41.745404+0000","last_undegraded":"2024-09-14T10:55:41.745404+0000","last_fullsized":"2024-09-14T10:55:41.745404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:33.119288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746096+0000","last_change":"2024-09-14T10:55:08.697901+0000","last_active":"2024-09-14T10:55:41.746096+0000","last_peered":"2024-09-14T10:55:41.746096+0000","last_clean":"2024-09-14T10:55:41.746096+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:55:41.746096+0000","last_undegraded":"2024-09-14T10:55:41.746096+0000","last_fullsized":"2024-09-14T10:55:41.746096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:51.107343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.521522+0000","last_change":"2024-09-14T10:55:04.705534+0000","last_active":"2024-09-14T10:55:46.521522+0000","last_peered":"2024-09-14T10:55:46.521522+0000","last_clean":"2024-09-14T10:55:46.521522+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:55:46.521522+0000","last_undegraded":"2024-09-14T10:55:46.521522+0000","last_fullsized":"2024-09-14T10:55:46.521522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:26.471935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747967+0000","last_change":"2024-09-14T10:55:08.703383+0000","last_active":"2024-09-14T10:55:41.747967+0000","last_peered":"2024-09-14T10:55:41.747967+0000","last_clean":"2024-09-14T10:55:41.747967+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:55:41.747967+0000","last_undegraded":"2024-09-14T10:55:41.747967+0000","last_fullsized":"2024-09-14T10:55:41.747967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:03.440350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787559+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:08.787559+0000","last_peered":"2024-09-14T10:58:08.787559+0000","last_clean":"2024-09-14T10:58:08.787559+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:08.787559+0000","last_undegraded":"2024-09-14T10:58:08.787559+0000","last_fullsized":"2024-09-14T10:58:08.787559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270140+0000","last_change":"2024-09-14T10:55:06.697810+0000","last_active":"2024-09-14T10:55:46.270140+0000","last_peered":"2024-09-14T10:55:46.270140+0000","last_clean":"2024-09-14T10:55:46.270140+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:55:46.270140+0000","last_undegraded":"2024-09-14T10:55:46.270140+0000","last_fullsized":"2024-09-14T10:55:46.270140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:09.071738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.562476+0000","last_change":"2024-09-14T10:55:04.697949+0000","last_active":"2024-09-14T10:57:12.562476+0000","last_peered":"2024-09-14T10:57:12.562476+0000","last_clean":"2024-09-14T10:57:12.562476+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:57:12.562476+0000","last_undegraded":"2024-09-14T10:57:12.562476+0000","last_fullsized":"2024-09-14T10:57:12.562476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:06.191131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099957+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:57:37.099957+0000","last_peered":"2024-09-14T10:57:37.099957+0000","last_clean":"2024-09-14T10:57:37.099957+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:57:37.099957+0000","last_undegraded":"2024-09-14T10:57:37.099957+0000","last_fullsized":"2024-09-14T10:57:37.099957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071993+0000","last_change":"2024-09-14T10:55:06.700108+0000","last_active":"2024-09-14T10:58:13.071993+0000","last_peered":"2024-09-14T10:58:13.071993+0000","last_clean":"2024-09-14T10:58:13.071993+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:13.071993+0000","last_undegraded":"2024-09-14T10:58:13.071993+0000","last_fullsized":"2024-09-14T10:58:13.071993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:18.353830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751377+0000","last_change":"2024-09-14T10:55:04.703179+0000","last_active":"2024-09-14T10:55:41.751377+0000","last_peered":"2024-09-14T10:55:41.751377+0000","last_clean":"2024-09-14T10:55:41.751377+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:55:41.751377+0000","last_undegraded":"2024-09-14T10:55:41.751377+0000","last_fullsized":"2024-09-14T10:55:41.751377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.756195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743711+0000","last_change":"2024-09-14T10:55:08.703801+0000","last_active":"2024-09-14T10:55:41.743711+0000","last_peered":"2024-09-14T10:55:41.743711+0000","last_clean":"2024-09-14T10:55:41.743711+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:55:41.743711+0000","last_undegraded":"2024-09-14T10:55:41.743711+0000","last_fullsized":"2024-09-14T10:55:41.743711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:30.805117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.164937+0000","last_change":"2024-09-14T10:55:10.711150+0000","last_active":"2024-09-14T10:57:11.164937+0000","last_peered":"2024-09-14T10:57:11.164937+0000","last_clean":"2024-09-14T10:57:11.164937+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:57:11.164937+0000","last_undegraded":"2024-09-14T10:57:11.164937+0000","last_fullsized":"2024-09-14T10:57:11.164937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.611145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071856+0000","last_change":"2024-09-14T10:55:06.693096+0000","last_active":"2024-09-14T10:56:29.071856+0000","last_peered":"2024-09-14T10:56:29.071856+0000","last_clean":"2024-09-14T10:56:29.071856+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:56:29.071856+0000","last_undegraded":"2024-09-14T10:56:29.071856+0000","last_fullsized":"2024-09-14T10:56:29.071856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:46.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750779+0000","last_change":"2024-09-14T10:55:04.703485+0000","last_active":"2024-09-14T10:55:41.750779+0000","last_peered":"2024-09-14T10:55:41.750779+0000","last_clean":"2024-09-14T10:55:41.750779+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:55:41.750779+0000","last_undegraded":"2024-09-14T10:55:41.750779+0000","last_fullsized":"2024-09-14T10:55:41.750779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:22.991367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745415+0000","last_change":"2024-09-14T10:55:08.703463+0000","last_active":"2024-09-14T10:55:41.745415+0000","last_peered":"2024-09-14T10:55:41.745415+0000","last_clean":"2024-09-14T10:55:41.745415+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:55:41.745415+0000","last_undegraded":"2024-09-14T10:55:41.745415+0000","last_fullsized":"2024-09-14T10:55:41.745415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.948464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.144736+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:57:11.144736+0000","last_peered":"2024-09-14T10:57:11.144736+0000","last_clean":"2024-09-14T10:57:11.144736+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:57:11.144736+0000","last_undegraded":"2024-09-14T10:57:11.144736+0000","last_fullsized":"2024-09-14T10:57:11.144736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254953+0000","last_change":"2024-09-14T10:55:06.695110+0000","last_active":"2024-09-14T10:58:13.254953+0000","last_peered":"2024-09-14T10:58:13.254953+0000","last_clean":"2024-09-14T10:58:13.254953+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:13.254953+0000","last_undegraded":"2024-09-14T10:58:13.254953+0000","last_fullsized":"2024-09-14T10:58:13.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:34.398479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744632+0000","last_change":"2024-09-14T10:55:04.702159+0000","last_active":"2024-09-14T10:55:41.744632+0000","last_peered":"2024-09-14T10:55:41.744632+0000","last_clean":"2024-09-14T10:55:41.744632+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:55:41.744632+0000","last_undegraded":"2024-09-14T10:55:41.744632+0000","last_fullsized":"2024-09-14T10:55:41.744632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:32.478928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747579+0000","last_change":"2024-09-14T10:55:08.700971+0000","last_active":"2024-09-14T10:55:41.747579+0000","last_peered":"2024-09-14T10:55:41.747579+0000","last_clean":"2024-09-14T10:55:41.747579+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:55:41.747579+0000","last_undegraded":"2024-09-14T10:55:41.747579+0000","last_fullsized":"2024-09-14T10:55:41.747579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:53.973360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.166761+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:57:11.166761+0000","last_peered":"2024-09-14T10:57:11.166761+0000","last_clean":"2024-09-14T10:57:11.166761+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:57:11.166761+0000","last_undegraded":"2024-09-14T10:57:11.166761+0000","last_fullsized":"2024-09-14T10:57:11.166761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.883679+0000","last_change":"2024-09-14T10:55:06.687352+0000","last_active":"2024-09-14T10:56:28.883679+0000","last_peered":"2024-09-14T10:56:28.883679+0000","last_clean":"2024-09-14T10:56:28.883679+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:56:28.883679+0000","last_undegraded":"2024-09-14T10:56:28.883679+0000","last_fullsized":"2024-09-14T10:56:28.883679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.409908+0000","last_change":"2024-09-14T10:55:04.711138+0000","last_active":"2024-09-14T10:55:45.409908+0000","last_peered":"2024-09-14T10:55:45.409908+0000","last_clean":"2024-09-14T10:55:45.409908+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:55:45.409908+0000","last_undegraded":"2024-09-14T10:55:45.409908+0000","last_fullsized":"2024-09-14T10:55:45.409908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:30.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:42.082259+0000","last_change":"2024-09-14T10:55:41.752599+0000","last_active":"2024-09-14T10:55:42.082259+0000","last_peered":"2024-09-14T10:55:42.082259+0000","last_clean":"2024-09-14T10:55:42.082259+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:55:42.082259+0000","last_undegraded":"2024-09-14T10:55:42.082259+0000","last_fullsized":"2024-09-14T10:55:42.082259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'54","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.168560+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:57:11.168560+0000","last_peered":"2024-09-14T10:57:11.168560+0000","last_clean":"2024-09-14T10:57:11.168560+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:57:11.168560+0000","last_undegraded":"2024-09-14T10:57:11.168560+0000","last_fullsized":"2024-09-14T10:57:11.168560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744942+0000","last_change":"2024-09-14T10:55:06.703711+0000","last_active":"2024-09-14T10:55:41.744942+0000","last_peered":"2024-09-14T10:55:41.744942+0000","last_clean":"2024-09-14T10:55:41.744942+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:55:41.744942+0000","last_undegraded":"2024-09-14T10:55:41.744942+0000","last_fullsized":"2024-09-14T10:55:41.744942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:13.371367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746090+0000","last_change":"2024-09-14T10:55:04.691040+0000","last_active":"2024-09-14T10:55:41.746090+0000","last_peered":"2024-09-14T10:55:41.746090+0000","last_clean":"2024-09-14T10:55:41.746090+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:55:41.746090+0000","last_undegraded":"2024-09-14T10:55:41.746090+0000","last_fullsized":"2024-09-14T10:55:41.746090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:07.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747621+0000","last_change":"2024-09-14T10:55:08.699358+0000","last_active":"2024-09-14T10:55:41.747621+0000","last_peered":"2024-09-14T10:55:41.747621+0000","last_clean":"2024-09-14T10:55:41.747621+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:55:41.747621+0000","last_undegraded":"2024-09-14T10:55:41.747621+0000","last_fullsized":"2024-09-14T10:55:41.747621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'34","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.937869+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:12.937869+0000","last_peered":"2024-09-14T10:58:12.937869+0000","last_clean":"2024-09-14T10:58:12.937869+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:12.937869+0000","last_undegraded":"2024-09-14T10:58:12.937869+0000","last_fullsized":"2024-09-14T10:58:12.937869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270233+0000","last_change":"2024-09-14T10:55:06.701991+0000","last_active":"2024-09-14T10:55:46.270233+0000","last_peered":"2024-09-14T10:55:46.270233+0000","last_clean":"2024-09-14T10:55:46.270233+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:55:46.270233+0000","last_undegraded":"2024-09-14T10:55:46.270233+0000","last_fullsized":"2024-09-14T10:55:46.270233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:45.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743476+0000","last_change":"2024-09-14T10:55:04.700925+0000","last_active":"2024-09-14T10:55:41.743476+0000","last_peered":"2024-09-14T10:55:41.743476+0000","last_clean":"2024-09-14T10:55:41.743476+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:55:41.743476+0000","last_undegraded":"2024-09-14T10:55:41.743476+0000","last_fullsized":"2024-09-14T10:55:41.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:49.933927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746151+0000","last_change":"2024-09-14T10:55:08.703241+0000","last_active":"2024-09-14T10:55:41.746151+0000","last_peered":"2024-09-14T10:55:41.746151+0000","last_clean":"2024-09-14T10:55:41.746151+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:55:41.746151+0000","last_undegraded":"2024-09-14T10:55:41.746151+0000","last_fullsized":"2024-09-14T10:55:41.746151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.686570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'39","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.174674+0000","last_change":"2024-09-14T10:55:10.703424+0000","last_active":"2024-09-14T10:57:11.174674+0000","last_peered":"2024-09-14T10:57:11.174674+0000","last_clean":"2024-09-14T10:57:11.174674+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:57:11.174674+0000","last_undegraded":"2024-09-14T10:57:11.174674+0000","last_fullsized":"2024-09-14T10:57:11.174674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:42.700099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.381724+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:13.381724+0000","last_peered":"2024-09-14T10:58:13.381724+0000","last_clean":"2024-09-14T10:58:13.381724+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:13.381724+0000","last_undegraded":"2024-09-14T10:58:13.381724+0000","last_fullsized":"2024-09-14T10:58:13.381724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065459+0000","last_change":"2024-09-14T10:55:06.695542+0000","last_active":"2024-09-14T10:58:13.065459+0000","last_peered":"2024-09-14T10:58:13.065459+0000","last_clean":"2024-09-14T10:58:13.065459+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:13.065459+0000","last_undegraded":"2024-09-14T10:58:13.065459+0000","last_fullsized":"2024-09-14T10:58:13.065459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.739856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742547+0000","last_change":"2024-09-14T10:55:04.707433+0000","last_active":"2024-09-14T10:55:41.742547+0000","last_peered":"2024-09-14T10:55:41.742547+0000","last_clean":"2024-09-14T10:55:41.742547+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:55:41.742547+0000","last_undegraded":"2024-09-14T10:55:41.742547+0000","last_fullsized":"2024-09-14T10:55:41.742547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.332597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224554+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:57:12.224554+0000","last_peered":"2024-09-14T10:57:12.224554+0000","last_clean":"2024-09-14T10:57:12.224554+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:57:12.224554+0000","last_undegraded":"2024-09-14T10:57:12.224554+0000","last_fullsized":"2024-09-14T10:57:12.224554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":459,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.337503+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:13.337503+0000","last_peered":"2024-09-14T10:58:13.337503+0000","last_clean":"2024-09-14T10:58:13.337503+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:13.337503+0000","last_undegraded":"2024-09-14T10:58:13.337503+0000","last_fullsized":"2024-09-14T10:58:13.337503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:22.097476+0000","last_change":"2024-09-14T10:55:06.706335+0000","last_active":"2024-09-14T10:57:22.097476+0000","last_peered":"2024-09-14T10:57:22.097476+0000","last_clean":"2024-09-14T10:57:22.097476+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:57:22.097476+0000","last_undegraded":"2024-09-14T10:57:22.097476+0000","last_fullsized":"2024-09-14T10:57:22.097476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.143962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.411031+0000","last_change":"2024-09-14T10:55:04.710463+0000","last_active":"2024-09-14T10:55:45.411031+0000","last_peered":"2024-09-14T10:55:45.411031+0000","last_clean":"2024-09-14T10:55:45.411031+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:55:45.411031+0000","last_undegraded":"2024-09-14T10:55:45.411031+0000","last_fullsized":"2024-09-14T10:55:45.411031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:37.366298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.161657+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:57:11.161657+0000","last_peered":"2024-09-14T10:57:11.161657+0000","last_clean":"2024-09-14T10:57:11.161657+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:57:11.161657+0000","last_undegraded":"2024-09-14T10:57:11.161657+0000","last_fullsized":"2024-09-14T10:57:11.161657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072341+0000","last_change":"2024-09-14T10:55:06.700492+0000","last_active":"2024-09-14T10:56:29.072341+0000","last_peered":"2024-09-14T10:56:29.072341+0000","last_clean":"2024-09-14T10:56:29.072341+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:56:29.072341+0000","last_undegraded":"2024-09-14T10:56:29.072341+0000","last_fullsized":"2024-09-14T10:56:29.072341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:08.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743002+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:55:41.743002+0000","last_peered":"2024-09-14T10:55:41.743002+0000","last_clean":"2024-09-14T10:55:41.743002+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:55:41.743002+0000","last_undegraded":"2024-09-14T10:55:41.743002+0000","last_fullsized":"2024-09-14T10:55:41.743002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742229+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:55:41.742229+0000","last_peered":"2024-09-14T10:55:41.742229+0000","last_clean":"2024-09-14T10:55:41.742229+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:55:41.742229+0000","last_undegraded":"2024-09-14T10:55:41.742229+0000","last_fullsized":"2024-09-14T10:55:41.742229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.277466+0000","last_change":"2024-09-14T10:55:04.711278+0000","last_active":"2024-09-14T10:58:13.277466+0000","last_peered":"2024-09-14T10:58:13.277466+0000","last_clean":"2024-09-14T10:58:13.277466+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:13.277466+0000","last_undegraded":"2024-09-14T10:58:13.277466+0000","last_fullsized":"2024-09-14T10:58:13.277466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:22.252465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746166+0000","last_change":"2024-09-14T10:55:08.700288+0000","last_active":"2024-09-14T10:55:41.746166+0000","last_peered":"2024-09-14T10:55:41.746166+0000","last_clean":"2024-09-14T10:55:41.746166+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:55:41.746166+0000","last_undegraded":"2024-09-14T10:55:41.746166+0000","last_fullsized":"2024-09-14T10:55:41.746166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:02.043861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.172718+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:57:11.172718+0000","last_peered":"2024-09-14T10:57:11.172718+0000","last_clean":"2024-09-14T10:57:11.172718+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:57:11.172718+0000","last_undegraded":"2024-09-14T10:57:11.172718+0000","last_fullsized":"2024-09-14T10:57:11.172718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971149+0000","last_change":"2024-09-14T10:55:06.692907+0000","last_active":"2024-09-14T10:58:12.971149+0000","last_peered":"2024-09-14T10:58:12.971149+0000","last_clean":"2024-09-14T10:58:12.971149+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:12.971149+0000","last_undegraded":"2024-09-14T10:58:12.971149+0000","last_fullsized":"2024-09-14T10:58:12.971149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:04.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741463+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:55:41.741463+0000","last_peered":"2024-09-14T10:55:41.741463+0000","last_clean":"2024-09-14T10:55:41.741463+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:55:41.741463+0000","last_undegraded":"2024-09-14T10:55:41.741463+0000","last_fullsized":"2024-09-14T10:55:41.741463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745280+0000","last_change":"2024-09-14T10:55:04.692738+0000","last_active":"2024-09-14T10:55:41.745280+0000","last_peered":"2024-09-14T10:55:41.745280+0000","last_clean":"2024-09-14T10:55:41.745280+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:55:41.745280+0000","last_undegraded":"2024-09-14T10:55:41.745280+0000","last_fullsized":"2024-09-14T10:55:41.745280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.808200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787545+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:08.787545+0000","last_peered":"2024-09-14T10:58:08.787545+0000","last_clean":"2024-09-14T10:58:08.787545+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:08.787545+0000","last_undegraded":"2024-09-14T10:58:08.787545+0000","last_fullsized":"2024-09-14T10:58:08.787545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971995+0000","last_change":"2024-09-14T10:55:06.697381+0000","last_active":"2024-09-14T10:58:12.971995+0000","last_peered":"2024-09-14T10:58:12.971995+0000","last_clean":"2024-09-14T10:58:12.971995+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:12.971995+0000","last_undegraded":"2024-09-14T10:58:12.971995+0000","last_fullsized":"2024-09-14T10:58:12.971995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:17.404755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746730+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:55:41.746730+0000","last_peered":"2024-09-14T10:55:41.746730+0000","last_clean":"2024-09-14T10:55:41.746730+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:55:41.746730+0000","last_undegraded":"2024-09-14T10:55:41.746730+0000","last_fullsized":"2024-09-14T10:55:41.746730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.883807+0000","last_change":"2024-09-14T10:55:04.703428+0000","last_active":"2024-09-14T10:58:12.883807+0000","last_peered":"2024-09-14T10:58:12.883807+0000","last_clean":"2024-09-14T10:58:12.883807+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:12.883807+0000","last_undegraded":"2024-09-14T10:58:12.883807+0000","last_fullsized":"2024-09-14T10:58:12.883807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:53.536029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750615+0000","last_change":"2024-09-14T10:55:08.699744+0000","last_active":"2024-09-14T10:55:41.750615+0000","last_peered":"2024-09-14T10:55:41.750615+0000","last_clean":"2024-09-14T10:55:41.750615+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:55:41.750615+0000","last_undegraded":"2024-09-14T10:55:41.750615+0000","last_fullsized":"2024-09-14T10:55:41.750615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:26.469946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787613+0000","last_change":"2024-09-14T10:55:10.711152+0000","last_active":"2024-09-14T10:58:08.787613+0000","last_peered":"2024-09-14T10:58:08.787613+0000","last_clean":"2024-09-14T10:58:08.787613+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:08.787613+0000","last_undegraded":"2024-09-14T10:58:08.787613+0000","last_fullsized":"2024-09-14T10:58:08.787613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:00.848960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254782+0000","last_change":"2024-09-14T10:55:06.696400+0000","last_active":"2024-09-14T10:58:13.254782+0000","last_peered":"2024-09-14T10:58:13.254782+0000","last_clean":"2024-09-14T10:58:13.254782+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:13.254782+0000","last_undegraded":"2024-09-14T10:58:13.254782+0000","last_fullsized":"2024-09-14T10:58:13.254782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:27.637523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742327+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:55:41.742327+0000","last_peered":"2024-09-14T10:55:41.742327+0000","last_clean":"2024-09-14T10:55:41.742327+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:55:41.742327+0000","last_undegraded":"2024-09-14T10:55:41.742327+0000","last_fullsized":"2024-09-14T10:55:41.742327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746853+0000","last_change":"2024-09-14T10:55:04.701485+0000","last_active":"2024-09-14T10:55:41.746853+0000","last_peered":"2024-09-14T10:55:41.746853+0000","last_clean":"2024-09-14T10:55:41.746853+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:55:41.746853+0000","last_undegraded":"2024-09-14T10:55:41.746853+0000","last_fullsized":"2024-09-14T10:55:41.746853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:55.465771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747177+0000","last_change":"2024-09-14T10:55:08.697214+0000","last_active":"2024-09-14T10:55:41.747177+0000","last_peered":"2024-09-14T10:55:41.747177+0000","last_clean":"2024-09-14T10:55:41.747177+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:55:41.747177+0000","last_undegraded":"2024-09-14T10:55:41.747177+0000","last_fullsized":"2024-09-14T10:55:41.747177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:19.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.216318+0000","last_change":"2024-09-14T10:55:06.706535+0000","last_active":"2024-09-14T10:58:13.216318+0000","last_peered":"2024-09-14T10:58:13.216318+0000","last_clean":"2024-09-14T10:58:13.216318+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:13.216318+0000","last_undegraded":"2024-09-14T10:58:13.216318+0000","last_fullsized":"2024-09-14T10:58:13.216318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:55.794763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745720+0000","last_change":"2024-09-14T10:55:04.700577+0000","last_active":"2024-09-14T10:55:41.745720+0000","last_peered":"2024-09-14T10:55:41.745720+0000","last_clean":"2024-09-14T10:55:41.745720+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:55:41.745720+0000","last_undegraded":"2024-09-14T10:55:41.745720+0000","last_fullsized":"2024-09-14T10:55:41.745720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:41.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746368+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:55:41.746368+0000","last_peered":"2024-09-14T10:55:41.746368+0000","last_clean":"2024-09-14T10:55:41.746368+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:55:41.746368+0000","last_undegraded":"2024-09-14T10:55:41.746368+0000","last_fullsized":"2024-09-14T10:55:41.746368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.400872+0000","last_change":"2024-09-14T10:55:08.697596+0000","last_active":"2024-09-14T10:58:13.400872+0000","last_peered":"2024-09-14T10:58:13.400872+0000","last_clean":"2024-09-14T10:58:13.400872+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:13.400872+0000","last_undegraded":"2024-09-14T10:58:13.400872+0000","last_fullsized":"2024-09-14T10:58:13.400872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:19.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288374+0000","last_change":"2024-09-14T10:55:06.706584+0000","last_active":"2024-09-14T10:58:13.288374+0000","last_peered":"2024-09-14T10:58:13.288374+0000","last_clean":"2024-09-14T10:58:13.288374+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:13.288374+0000","last_undegraded":"2024-09-14T10:58:13.288374+0000","last_fullsized":"2024-09-14T10:58:13.288374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.341911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.872057+0000","last_change":"2024-09-14T10:55:04.693803+0000","last_active":"2024-09-14T10:58:12.872057+0000","last_peered":"2024-09-14T10:58:12.872057+0000","last_clean":"2024-09-14T10:58:12.872057+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:12.872057+0000","last_undegraded":"2024-09-14T10:58:12.872057+0000","last_fullsized":"2024-09-14T10:58:12.872057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:11.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744220+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:55:41.744220+0000","last_peered":"2024-09-14T10:55:41.744220+0000","last_clean":"2024-09-14T10:55:41.744220+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:55:41.744220+0000","last_undegraded":"2024-09-14T10:55:41.744220+0000","last_fullsized":"2024-09-14T10:55:41.744220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787486+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:08.787486+0000","last_peered":"2024-09-14T10:58:08.787486+0000","last_clean":"2024-09-14T10:58:08.787486+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:08.787486+0000","last_undegraded":"2024-09-14T10:58:08.787486+0000","last_fullsized":"2024-09-14T10:58:08.787486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.576048+0000","last_change":"2024-09-14T10:55:06.700418+0000","last_active":"2024-09-14T10:57:12.576048+0000","last_peered":"2024-09-14T10:57:12.576048+0000","last_clean":"2024-09-14T10:57:12.576048+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:57:12.576048+0000","last_undegraded":"2024-09-14T10:57:12.576048+0000","last_fullsized":"2024-09-14T10:57:12.576048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.529891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747368+0000","last_change":"2024-09-14T10:55:04.701334+0000","last_active":"2024-09-14T10:55:41.747368+0000","last_peered":"2024-09-14T10:55:41.747368+0000","last_clean":"2024-09-14T10:55:41.747368+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:55:41.747368+0000","last_undegraded":"2024-09-14T10:55:41.747368+0000","last_fullsized":"2024-09-14T10:55:41.747368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:44.481979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747311+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:55:41.747311+0000","last_peered":"2024-09-14T10:55:41.747311+0000","last_clean":"2024-09-14T10:55:41.747311+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:55:41.747311+0000","last_undegraded":"2024-09-14T10:55:41.747311+0000","last_fullsized":"2024-09-14T10:55:41.747311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206572+0000","last_change":"2024-09-14T10:55:06.696240+0000","last_active":"2024-09-14T10:58:13.206572+0000","last_peered":"2024-09-14T10:58:13.206572+0000","last_clean":"2024-09-14T10:58:13.206572+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:13.206572+0000","last_undegraded":"2024-09-14T10:58:13.206572+0000","last_fullsized":"2024-09-14T10:58:13.206572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:55.340683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747296+0000","last_change":"2024-09-14T10:55:04.711259+0000","last_active":"2024-09-14T10:55:41.747296+0000","last_peered":"2024-09-14T10:55:41.747296+0000","last_clean":"2024-09-14T10:55:41.747296+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:55:41.747296+0000","last_undegraded":"2024-09-14T10:55:41.747296+0000","last_fullsized":"2024-09-14T10:55:41.747296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:39.310566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746456+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:55:41.746456+0000","last_peered":"2024-09-14T10:55:41.746456+0000","last_clean":"2024-09-14T10:55:41.746456+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:55:41.746456+0000","last_undegraded":"2024-09-14T10:55:41.746456+0000","last_fullsized":"2024-09-14T10:55:41.746456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.205970+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:57:12.205970+0000","last_peered":"2024-09-14T10:57:12.205970+0000","last_clean":"2024-09-14T10:57:12.205970+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:57:12.205970+0000","last_undegraded":"2024-09-14T10:57:12.205970+0000","last_fullsized":"2024-09-14T10:57:12.205970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'84","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096443+0000","last_change":"2024-09-14T10:55:10.706862+0000","last_active":"2024-09-14T10:57:17.096443+0000","last_peered":"2024-09-14T10:57:17.096443+0000","last_clean":"2024-09-14T10:57:17.096443+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:57:17.096443+0000","last_undegraded":"2024-09-14T10:57:17.096443+0000","last_fullsized":"2024-09-14T10:57:17.096443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:12.621258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584503+0000","last_change":"2024-09-14T10:55:06.704098+0000","last_active":"2024-09-14T10:57:12.584503+0000","last_peered":"2024-09-14T10:57:12.584503+0000","last_clean":"2024-09-14T10:57:12.584503+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:57:12.584503+0000","last_undegraded":"2024-09-14T10:57:12.584503+0000","last_fullsized":"2024-09-14T10:57:12.584503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:55.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743912+0000","last_change":"2024-09-14T10:55:04.711613+0000","last_active":"2024-09-14T10:55:41.743912+0000","last_peered":"2024-09-14T10:55:41.743912+0000","last_clean":"2024-09-14T10:55:41.743912+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:55:41.743912+0000","last_undegraded":"2024-09-14T10:55:41.743912+0000","last_fullsized":"2024-09-14T10:55:41.743912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:11.362054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.755110+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:55:41.755110+0000","last_peered":"2024-09-14T10:55:41.755110+0000","last_clean":"2024-09-14T10:55:41.755110+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:55:41.755110+0000","last_undegraded":"2024-09-14T10:55:41.755110+0000","last_fullsized":"2024-09-14T10:55:41.755110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:31.114647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.165855+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:57:11.165855+0000","last_peered":"2024-09-14T10:57:11.165855+0000","last_clean":"2024-09-14T10:57:11.165855+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:57:11.165855+0000","last_undegraded":"2024-09-14T10:57:11.165855+0000","last_fullsized":"2024-09-14T10:57:11.165855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072086+0000","last_change":"2024-09-14T10:55:06.706869+0000","last_active":"2024-09-14T10:56:29.072086+0000","last_peered":"2024-09-14T10:56:29.072086+0000","last_clean":"2024-09-14T10:56:29.072086+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:56:29.072086+0000","last_undegraded":"2024-09-14T10:56:29.072086+0000","last_fullsized":"2024-09-14T10:56:29.072086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:29.765849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.528232+0000","last_change":"2024-09-14T10:55:04.701437+0000","last_active":"2024-09-14T10:55:46.528232+0000","last_peered":"2024-09-14T10:55:46.528232+0000","last_clean":"2024-09-14T10:55:46.528232+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:55:46.528232+0000","last_undegraded":"2024-09-14T10:55:46.528232+0000","last_fullsized":"2024-09-14T10:55:46.528232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:36.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255000+0000","last_change":"2024-09-14T10:55:06.693983+0000","last_active":"2024-09-14T10:58:13.255000+0000","last_peered":"2024-09-14T10:58:13.255000+0000","last_clean":"2024-09-14T10:58:13.255000+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:13.255000+0000","last_undegraded":"2024-09-14T10:58:13.255000+0000","last_fullsized":"2024-09-14T10:58:13.255000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.880458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750801+0000","last_change":"2024-09-14T10:55:04.698396+0000","last_active":"2024-09-14T10:55:41.750801+0000","last_peered":"2024-09-14T10:55:41.750801+0000","last_clean":"2024-09-14T10:55:41.750801+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:55:41.750801+0000","last_undegraded":"2024-09-14T10:55:41.750801+0000","last_fullsized":"2024-09-14T10:55:41.750801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:53.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749782+0000","last_change":"2024-09-14T10:55:08.706267+0000","last_active":"2024-09-14T10:55:41.749782+0000","last_peered":"2024-09-14T10:55:41.749782+0000","last_clean":"2024-09-14T10:55:41.749782+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:55:41.749782+0000","last_undegraded":"2024-09-14T10:55:41.749782+0000","last_fullsized":"2024-09-14T10:55:41.749782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:55.090960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:27.098679+0000","last_change":"2024-09-14T10:55:06.700291+0000","last_active":"2024-09-14T10:57:27.098679+0000","last_peered":"2024-09-14T10:57:27.098679+0000","last_clean":"2024-09-14T10:57:27.098679+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:57:27.098679+0000","last_undegraded":"2024-09-14T10:57:27.098679+0000","last_fullsized":"2024-09-14T10:57:27.098679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:17.660782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748263+0000","last_change":"2024-09-14T10:55:04.699426+0000","last_active":"2024-09-14T10:55:41.748263+0000","last_peered":"2024-09-14T10:55:41.748263+0000","last_clean":"2024-09-14T10:55:41.748263+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:55:41.748263+0000","last_undegraded":"2024-09-14T10:55:41.748263+0000","last_fullsized":"2024-09-14T10:55:41.748263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:02.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.150888+0000","last_change":"2024-09-14T10:55:10.702656+0000","last_active":"2024-09-14T10:57:11.150888+0000","last_peered":"2024-09-14T10:57:11.150888+0000","last_clean":"2024-09-14T10:57:11.150888+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:57:11.150888+0000","last_undegraded":"2024-09-14T10:57:11.150888+0000","last_fullsized":"2024-09-14T10:57:11.150888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:11.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741582+0000","last_change":"2024-09-14T10:55:04.710135+0000","last_active":"2024-09-14T10:55:41.741582+0000","last_peered":"2024-09-14T10:55:41.741582+0000","last_clean":"2024-09-14T10:55:41.741582+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:55:41.741582+0000","last_undegraded":"2024-09-14T10:55:41.741582+0000","last_fullsized":"2024-09-14T10:55:41.741582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:45.412903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065142+0000","last_change":"2024-09-14T10:55:06.697498+0000","last_active":"2024-09-14T10:58:13.065142+0000","last_peered":"2024-09-14T10:58:13.065142+0000","last_clean":"2024-09-14T10:58:13.065142+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:13.065142+0000","last_undegraded":"2024-09-14T10:58:13.065142+0000","last_fullsized":"2024-09-14T10:58:13.065142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:39.956062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.516347+0000","last_change":"2024-09-14T10:55:04.709771+0000","last_active":"2024-09-14T10:55:46.516347+0000","last_peered":"2024-09-14T10:55:46.516347+0000","last_clean":"2024-09-14T10:55:46.516347+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:55:46.516347+0000","last_undegraded":"2024-09-14T10:55:46.516347+0000","last_fullsized":"2024-09-14T10:55:46.516347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:06.645182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751169+0000","last_change":"2024-09-14T10:55:08.699650+0000","last_active":"2024-09-14T10:55:41.751169+0000","last_peered":"2024-09-14T10:55:41.751169+0000","last_clean":"2024-09-14T10:55:41.751169+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:55:41.751169+0000","last_undegraded":"2024-09-14T10:55:41.751169+0000","last_fullsized":"2024-09-14T10:55:41.751169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:29.469388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.151854+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:57:11.151854+0000","last_peered":"2024-09-14T10:57:11.151854+0000","last_clean":"2024-09-14T10:57:11.151854+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:57:11.151854+0000","last_undegraded":"2024-09-14T10:57:11.151854+0000","last_fullsized":"2024-09-14T10:57:11.151854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744988+0000","last_change":"2024-09-14T10:55:04.711540+0000","last_active":"2024-09-14T10:55:41.744988+0000","last_peered":"2024-09-14T10:55:41.744988+0000","last_clean":"2024-09-14T10:55:41.744988+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:55:41.744988+0000","last_undegraded":"2024-09-14T10:55:41.744988+0000","last_fullsized":"2024-09-14T10:55:41.744988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:34.258135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746905+0000","last_change":"2024-09-14T10:55:08.696759+0000","last_active":"2024-09-14T10:55:41.746905+0000","last_peered":"2024-09-14T10:55:41.746905+0000","last_clean":"2024-09-14T10:55:41.746905+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:55:41.746905+0000","last_undegraded":"2024-09-14T10:55:41.746905+0000","last_fullsized":"2024-09-14T10:55:41.746905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.250751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.213430+0000","last_change":"2024-09-14T10:55:06.687522+0000","last_active":"2024-09-14T10:58:13.213430+0000","last_peered":"2024-09-14T10:58:13.213430+0000","last_clean":"2024-09-14T10:58:13.213430+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:13.213430+0000","last_undegraded":"2024-09-14T10:58:13.213430+0000","last_fullsized":"2024-09-14T10:58:13.213430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.424148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742424+0000","last_change":"2024-09-14T10:55:04.707600+0000","last_active":"2024-09-14T10:55:41.742424+0000","last_peered":"2024-09-14T10:55:41.742424+0000","last_clean":"2024-09-14T10:55:41.742424+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:55:41.742424+0000","last_undegraded":"2024-09-14T10:55:41.742424+0000","last_fullsized":"2024-09-14T10:55:41.742424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:35.430004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.392241+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:13.392241+0000","last_peered":"2024-09-14T10:58:13.392241+0000","last_clean":"2024-09-14T10:58:13.392241+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:13.392241+0000","last_undegraded":"2024-09-14T10:58:13.392241+0000","last_fullsized":"2024-09-14T10:58:13.392241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099899+0000","last_change":"2024-09-14T10:55:06.687803+0000","last_active":"2024-09-14T10:57:37.099899+0000","last_peered":"2024-09-14T10:57:37.099899+0000","last_clean":"2024-09-14T10:57:37.099899+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:57:37.099899+0000","last_undegraded":"2024-09-14T10:57:37.099899+0000","last_fullsized":"2024-09-14T10:57:37.099899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:19.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099990+0000","last_change":"2024-09-14T10:55:04.697878+0000","last_active":"2024-09-14T10:57:37.099990+0000","last_peered":"2024-09-14T10:57:37.099990+0000","last_clean":"2024-09-14T10:57:37.099990+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:57:37.099990+0000","last_undegraded":"2024-09-14T10:57:37.099990+0000","last_fullsized":"2024-09-14T10:57:37.099990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.142769+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:57:11.142769+0000","last_peered":"2024-09-14T10:57:11.142769+0000","last_clean":"2024-09-14T10:57:11.142769+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:57:11.142769+0000","last_undegraded":"2024-09-14T10:57:11.142769+0000","last_fullsized":"2024-09-14T10:57:11.142769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282026+0000","last_change":"2024-09-14T10:55:06.687347+0000","last_active":"2024-09-14T10:58:13.282026+0000","last_peered":"2024-09-14T10:58:13.282026+0000","last_clean":"2024-09-14T10:58:13.282026+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:13.282026+0000","last_undegraded":"2024-09-14T10:58:13.282026+0000","last_fullsized":"2024-09-14T10:58:13.282026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:08.040457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744386+0000","last_change":"2024-09-14T10:55:04.711139+0000","last_active":"2024-09-14T10:55:41.744386+0000","last_peered":"2024-09-14T10:55:41.744386+0000","last_clean":"2024-09-14T10:55:41.744386+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:55:41.744386+0000","last_undegraded":"2024-09-14T10:55:41.744386+0000","last_fullsized":"2024-09-14T10:55:41.744386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.640526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750062+0000","last_change":"2024-09-14T10:55:08.697330+0000","last_active":"2024-09-14T10:55:41.750062+0000","last_peered":"2024-09-14T10:55:41.750062+0000","last_clean":"2024-09-14T10:55:41.750062+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:55:41.750062+0000","last_undegraded":"2024-09-14T10:55:41.750062+0000","last_fullsized":"2024-09-14T10:55:41.750062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.585707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.261968+0000","last_change":"2024-09-14T10:55:06.701898+0000","last_active":"2024-09-14T10:58:13.261968+0000","last_peered":"2024-09-14T10:58:13.261968+0000","last_clean":"2024-09-14T10:58:13.261968+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:58:13.261968+0000","last_undegraded":"2024-09-14T10:58:13.261968+0000","last_fullsized":"2024-09-14T10:58:13.261968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:01.158624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747660+0000","last_change":"2024-09-14T10:55:04.693915+0000","last_active":"2024-09-14T10:55:41.747660+0000","last_peered":"2024-09-14T10:55:41.747660+0000","last_clean":"2024-09-14T10:55:41.747660+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:55:41.747660+0000","last_undegraded":"2024-09-14T10:55:41.747660+0000","last_fullsized":"2024-09-14T10:55:41.747660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:42.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749018+0000","last_change":"2024-09-14T10:55:08.705127+0000","last_active":"2024-09-14T10:55:41.749018+0000","last_peered":"2024-09-14T10:55:41.749018+0000","last_clean":"2024-09-14T10:55:41.749018+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:55:41.749018+0000","last_undegraded":"2024-09-14T10:55:41.749018+0000","last_fullsized":"2024-09-14T10:55:41.749018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:13.732662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.167639+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:57:11.167639+0000","last_peered":"2024-09-14T10:57:11.167639+0000","last_clean":"2024-09-14T10:57:11.167639+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:57:11.167639+0000","last_undegraded":"2024-09-14T10:57:11.167639+0000","last_fullsized":"2024-09-14T10:57:11.167639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206948+0000","last_change":"2024-09-14T10:55:06.685023+0000","last_active":"2024-09-14T10:58:13.206948+0000","last_peered":"2024-09-14T10:58:13.206948+0000","last_clean":"2024-09-14T10:58:13.206948+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:13.206948+0000","last_undegraded":"2024-09-14T10:58:13.206948+0000","last_fullsized":"2024-09-14T10:58:13.206948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.730948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.095656+0000","last_change":"2024-09-14T10:55:04.699747+0000","last_active":"2024-09-14T10:57:12.095656+0000","last_peered":"2024-09-14T10:57:12.095656+0000","last_clean":"2024-09-14T10:57:12.095656+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:57:12.095656+0000","last_undegraded":"2024-09-14T10:57:12.095656+0000","last_fullsized":"2024-09-14T10:57:12.095656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:31.195740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224838+0000","last_change":"2024-09-14T10:55:08.704615+0000","last_active":"2024-09-14T10:57:12.224838+0000","last_peered":"2024-09-14T10:57:12.224838+0000","last_clean":"2024-09-14T10:57:12.224838+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:57:12.224838+0000","last_undegraded":"2024-09-14T10:57:12.224838+0000","last_fullsized":"2024-09-14T10:57:12.224838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:58.840952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'32","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.603846+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:12.603846+0000","last_peered":"2024-09-14T10:58:12.603846+0000","last_clean":"2024-09-14T10:58:12.603846+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:12.603846+0000","last_undegraded":"2024-09-14T10:58:12.603846+0000","last_fullsized":"2024-09-14T10:58:12.603846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970449+0000","last_change":"2024-09-14T10:55:06.706262+0000","last_active":"2024-09-14T10:58:12.970449+0000","last_peered":"2024-09-14T10:58:12.970449+0000","last_clean":"2024-09-14T10:58:12.970449+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:12.970449+0000","last_undegraded":"2024-09-14T10:58:12.970449+0000","last_fullsized":"2024-09-14T10:58:12.970449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:47.079971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745287+0000","last_change":"2024-09-14T10:55:04.692001+0000","last_active":"2024-09-14T10:55:41.745287+0000","last_peered":"2024-09-14T10:55:41.745287+0000","last_clean":"2024-09-14T10:55:41.745287+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:55:41.745287+0000","last_undegraded":"2024-09-14T10:55:41.745287+0000","last_fullsized":"2024-09-14T10:55:41.745287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:53.842302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071299+0000","last_change":"2024-09-14T10:55:06.687507+0000","last_active":"2024-09-14T10:58:13.071299+0000","last_peered":"2024-09-14T10:58:13.071299+0000","last_clean":"2024-09-14T10:58:13.071299+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:13.071299+0000","last_undegraded":"2024-09-14T10:58:13.071299+0000","last_fullsized":"2024-09-14T10:58:13.071299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:25.386577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745168+0000","last_change":"2024-09-14T10:55:04.688069+0000","last_active":"2024-09-14T10:55:41.745168+0000","last_peered":"2024-09-14T10:55:41.745168+0000","last_clean":"2024-09-14T10:55:41.745168+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:55:41.745168+0000","last_undegraded":"2024-09-14T10:55:41.745168+0000","last_fullsized":"2024-09-14T10:55:41.745168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.177526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.906651+0000","last_change":"2024-09-14T10:55:04.710926+0000","last_active":"2024-09-14T10:55:45.906651+0000","last_peered":"2024-09-14T10:55:45.906651+0000","last_clean":"2024-09-14T10:55:45.906651+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:55:45.906651+0000","last_undegraded":"2024-09-14T10:55:45.906651+0000","last_fullsized":"2024-09-14T10:55:45.906651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:49.684958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288727+0000","last_change":"2024-09-14T10:55:06.696409+0000","last_active":"2024-09-14T10:58:13.288727+0000","last_peered":"2024-09-14T10:58:13.288727+0000","last_clean":"2024-09-14T10:58:13.288727+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:13.288727+0000","last_undegraded":"2024-09-14T10:58:13.288727+0000","last_fullsized":"2024-09-14T10:58:13.288727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:21.339716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.853982+0000","last_change":"2024-09-14T10:55:04.692725+0000","last_active":"2024-09-14T10:58:12.853982+0000","last_peered":"2024-09-14T10:58:12.853982+0000","last_clean":"2024-09-14T10:58:12.853982+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:12.853982+0000","last_undegraded":"2024-09-14T10:58:12.853982+0000","last_fullsized":"2024-09-14T10:58:12.853982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:11.121584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584098+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:57:12.584098+0000","last_peered":"2024-09-14T10:57:12.584098+0000","last_clean":"2024-09-14T10:57:12.584098+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:57:12.584098+0000","last_undegraded":"2024-09-14T10:57:12.584098+0000","last_fullsized":"2024-09-14T10:57:12.584098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:07.392085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747193+0000","last_change":"2024-09-14T10:55:04.688186+0000","last_active":"2024-09-14T10:55:41.747193+0000","last_peered":"2024-09-14T10:55:41.747193+0000","last_clean":"2024-09-14T10:55:41.747193+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:55:41.747193+0000","last_undegraded":"2024-09-14T10:55:41.747193+0000","last_fullsized":"2024-09-14T10:55:41.747193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:00.846319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747700+0000","last_change":"2024-09-14T10:55:06.706855+0000","last_active":"2024-09-14T10:55:41.747700+0000","last_peered":"2024-09-14T10:55:41.747700+0000","last_clean":"2024-09-14T10:55:41.747700+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:55:41.747700+0000","last_undegraded":"2024-09-14T10:55:41.747700+0000","last_fullsized":"2024-09-14T10:55:41.747700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:37.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745885+0000","last_change":"2024-09-14T10:55:04.713422+0000","last_active":"2024-09-14T10:55:41.745885+0000","last_peered":"2024-09-14T10:55:41.745885+0000","last_clean":"2024-09-14T10:55:41.745885+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:55:41.745885+0000","last_undegraded":"2024-09-14T10:55:41.745885+0000","last_fullsized":"2024-09-14T10:55:41.745885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.810507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254690+0000","last_change":"2024-09-14T10:55:06.693603+0000","last_active":"2024-09-14T10:58:13.254690+0000","last_peered":"2024-09-14T10:58:13.254690+0000","last_clean":"2024-09-14T10:58:13.254690+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:13.254690+0000","last_undegraded":"2024-09-14T10:58:13.254690+0000","last_fullsized":"2024-09-14T10:58:13.254690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.667603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750884+0000","last_change":"2024-09-14T10:55:04.703452+0000","last_active":"2024-09-14T10:55:41.750884+0000","last_peered":"2024-09-14T10:55:41.750884+0000","last_clean":"2024-09-14T10:55:41.750884+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:55:41.750884+0000","last_undegraded":"2024-09-14T10:55:41.750884+0000","last_fullsized":"2024-09-14T10:55:41.750884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:00.261748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.269807+0000","last_change":"2024-09-14T10:55:06.695095+0000","last_active":"2024-09-14T10:55:46.269807+0000","last_peered":"2024-09-14T10:55:46.269807+0000","last_clean":"2024-09-14T10:55:46.269807+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:55:46.269807+0000","last_undegraded":"2024-09-14T10:55:46.269807+0000","last_fullsized":"2024-09-14T10:55:46.269807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:34.488242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747648+0000","last_change":"2024-09-14T10:55:04.692552+0000","last_active":"2024-09-14T10:55:41.747648+0000","last_peered":"2024-09-14T10:55:41.747648+0000","last_clean":"2024-09-14T10:55:41.747648+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:55:41.747648+0000","last_undegraded":"2024-09-14T10:55:41.747648+0000","last_fullsized":"2024-09-14T10:55:41.747648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:21.177487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.063117+0000","last_change":"2024-09-14T10:55:06.701407+0000","last_active":"2024-09-14T10:58:13.063117+0000","last_peered":"2024-09-14T10:58:13.063117+0000","last_clean":"2024-09-14T10:58:13.063117+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:13.063117+0000","last_undegraded":"2024-09-14T10:58:13.063117+0000","last_fullsized":"2024-09-14T10:58:13.063117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:37.860704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741718+0000","last_change":"2024-09-14T10:55:04.710334+0000","last_active":"2024-09-14T10:55:41.741718+0000","last_peered":"2024-09-14T10:55:41.741718+0000","last_clean":"2024-09-14T10:55:41.741718+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:55:41.741718+0000","last_undegraded":"2024-09-14T10:55:41.741718+0000","last_fullsized":"2024-09-14T10:55:41.741718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.591594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.933306+0000","last_change":"2024-09-14T10:55:04.708511+0000","last_active":"2024-09-14T10:58:12.933306+0000","last_peered":"2024-09-14T10:58:12.933306+0000","last_clean":"2024-09-14T10:58:12.933306+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:12.933306+0000","last_undegraded":"2024-09-14T10:58:12.933306+0000","last_fullsized":"2024-09-14T10:58:12.933306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.156640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'5","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:25.087198+0000","last_change":"2024-09-14T10:55:41.752889+0000","last_active":"2024-09-14T10:57:25.087198+0000","last_peered":"2024-09-14T10:57:25.087198+0000","last_clean":"2024-09-14T10:57:25.087198+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:57:25.087198+0000","last_undegraded":"2024-09-14T10:57:25.087198+0000","last_fullsized":"2024-09-14T10:57:25.087198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:42.730360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745601+0000","last_change":"2024-09-14T10:55:04.711861+0000","last_active":"2024-09-14T10:55:41.745601+0000","last_peered":"2024-09-14T10:55:41.745601+0000","last_clean":"2024-09-14T10:55:41.745601+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:55:41.745601+0000","last_undegraded":"2024-09-14T10:55:41.745601+0000","last_fullsized":"2024-09-14T10:55:41.745601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:53.636737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.585870+0000","last_change":"2024-09-14T10:55:06.693977+0000","last_active":"2024-09-14T10:57:12.585870+0000","last_peered":"2024-09-14T10:57:12.585870+0000","last_clean":"2024-09-14T10:57:12.585870+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:57:12.585870+0000","last_undegraded":"2024-09-14T10:57:12.585870+0000","last_fullsized":"2024-09-14T10:57:12.585870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:37.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745837+0000","last_change":"2024-09-14T10:55:04.709726+0000","last_active":"2024-09-14T10:55:41.745837+0000","last_peered":"2024-09-14T10:55:41.745837+0000","last_clean":"2024-09-14T10:55:41.745837+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:55:41.745837+0000","last_undegraded":"2024-09-14T10:55:41.745837+0000","last_fullsized":"2024-09-14T10:55:41.745837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:48.224901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206534+0000","last_change":"2024-09-14T10:55:06.706605+0000","last_active":"2024-09-14T10:58:13.206534+0000","last_peered":"2024-09-14T10:58:13.206534+0000","last_clean":"2024-09-14T10:58:13.206534+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:13.206534+0000","last_undegraded":"2024-09-14T10:58:13.206534+0000","last_fullsized":"2024-09-14T10:58:13.206534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:52.689688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743268+0000","last_change":"2024-09-14T10:55:04.699774+0000","last_active":"2024-09-14T10:55:41.743268+0000","last_peered":"2024-09-14T10:55:41.743268+0000","last_clean":"2024-09-14T10:55:41.743268+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:55:41.743268+0000","last_undegraded":"2024-09-14T10:55:41.743268+0000","last_fullsized":"2024-09-14T10:55:41.743268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:35.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288869+0000","last_change":"2024-09-14T10:55:06.699736+0000","last_active":"2024-09-14T10:58:13.288869+0000","last_peered":"2024-09-14T10:58:13.288869+0000","last_clean":"2024-09-14T10:58:13.288869+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:13.288869+0000","last_undegraded":"2024-09-14T10:58:13.288869+0000","last_fullsized":"2024-09-14T10:58:13.288869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.763519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744546+0000","last_change":"2024-09-14T10:55:04.709992+0000","last_active":"2024-09-14T10:55:41.744546+0000","last_peered":"2024-09-14T10:55:41.744546+0000","last_clean":"2024-09-14T10:55:41.744546+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:55:41.744546+0000","last_undegraded":"2024-09-14T10:55:41.744546+0000","last_fullsized":"2024-09-14T10:55:41.744546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:50.555115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.185204+0000","last_change":"2024-09-14T10:55:04.699259+0000","last_active":"2024-09-14T10:58:13.185204+0000","last_peered":"2024-09-14T10:58:13.185204+0000","last_clean":"2024-09-14T10:58:13.185204+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:13.185204+0000","last_undegraded":"2024-09-14T10:58:13.185204+0000","last_fullsized":"2024-09-14T10:58:13.185204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:40.790660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254366+0000","last_change":"2024-09-14T10:55:06.695857+0000","last_active":"2024-09-14T10:58:13.254366+0000","last_peered":"2024-09-14T10:58:13.254366+0000","last_clean":"2024-09-14T10:58:13.254366+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:13.254366+0000","last_undegraded":"2024-09-14T10:58:13.254366+0000","last_fullsized":"2024-09-14T10:58:13.254366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.647597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747002+0000","last_change":"2024-09-14T10:55:04.708597+0000","last_active":"2024-09-14T10:55:41.747002+0000","last_peered":"2024-09-14T10:55:41.747002+0000","last_clean":"2024-09-14T10:55:41.747002+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:55:41.747002+0000","last_undegraded":"2024-09-14T10:55:41.747002+0000","last_fullsized":"2024-09-14T10:55:41.747002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:23.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742085+0000","last_change":"2024-09-14T10:55:04.710032+0000","last_active":"2024-09-14T10:55:41.742085+0000","last_peered":"2024-09-14T10:55:41.742085+0000","last_clean":"2024-09-14T10:55:41.742085+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:55:41.742085+0000","last_undegraded":"2024-09-14T10:55:41.742085+0000","last_fullsized":"2024-09-14T10:55:41.742085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:53.935014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970776+0000","last_change":"2024-09-14T10:55:06.697653+0000","last_active":"2024-09-14T10:58:12.970776+0000","last_peered":"2024-09-14T10:58:12.970776+0000","last_clean":"2024-09-14T10:58:12.970776+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:12.970776+0000","last_undegraded":"2024-09-14T10:58:12.970776+0000","last_fullsized":"2024-09-14T10:58:12.970776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:19.133663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.907988+0000","last_change":"2024-09-14T10:55:04.708709+0000","last_active":"2024-09-14T10:58:12.907988+0000","last_peered":"2024-09-14T10:58:12.907988+0000","last_clean":"2024-09-14T10:58:12.907988+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:12.907988+0000","last_undegraded":"2024-09-14T10:58:12.907988+0000","last_fullsized":"2024-09-14T10:58:12.907988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.909709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.289007+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:58:13.289007+0000","last_peered":"2024-09-14T10:58:13.289007+0000","last_clean":"2024-09-14T10:58:13.289007+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:13.289007+0000","last_undegraded":"2024-09-14T10:58:13.289007+0000","last_fullsized":"2024-09-14T10:58:13.289007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:19.903453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":9028480,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26136576,"data_stored":26136576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":9012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":9228288,"data_stored":8874188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44856,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326984,"statfs":{"total":96636764160,"available":96590831616,"internally_reserved":0,"allocated":9740288,"data_stored":9460416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44892,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326948,"statfs":{"total":96636764160,"available":96590794752,"internally_reserved":0,"allocated":9777152,"data_stored":9463327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52260,"kb_used_data":12756,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319580,"statfs":{"total":96636764160,"available":96583249920,"internally_reserved":0,"allocated":13062144,"data_stored":12744757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:58:20.394 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f020713d640 1 Processor -- start 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f020713d640 1 -- start start 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f020713d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f020012cba0 0x7f02001315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f020713d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020009a290 con 0x7f020012c0b0 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f020713d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f0200071860 con 0x7f020012cba0 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f01fffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f020012cba0 0x7f02001315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f0204ed9640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f020012c0b0 0x7f020012c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40230/0 (socket says 172.21.15.116:40230) 2024-09-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f01fffff640 1 --2- 172.21.15.116:0/1059625557 >> v2:172.21.15.116:3300/0 conn(0x7f020012cba0 0x7f02001315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41316/0 (socket says 172.21.15.116:41316) 2024-09-14T10:58:20.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.493+0000 7f0204ed9640 1 -- 172.21.15.116:0/1059625557 learned_addr learned my addr 172.21.15.116:0/1059625557 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:20.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01fffff640 1 -- 172.21.15.116:0/1059625557 >> v1:172.21.15.116:6789/0 conn(0x7f020012c0b0 legacy=0x7f020012c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01fffff640 1 -- 172.21.15.116:0/1059625557 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0200099e20 con 0x7f020012cba0 2024-09-14T10:58:20.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01fffff640 1 --2- 172.21.15.116:0/1059625557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012cba0 0x7f02001315e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009750 tx=0x7f01e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb46434d16f882c server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01ff7fe640 1 -- 172.21.15.116:0/1059625557 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e8037070 con 0x7f020012cba0 2024-09-14T10:58:20.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01ff7fe640 1 -- 172.21.15.116:0/1059625557 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e802ad80 con 0x7f020012cba0 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.494+0000 7f01ff7fe640 1 -- 172.21.15.116:0/1059625557 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01e8032590 con 0x7f020012cba0 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 -- 172.21.15.116:0/1059625557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012cba0 msgr2=0x7f02001315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 --2- 172.21.15.116:0/1059625557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012cba0 0x7f02001315e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009750 tx=0x7f01e802a140 comp rx=0 tx=0).stop 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 -- 172.21.15.116:0/1059625557 shutdown_connections 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 --2- 172.21.15.116:0/1059625557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012cba0 0x7f02001315e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 -- 172.21.15.116:0/1059625557 >> 172.21.15.116:0/1059625557 conn(0x7f020009abc0 msgr2=0x7f0200098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 -- 172.21.15.116:0/1059625557 shutdown_connections 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.495+0000 7f020713d640 1 -- 172.21.15.116:0/1059625557 wait complete. 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.496+0000 7f020713d640 1 Processor -- start 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.496+0000 7f020713d640 1 -- start start 2024-09-14T10:58:20.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.496+0000 7f020713d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.496+0000 7f020713d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0200070c40 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.496+0000 7f0204ed9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f0204ed9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41324/0 (socket says 172.21.15.116:41324) 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f0204ed9640 1 -- 172.21.15.116:0/244468016 learned_addr learned my addr 172.21.15.116:0/244468016 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f0204ed9640 1 -- 172.21.15.116:0/244468016 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001290b0 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f0204ed9640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f01f000cb40 tx=0x7f01f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0017070 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f000aba0 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0200128940 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0012400 con 0x7f020012c0b0 2024-09-14T10:58:20.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.497+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001269d0 con 0x7f020012c0b0 2024-09-14T10:58:20.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.498+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f01f001a070 con 0x7f020012c0b0 2024-09-14T10:58:20.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.498+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f020012c490 con 0x7f020012c0b0 2024-09-14T10:58:20.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.498+0000 7f01fd7fa640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 0x7f01e0040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.498+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f01f00533f0 con 0x7f020012c0b0 2024-09-14T10:58:20.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.498+0000 7f01fffff640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 0x7f01e0040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.499+0000 7f01fffff640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 0x7f01e0040a30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f01e8034000 tx=0x7f01e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.503+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f01f0019cd0 con 0x7f020012c0b0 2024-09-14T10:58:20.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.672+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0200129450 con 0x7f01e003e570 2024-09-14T10:58:20.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.682+0000 7f01fd7fa640 1 -- 172.21.15.116:0/244468016 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665751 (secure 0 0 0) 0x7f0200129450 con 0x7f01e003e570 2024-09-14T10:58:20.691 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:20.697 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:58:20.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 msgr2=0x7f01e0040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 0x7f01e0040a30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f01e8034000 tx=0x7f01e802e000 comp rx=0 tx=0).stop 2024-09-14T10:58:20.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 msgr2=0x7f02001262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f01f000cb40 tx=0x7f01f000a060 comp rx=0 tx=0).stop 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 shutdown_connections 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f01e003e570 0x7f01e0040a30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 --2- 172.21.15.116:0/244468016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f020012c0b0 0x7f02001262b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 >> 172.21.15.116:0/244468016 conn(0x7f020009abc0 msgr2=0x7f02001b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 shutdown_connections 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.686+0000 7f020713d640 1 -- 172.21.15.116:0/244468016 wait complete. 2024-09-14T10:58:20.700 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-14T10:58:20.119844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9635600,"num_objects":225,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4978,"num_read_kb":4512,"num_write":2066,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4468,"ondisk_log_size":4468,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186364,"kb_used_data":40828,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377300996,"statfs":{"total":386547056640,"available":386356219904,"internally_reserved":0,"allocated":41807872,"data_stored":40542688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9034471,"num_objects":5,"num_object_clones":0,"num_object_copies":13,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":513,"num_write":402,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004082"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751151+0000","last_change":"2024-09-14T10:55:04.693957+0000","last_active":"2024-09-14T10:55:41.751151+0000","last_peered":"2024-09-14T10:55:41.751151+0000","last_clean":"2024-09-14T10:55:41.751151+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:55:41.751151+0000","last_undegraded":"2024-09-14T10:55:41.751151+0000","last_fullsized":"2024-09-14T10:55:41.751151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.408068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099828+0000","last_change":"2024-09-14T10:55:06.701780+0000","last_active":"2024-09-14T10:57:37.099828+0000","last_peered":"2024-09-14T10:57:37.099828+0000","last_clean":"2024-09-14T10:57:37.099828+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:57:37.099828+0000","last_undegraded":"2024-09-14T10:57:37.099828+0000","last_fullsized":"2024-09-14T10:57:37.099828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:25.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747843+0000","last_change":"2024-09-14T10:55:04.693160+0000","last_active":"2024-09-14T10:55:41.747843+0000","last_peered":"2024-09-14T10:55:41.747843+0000","last_clean":"2024-09-14T10:55:41.747843+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:55:41.747843+0000","last_undegraded":"2024-09-14T10:55:41.747843+0000","last_fullsized":"2024-09-14T10:55:41.747843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:56.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.044322+0000","last_change":"2024-09-14T10:55:41.755184+0000","last_active":"2024-09-14T10:55:47.044322+0000","last_peered":"2024-09-14T10:55:47.044322+0000","last_clean":"2024-09-14T10:55:47.044322+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:55:47.044322+0000","last_undegraded":"2024-09-14T10:55:47.044322+0000","last_fullsized":"2024-09-14T10:55:47.044322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:40.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.486444+0000","last_change":"2024-09-14T10:55:04.710321+0000","last_active":"2024-09-14T10:57:12.486444+0000","last_peered":"2024-09-14T10:57:12.486444+0000","last_clean":"2024-09-14T10:57:12.486444+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:57:12.486444+0000","last_undegraded":"2024-09-14T10:57:12.486444+0000","last_fullsized":"2024-09-14T10:57:12.486444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:23.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.536080+0000","last_change":"2024-09-14T10:55:04.691950+0000","last_active":"2024-09-14T10:57:12.536080+0000","last_peered":"2024-09-14T10:57:12.536080+0000","last_clean":"2024-09-14T10:57:12.536080+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:57:12.536080+0000","last_undegraded":"2024-09-14T10:57:12.536080+0000","last_fullsized":"2024-09-14T10:57:12.536080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065448+0000","last_change":"2024-09-14T10:55:41.752605+0000","last_active":"2024-09-14T10:58:13.065448+0000","last_peered":"2024-09-14T10:58:13.065448+0000","last_clean":"2024-09-14T10:58:13.065448+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:13.065448+0000","last_undegraded":"2024-09-14T10:58:13.065448+0000","last_fullsized":"2024-09-14T10:58:13.065448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.626179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.952023+0000","last_change":"2024-09-14T10:55:04.693896+0000","last_active":"2024-09-14T10:58:12.952023+0000","last_peered":"2024-09-14T10:58:12.952023+0000","last_clean":"2024-09-14T10:58:12.952023+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:12.952023+0000","last_undegraded":"2024-09-14T10:58:12.952023+0000","last_fullsized":"2024-09-14T10:58:12.952023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:25.363300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282107+0000","last_change":"2024-09-14T10:55:06.694032+0000","last_active":"2024-09-14T10:58:13.282107+0000","last_peered":"2024-09-14T10:58:13.282107+0000","last_clean":"2024-09-14T10:58:13.282107+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:13.282107+0000","last_undegraded":"2024-09-14T10:58:13.282107+0000","last_fullsized":"2024-09-14T10:58:13.282107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:52.564428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747657+0000","last_change":"2024-09-14T10:55:04.691521+0000","last_active":"2024-09-14T10:55:41.747657+0000","last_peered":"2024-09-14T10:55:41.747657+0000","last_clean":"2024-09-14T10:55:41.747657+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:55:41.747657+0000","last_undegraded":"2024-09-14T10:55:41.747657+0000","last_fullsized":"2024-09-14T10:55:41.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:36.146379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194738+0000","last_change":"2024-09-14T10:55:04.699709+0000","last_active":"2024-09-14T10:58:13.194738+0000","last_peered":"2024-09-14T10:58:13.194738+0000","last_clean":"2024-09-14T10:58:13.194738+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:13.194738+0000","last_undegraded":"2024-09-14T10:58:13.194738+0000","last_fullsized":"2024-09-14T10:58:13.194738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:53.785449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751899+0000","last_change":"2024-09-14T10:55:06.698420+0000","last_active":"2024-09-14T10:55:41.751899+0000","last_peered":"2024-09-14T10:55:41.751899+0000","last_clean":"2024-09-14T10:55:41.751899+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:55:41.751899+0000","last_undegraded":"2024-09-14T10:55:41.751899+0000","last_fullsized":"2024-09-14T10:55:41.751899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:37.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745255+0000","last_change":"2024-09-14T10:55:04.692677+0000","last_active":"2024-09-14T10:55:41.745255+0000","last_peered":"2024-09-14T10:55:41.745255+0000","last_clean":"2024-09-14T10:55:41.745255+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:55:41.745255+0000","last_undegraded":"2024-09-14T10:55:41.745255+0000","last_fullsized":"2024-09-14T10:55:41.745255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:19.955381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071556+0000","last_change":"2024-09-14T10:55:06.695226+0000","last_active":"2024-09-14T10:56:29.071556+0000","last_peered":"2024-09-14T10:56:29.071556+0000","last_clean":"2024-09-14T10:56:29.071556+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:56:29.071556+0000","last_undegraded":"2024-09-14T10:56:29.071556+0000","last_fullsized":"2024-09-14T10:56:29.071556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:25.288530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'7","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.190959+0000","last_change":"2024-09-14T10:55:04.710323+0000","last_active":"2024-09-14T10:58:13.190959+0000","last_peered":"2024-09-14T10:58:13.190959+0000","last_clean":"2024-09-14T10:58:13.190959+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:13.190959+0000","last_undegraded":"2024-09-14T10:58:13.190959+0000","last_fullsized":"2024-09-14T10:58:13.190959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:30.799795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":7,"num_write":23,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.281969+0000","last_change":"2024-09-14T10:55:06.699438+0000","last_active":"2024-09-14T10:58:13.281969+0000","last_peered":"2024-09-14T10:58:13.281969+0000","last_clean":"2024-09-14T10:58:13.281969+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:13.281969+0000","last_undegraded":"2024-09-14T10:58:13.281969+0000","last_fullsized":"2024-09-14T10:58:13.281969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.481249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751744+0000","last_change":"2024-09-14T10:55:04.699550+0000","last_active":"2024-09-14T10:55:41.751744+0000","last_peered":"2024-09-14T10:55:41.751744+0000","last_clean":"2024-09-14T10:55:41.751744+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:55:41.751744+0000","last_undegraded":"2024-09-14T10:55:41.751744+0000","last_fullsized":"2024-09-14T10:55:41.751744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:02.897364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584049+0000","last_change":"2024-09-14T10:55:06.699540+0000","last_active":"2024-09-14T10:57:12.584049+0000","last_peered":"2024-09-14T10:57:12.584049+0000","last_clean":"2024-09-14T10:57:12.584049+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:57:12.584049+0000","last_undegraded":"2024-09-14T10:57:12.584049+0000","last_fullsized":"2024-09-14T10:57:12.584049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:32.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.410027+0000","last_change":"2024-09-14T10:55:04.710493+0000","last_active":"2024-09-14T10:55:45.410027+0000","last_peered":"2024-09-14T10:55:45.410027+0000","last_clean":"2024-09-14T10:55:45.410027+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:55:45.410027+0000","last_undegraded":"2024-09-14T10:55:45.410027+0000","last_fullsized":"2024-09-14T10:55:45.410027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:11.097667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254829+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:58:13.254829+0000","last_peered":"2024-09-14T10:58:13.254829+0000","last_clean":"2024-09-14T10:58:13.254829+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:13.254829+0000","last_undegraded":"2024-09-14T10:58:13.254829+0000","last_fullsized":"2024-09-14T10:58:13.254829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745936+0000","last_change":"2024-09-14T10:55:04.697066+0000","last_active":"2024-09-14T10:55:41.745936+0000","last_peered":"2024-09-14T10:55:41.745936+0000","last_clean":"2024-09-14T10:55:41.745936+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:55:41.745936+0000","last_undegraded":"2024-09-14T10:55:41.745936+0000","last_fullsized":"2024-09-14T10:55:41.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:54.003676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747047+0000","last_change":"2024-09-14T10:55:06.695487+0000","last_active":"2024-09-14T10:55:41.747047+0000","last_peered":"2024-09-14T10:55:41.747047+0000","last_clean":"2024-09-14T10:55:41.747047+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:55:41.747047+0000","last_undegraded":"2024-09-14T10:55:41.747047+0000","last_fullsized":"2024-09-14T10:55:41.747047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:37.971520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746476+0000","last_change":"2024-09-14T10:55:04.708722+0000","last_active":"2024-09-14T10:55:41.746476+0000","last_peered":"2024-09-14T10:55:41.746476+0000","last_clean":"2024-09-14T10:55:41.746476+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:55:41.746476+0000","last_undegraded":"2024-09-14T10:55:41.746476+0000","last_fullsized":"2024-09-14T10:55:41.746476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:12.437345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071829+0000","last_change":"2024-09-14T10:55:06.697009+0000","last_active":"2024-09-14T10:56:29.071829+0000","last_peered":"2024-09-14T10:56:29.071829+0000","last_clean":"2024-09-14T10:56:29.071829+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:56:29.071829+0000","last_undegraded":"2024-09-14T10:56:29.071829+0000","last_fullsized":"2024-09-14T10:56:29.071829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.649839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.200303+0000","last_change":"2024-09-14T10:55:04.701290+0000","last_active":"2024-09-14T10:58:13.200303+0000","last_peered":"2024-09-14T10:58:13.200303+0000","last_clean":"2024-09-14T10:58:13.200303+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:13.200303+0000","last_undegraded":"2024-09-14T10:58:13.200303+0000","last_fullsized":"2024-09-14T10:58:13.200303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.929907+0000","last_change":"2024-09-14T10:55:06.689207+0000","last_active":"2024-09-14T10:55:45.929907+0000","last_peered":"2024-09-14T10:55:45.929907+0000","last_clean":"2024-09-14T10:55:45.929907+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:55:45.929907+0000","last_undegraded":"2024-09-14T10:55:45.929907+0000","last_fullsized":"2024-09-14T10:55:45.929907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:51.007328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742523+0000","last_change":"2024-09-14T10:55:04.707857+0000","last_active":"2024-09-14T10:55:41.742523+0000","last_peered":"2024-09-14T10:55:41.742523+0000","last_clean":"2024-09-14T10:55:41.742523+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:55:41.742523+0000","last_undegraded":"2024-09-14T10:55:41.742523+0000","last_fullsized":"2024-09-14T10:55:41.742523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.756536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.160376+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:57:11.160376+0000","last_peered":"2024-09-14T10:57:11.160376+0000","last_clean":"2024-09-14T10:57:11.160376+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:57:11.160376+0000","last_undegraded":"2024-09-14T10:57:11.160376+0000","last_fullsized":"2024-09-14T10:57:11.160376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'17","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.982652+0000","last_change":"2024-09-14T10:55:06.692424+0000","last_active":"2024-09-14T10:58:12.982652+0000","last_peered":"2024-09-14T10:58:12.982652+0000","last_clean":"2024-09-14T10:58:12.982652+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:58:12.982652+0000","last_undegraded":"2024-09-14T10:58:12.982652+0000","last_fullsized":"2024-09-14T10:58:12.982652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:34.169033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745404+0000","last_change":"2024-09-14T10:55:04.702312+0000","last_active":"2024-09-14T10:55:41.745404+0000","last_peered":"2024-09-14T10:55:41.745404+0000","last_clean":"2024-09-14T10:55:41.745404+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:55:41.745404+0000","last_undegraded":"2024-09-14T10:55:41.745404+0000","last_fullsized":"2024-09-14T10:55:41.745404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:33.119288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746096+0000","last_change":"2024-09-14T10:55:08.697901+0000","last_active":"2024-09-14T10:55:41.746096+0000","last_peered":"2024-09-14T10:55:41.746096+0000","last_clean":"2024-09-14T10:55:41.746096+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:55:41.746096+0000","last_undegraded":"2024-09-14T10:55:41.746096+0000","last_fullsized":"2024-09-14T10:55:41.746096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:51.107343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.521522+0000","last_change":"2024-09-14T10:55:04.705534+0000","last_active":"2024-09-14T10:55:46.521522+0000","last_peered":"2024-09-14T10:55:46.521522+0000","last_clean":"2024-09-14T10:55:46.521522+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:55:46.521522+0000","last_undegraded":"2024-09-14T10:55:46.521522+0000","last_fullsized":"2024-09-14T10:55:46.521522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:26.471935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747967+0000","last_change":"2024-09-14T10:55:08.703383+0000","last_active":"2024-09-14T10:55:41.747967+0000","last_peered":"2024-09-14T10:55:41.747967+0000","last_clean":"2024-09-14T10:55:41.747967+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:55:41.747967+0000","last_undegraded":"2024-09-14T10:55:41.747967+0000","last_fullsized":"2024-09-14T10:55:41.747967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:03.440350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787559+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:08.787559+0000","last_peered":"2024-09-14T10:58:08.787559+0000","last_clean":"2024-09-14T10:58:08.787559+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:08.787559+0000","last_undegraded":"2024-09-14T10:58:08.787559+0000","last_fullsized":"2024-09-14T10:58:08.787559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270140+0000","last_change":"2024-09-14T10:55:06.697810+0000","last_active":"2024-09-14T10:55:46.270140+0000","last_peered":"2024-09-14T10:55:46.270140+0000","last_clean":"2024-09-14T10:55:46.270140+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:55:46.270140+0000","last_undegraded":"2024-09-14T10:55:46.270140+0000","last_fullsized":"2024-09-14T10:55:46.270140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:09.071738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.562476+0000","last_change":"2024-09-14T10:55:04.697949+0000","last_active":"2024-09-14T10:57:12.562476+0000","last_peered":"2024-09-14T10:57:12.562476+0000","last_clean":"2024-09-14T10:57:12.562476+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:57:12.562476+0000","last_undegraded":"2024-09-14T10:57:12.562476+0000","last_fullsized":"2024-09-14T10:57:12.562476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:06.191131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099957+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:57:37.099957+0000","last_peered":"2024-09-14T10:57:37.099957+0000","last_clean":"2024-09-14T10:57:37.099957+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:57:37.099957+0000","last_undegraded":"2024-09-14T10:57:37.099957+0000","last_fullsized":"2024-09-14T10:57:37.099957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071993+0000","last_change":"2024-09-14T10:55:06.700108+0000","last_active":"2024-09-14T10:58:13.071993+0000","last_peered":"2024-09-14T10:58:13.071993+0000","last_clean":"2024-09-14T10:58:13.071993+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:13.071993+0000","last_undegraded":"2024-09-14T10:58:13.071993+0000","last_fullsized":"2024-09-14T10:58:13.071993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:18.353830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751377+0000","last_change":"2024-09-14T10:55:04.703179+0000","last_active":"2024-09-14T10:55:41.751377+0000","last_peered":"2024-09-14T10:55:41.751377+0000","last_clean":"2024-09-14T10:55:41.751377+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:55:41.751377+0000","last_undegraded":"2024-09-14T10:55:41.751377+0000","last_fullsized":"2024-09-14T10:55:41.751377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.756195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743711+0000","last_change":"2024-09-14T10:55:08.703801+0000","last_active":"2024-09-14T10:55:41.743711+0000","last_peered":"2024-09-14T10:55:41.743711+0000","last_clean":"2024-09-14T10:55:41.743711+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:55:41.743711+0000","last_undegraded":"2024-09-14T10:55:41.743711+0000","last_fullsized":"2024-09-14T10:55:41.743711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:30.805117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.164937+0000","last_change":"2024-09-14T10:55:10.711150+0000","last_active":"2024-09-14T10:57:11.164937+0000","last_peered":"2024-09-14T10:57:11.164937+0000","last_clean":"2024-09-14T10:57:11.164937+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:57:11.164937+0000","last_undegraded":"2024-09-14T10:57:11.164937+0000","last_fullsized":"2024-09-14T10:57:11.164937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.611145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071856+0000","last_change":"2024-09-14T10:55:06.693096+0000","last_active":"2024-09-14T10:56:29.071856+0000","last_peered":"2024-09-14T10:56:29.071856+0000","last_clean":"2024-09-14T10:56:29.071856+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:56:29.071856+0000","last_undegraded":"2024-09-14T10:56:29.071856+0000","last_fullsized":"2024-09-14T10:56:29.071856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:46.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750779+0000","last_change":"2024-09-14T10:55:04.703485+0000","last_active":"2024-09-14T10:55:41.750779+0000","last_peered":"2024-09-14T10:55:41.750779+0000","last_clean":"2024-09-14T10:55:41.750779+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:55:41.750779+0000","last_undegraded":"2024-09-14T10:55:41.750779+0000","last_fullsized":"2024-09-14T10:55:41.750779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:22.991367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745415+0000","last_change":"2024-09-14T10:55:08.703463+0000","last_active":"2024-09-14T10:55:41.745415+0000","last_peered":"2024-09-14T10:55:41.745415+0000","last_clean":"2024-09-14T10:55:41.745415+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:55:41.745415+0000","last_undegraded":"2024-09-14T10:55:41.745415+0000","last_fullsized":"2024-09-14T10:55:41.745415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.948464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.144736+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:57:11.144736+0000","last_peered":"2024-09-14T10:57:11.144736+0000","last_clean":"2024-09-14T10:57:11.144736+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:57:11.144736+0000","last_undegraded":"2024-09-14T10:57:11.144736+0000","last_fullsized":"2024-09-14T10:57:11.144736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254953+0000","last_change":"2024-09-14T10:55:06.695110+0000","last_active":"2024-09-14T10:58:13.254953+0000","last_peered":"2024-09-14T10:58:13.254953+0000","last_clean":"2024-09-14T10:58:13.254953+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:13.254953+0000","last_undegraded":"2024-09-14T10:58:13.254953+0000","last_fullsized":"2024-09-14T10:58:13.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:34.398479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744632+0000","last_change":"2024-09-14T10:55:04.702159+0000","last_active":"2024-09-14T10:55:41.744632+0000","last_peered":"2024-09-14T10:55:41.744632+0000","last_clean":"2024-09-14T10:55:41.744632+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:55:41.744632+0000","last_undegraded":"2024-09-14T10:55:41.744632+0000","last_fullsized":"2024-09-14T10:55:41.744632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:32.478928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747579+0000","last_change":"2024-09-14T10:55:08.700971+0000","last_active":"2024-09-14T10:55:41.747579+0000","last_peered":"2024-09-14T10:55:41.747579+0000","last_clean":"2024-09-14T10:55:41.747579+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:55:41.747579+0000","last_undegraded":"2024-09-14T10:55:41.747579+0000","last_fullsized":"2024-09-14T10:55:41.747579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:53.973360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.166761+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:57:11.166761+0000","last_peered":"2024-09-14T10:57:11.166761+0000","last_clean":"2024-09-14T10:57:11.166761+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:57:11.166761+0000","last_undegraded":"2024-09-14T10:57:11.166761+0000","last_fullsized":"2024-09-14T10:57:11.166761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.883679+0000","last_change":"2024-09-14T10:55:06.687352+0000","last_active":"2024-09-14T10:56:28.883679+0000","last_peered":"2024-09-14T10:56:28.883679+0000","last_clean":"2024-09-14T10:56:28.883679+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:56:28.883679+0000","last_undegraded":"2024-09-14T10:56:28.883679+0000","last_fullsized":"2024-09-14T10:56:28.883679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.409908+0000","last_change":"2024-09-14T10:55:04.711138+0000","last_active":"2024-09-14T10:55:45.409908+0000","last_peered":"2024-09-14T10:55:45.409908+0000","last_clean":"2024-09-14T10:55:45.409908+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:55:45.409908+0000","last_undegraded":"2024-09-14T10:55:45.409908+0000","last_fullsized":"2024-09-14T10:55:45.409908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:30.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:42.082259+0000","last_change":"2024-09-14T10:55:41.752599+0000","last_active":"2024-09-14T10:55:42.082259+0000","last_peered":"2024-09-14T10:55:42.082259+0000","last_clean":"2024-09-14T10:55:42.082259+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:55:42.082259+0000","last_undegraded":"2024-09-14T10:55:42.082259+0000","last_fullsized":"2024-09-14T10:55:42.082259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'54","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.168560+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:57:11.168560+0000","last_peered":"2024-09-14T10:57:11.168560+0000","last_clean":"2024-09-14T10:57:11.168560+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:57:11.168560+0000","last_undegraded":"2024-09-14T10:57:11.168560+0000","last_fullsized":"2024-09-14T10:57:11.168560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744942+0000","last_change":"2024-09-14T10:55:06.703711+0000","last_active":"2024-09-14T10:55:41.744942+0000","last_peered":"2024-09-14T10:55:41.744942+0000","last_clean":"2024-09-14T10:55:41.744942+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:55:41.744942+0000","last_undegraded":"2024-09-14T10:55:41.744942+0000","last_fullsized":"2024-09-14T10:55:41.744942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:13.371367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746090+0000","last_change":"2024-09-14T10:55:04.691040+0000","last_active":"2024-09-14T10:55:41.746090+0000","last_peered":"2024-09-14T10:55:41.746090+0000","last_clean":"2024-09-14T10:55:41.746090+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:55:41.746090+0000","last_undegraded":"2024-09-14T10:55:41.746090+0000","last_fullsized":"2024-09-14T10:55:41.746090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:07.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747621+0000","last_change":"2024-09-14T10:55:08.699358+0000","last_active":"2024-09-14T10:55:41.747621+0000","last_peered":"2024-09-14T10:55:41.747621+0000","last_clean":"2024-09-14T10:55:41.747621+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:55:41.747621+0000","last_undegraded":"2024-09-14T10:55:41.747621+0000","last_fullsized":"2024-09-14T10:55:41.747621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'34","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.937869+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:12.937869+0000","last_peered":"2024-09-14T10:58:12.937869+0000","last_clean":"2024-09-14T10:58:12.937869+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:12.937869+0000","last_undegraded":"2024-09-14T10:58:12.937869+0000","last_fullsized":"2024-09-14T10:58:12.937869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270233+0000","last_change":"2024-09-14T10:55:06.701991+0000","last_active":"2024-09-14T10:55:46.270233+0000","last_peered":"2024-09-14T10:55:46.270233+0000","last_clean":"2024-09-14T10:55:46.270233+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:55:46.270233+0000","last_undegraded":"2024-09-14T10:55:46.270233+0000","last_fullsized":"2024-09-14T10:55:46.270233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:45.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743476+0000","last_change":"2024-09-14T10:55:04.700925+0000","last_active":"2024-09-14T10:55:41.743476+0000","last_peered":"2024-09-14T10:55:41.743476+0000","last_clean":"2024-09-14T10:55:41.743476+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:55:41.743476+0000","last_undegraded":"2024-09-14T10:55:41.743476+0000","last_fullsized":"2024-09-14T10:55:41.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:49.933927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746151+0000","last_change":"2024-09-14T10:55:08.703241+0000","last_active":"2024-09-14T10:55:41.746151+0000","last_peered":"2024-09-14T10:55:41.746151+0000","last_clean":"2024-09-14T10:55:41.746151+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:55:41.746151+0000","last_undegraded":"2024-09-14T10:55:41.746151+0000","last_fullsized":"2024-09-14T10:55:41.746151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.686570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'39","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.174674+0000","last_change":"2024-09-14T10:55:10.703424+0000","last_active":"2024-09-14T10:57:11.174674+0000","last_peered":"2024-09-14T10:57:11.174674+0000","last_clean":"2024-09-14T10:57:11.174674+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:57:11.174674+0000","last_undegraded":"2024-09-14T10:57:11.174674+0000","last_fullsized":"2024-09-14T10:57:11.174674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:42.700099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.381724+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:13.381724+0000","last_peered":"2024-09-14T10:58:13.381724+0000","last_clean":"2024-09-14T10:58:13.381724+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:13.381724+0000","last_undegraded":"2024-09-14T10:58:13.381724+0000","last_fullsized":"2024-09-14T10:58:13.381724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065459+0000","last_change":"2024-09-14T10:55:06.695542+0000","last_active":"2024-09-14T10:58:13.065459+0000","last_peered":"2024-09-14T10:58:13.065459+0000","last_clean":"2024-09-14T10:58:13.065459+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:13.065459+0000","last_undegraded":"2024-09-14T10:58:13.065459+0000","last_fullsized":"2024-09-14T10:58:13.065459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.739856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742547+0000","last_change":"2024-09-14T10:55:04.707433+0000","last_active":"2024-09-14T10:55:41.742547+0000","last_peered":"2024-09-14T10:55:41.742547+0000","last_clean":"2024-09-14T10:55:41.742547+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:55:41.742547+0000","last_undegraded":"2024-09-14T10:55:41.742547+0000","last_fullsized":"2024-09-14T10:55:41.742547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.332597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224554+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:57:12.224554+0000","last_peered":"2024-09-14T10:57:12.224554+0000","last_clean":"2024-09-14T10:57:12.224554+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:57:12.224554+0000","last_undegraded":"2024-09-14T10:57:12.224554+0000","last_fullsized":"2024-09-14T10:57:12.224554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":459,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.337503+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:13.337503+0000","last_peered":"2024-09-14T10:58:13.337503+0000","last_clean":"2024-09-14T10:58:13.337503+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:13.337503+0000","last_undegraded":"2024-09-14T10:58:13.337503+0000","last_fullsized":"2024-09-14T10:58:13.337503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:22.097476+0000","last_change":"2024-09-14T10:55:06.706335+0000","last_active":"2024-09-14T10:57:22.097476+0000","last_peered":"2024-09-14T10:57:22.097476+0000","last_clean":"2024-09-14T10:57:22.097476+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:57:22.097476+0000","last_undegraded":"2024-09-14T10:57:22.097476+0000","last_fullsized":"2024-09-14T10:57:22.097476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.143962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.411031+0000","last_change":"2024-09-14T10:55:04.710463+0000","last_active":"2024-09-14T10:55:45.411031+0000","last_peered":"2024-09-14T10:55:45.411031+0000","last_clean":"2024-09-14T10:55:45.411031+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:55:45.411031+0000","last_undegraded":"2024-09-14T10:55:45.411031+0000","last_fullsized":"2024-09-14T10:55:45.411031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:37.366298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.161657+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:57:11.161657+0000","last_peered":"2024-09-14T10:57:11.161657+0000","last_clean":"2024-09-14T10:57:11.161657+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:57:11.161657+0000","last_undegraded":"2024-09-14T10:57:11.161657+0000","last_fullsized":"2024-09-14T10:57:11.161657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072341+0000","last_change":"2024-09-14T10:55:06.700492+0000","last_active":"2024-09-14T10:56:29.072341+0000","last_peered":"2024-09-14T10:56:29.072341+0000","last_clean":"2024-09-14T10:56:29.072341+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:56:29.072341+0000","last_undegraded":"2024-09-14T10:56:29.072341+0000","last_fullsized":"2024-09-14T10:56:29.072341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:08.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743002+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:55:41.743002+0000","last_peered":"2024-09-14T10:55:41.743002+0000","last_clean":"2024-09-14T10:55:41.743002+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:55:41.743002+0000","last_undegraded":"2024-09-14T10:55:41.743002+0000","last_fullsized":"2024-09-14T10:55:41.743002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742229+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:55:41.742229+0000","last_peered":"2024-09-14T10:55:41.742229+0000","last_clean":"2024-09-14T10:55:41.742229+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:55:41.742229+0000","last_undegraded":"2024-09-14T10:55:41.742229+0000","last_fullsized":"2024-09-14T10:55:41.742229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.277466+0000","last_change":"2024-09-14T10:55:04.711278+0000","last_active":"2024-09-14T10:58:13.277466+0000","last_peered":"2024-09-14T10:58:13.277466+0000","last_clean":"2024-09-14T10:58:13.277466+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:13.277466+0000","last_undegraded":"2024-09-14T10:58:13.277466+0000","last_fullsized":"2024-09-14T10:58:13.277466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:22.252465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746166+0000","last_change":"2024-09-14T10:55:08.700288+0000","last_active":"2024-09-14T10:55:41.746166+0000","last_peered":"2024-09-14T10:55:41.746166+0000","last_clean":"2024-09-14T10:55:41.746166+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:55:41.746166+0000","last_undegraded":"2024-09-14T10:55:41.746166+0000","last_fullsized":"2024-09-14T10:55:41.746166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:02.043861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.172718+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:57:11.172718+0000","last_peered":"2024-09-14T10:57:11.172718+0000","last_clean":"2024-09-14T10:57:11.172718+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:57:11.172718+0000","last_undegraded":"2024-09-14T10:57:11.172718+0000","last_fullsized":"2024-09-14T10:57:11.172718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971149+0000","last_change":"2024-09-14T10:55:06.692907+0000","last_active":"2024-09-14T10:58:12.971149+0000","last_peered":"2024-09-14T10:58:12.971149+0000","last_clean":"2024-09-14T10:58:12.971149+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:12.971149+0000","last_undegraded":"2024-09-14T10:58:12.971149+0000","last_fullsized":"2024-09-14T10:58:12.971149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:04.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741463+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:55:41.741463+0000","last_peered":"2024-09-14T10:55:41.741463+0000","last_clean":"2024-09-14T10:55:41.741463+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:55:41.741463+0000","last_undegraded":"2024-09-14T10:55:41.741463+0000","last_fullsized":"2024-09-14T10:55:41.741463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745280+0000","last_change":"2024-09-14T10:55:04.692738+0000","last_active":"2024-09-14T10:55:41.745280+0000","last_peered":"2024-09-14T10:55:41.745280+0000","last_clean":"2024-09-14T10:55:41.745280+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:55:41.745280+0000","last_undegraded":"2024-09-14T10:55:41.745280+0000","last_fullsized":"2024-09-14T10:55:41.745280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.808200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787545+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:08.787545+0000","last_peered":"2024-09-14T10:58:08.787545+0000","last_clean":"2024-09-14T10:58:08.787545+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:08.787545+0000","last_undegraded":"2024-09-14T10:58:08.787545+0000","last_fullsized":"2024-09-14T10:58:08.787545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971995+0000","last_change":"2024-09-14T10:55:06.697381+0000","last_active":"2024-09-14T10:58:12.971995+0000","last_peered":"2024-09-14T10:58:12.971995+0000","last_clean":"2024-09-14T10:58:12.971995+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:12.971995+0000","last_undegraded":"2024-09-14T10:58:12.971995+0000","last_fullsized":"2024-09-14T10:58:12.971995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:17.404755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746730+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:55:41.746730+0000","last_peered":"2024-09-14T10:55:41.746730+0000","last_clean":"2024-09-14T10:55:41.746730+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:55:41.746730+0000","last_undegraded":"2024-09-14T10:55:41.746730+0000","last_fullsized":"2024-09-14T10:55:41.746730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.883807+0000","last_change":"2024-09-14T10:55:04.703428+0000","last_active":"2024-09-14T10:58:12.883807+0000","last_peered":"2024-09-14T10:58:12.883807+0000","last_clean":"2024-09-14T10:58:12.883807+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:12.883807+0000","last_undegraded":"2024-09-14T10:58:12.883807+0000","last_fullsized":"2024-09-14T10:58:12.883807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:53.536029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750615+0000","last_change":"2024-09-14T10:55:08.699744+0000","last_active":"2024-09-14T10:55:41.750615+0000","last_peered":"2024-09-14T10:55:41.750615+0000","last_clean":"2024-09-14T10:55:41.750615+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:55:41.750615+0000","last_undegraded":"2024-09-14T10:55:41.750615+0000","last_fullsized":"2024-09-14T10:55:41.750615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:26.469946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787613+0000","last_change":"2024-09-14T10:55:10.711152+0000","last_active":"2024-09-14T10:58:08.787613+0000","last_peered":"2024-09-14T10:58:08.787613+0000","last_clean":"2024-09-14T10:58:08.787613+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:08.787613+0000","last_undegraded":"2024-09-14T10:58:08.787613+0000","last_fullsized":"2024-09-14T10:58:08.787613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:00.848960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254782+0000","last_change":"2024-09-14T10:55:06.696400+0000","last_active":"2024-09-14T10:58:13.254782+0000","last_peered":"2024-09-14T10:58:13.254782+0000","last_clean":"2024-09-14T10:58:13.254782+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:13.254782+0000","last_undegraded":"2024-09-14T10:58:13.254782+0000","last_fullsized":"2024-09-14T10:58:13.254782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:27.637523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742327+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:55:41.742327+0000","last_peered":"2024-09-14T10:55:41.742327+0000","last_clean":"2024-09-14T10:55:41.742327+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:55:41.742327+0000","last_undegraded":"2024-09-14T10:55:41.742327+0000","last_fullsized":"2024-09-14T10:55:41.742327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746853+0000","last_change":"2024-09-14T10:55:04.701485+0000","last_active":"2024-09-14T10:55:41.746853+0000","last_peered":"2024-09-14T10:55:41.746853+0000","last_clean":"2024-09-14T10:55:41.746853+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:55:41.746853+0000","last_undegraded":"2024-09-14T10:55:41.746853+0000","last_fullsized":"2024-09-14T10:55:41.746853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:55.465771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747177+0000","last_change":"2024-09-14T10:55:08.697214+0000","last_active":"2024-09-14T10:55:41.747177+0000","last_peered":"2024-09-14T10:55:41.747177+0000","last_clean":"2024-09-14T10:55:41.747177+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:55:41.747177+0000","last_undegraded":"2024-09-14T10:55:41.747177+0000","last_fullsized":"2024-09-14T10:55:41.747177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:19.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.216318+0000","last_change":"2024-09-14T10:55:06.706535+0000","last_active":"2024-09-14T10:58:13.216318+0000","last_peered":"2024-09-14T10:58:13.216318+0000","last_clean":"2024-09-14T10:58:13.216318+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:13.216318+0000","last_undegraded":"2024-09-14T10:58:13.216318+0000","last_fullsized":"2024-09-14T10:58:13.216318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:55.794763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745720+0000","last_change":"2024-09-14T10:55:04.700577+0000","last_active":"2024-09-14T10:55:41.745720+0000","last_peered":"2024-09-14T10:55:41.745720+0000","last_clean":"2024-09-14T10:55:41.745720+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:55:41.745720+0000","last_undegraded":"2024-09-14T10:55:41.745720+0000","last_fullsized":"2024-09-14T10:55:41.745720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:41.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746368+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:55:41.746368+0000","last_peered":"2024-09-14T10:55:41.746368+0000","last_clean":"2024-09-14T10:55:41.746368+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:55:41.746368+0000","last_undegraded":"2024-09-14T10:55:41.746368+0000","last_fullsized":"2024-09-14T10:55:41.746368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.400872+0000","last_change":"2024-09-14T10:55:08.697596+0000","last_active":"2024-09-14T10:58:13.400872+0000","last_peered":"2024-09-14T10:58:13.400872+0000","last_clean":"2024-09-14T10:58:13.400872+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:13.400872+0000","last_undegraded":"2024-09-14T10:58:13.400872+0000","last_fullsized":"2024-09-14T10:58:13.400872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:19.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288374+0000","last_change":"2024-09-14T10:55:06.706584+0000","last_active":"2024-09-14T10:58:13.288374+0000","last_peered":"2024-09-14T10:58:13.288374+0000","last_clean":"2024-09-14T10:58:13.288374+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:13.288374+0000","last_undegraded":"2024-09-14T10:58:13.288374+0000","last_fullsized":"2024-09-14T10:58:13.288374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.341911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.872057+0000","last_change":"2024-09-14T10:55:04.693803+0000","last_active":"2024-09-14T10:58:12.872057+0000","last_peered":"2024-09-14T10:58:12.872057+0000","last_clean":"2024-09-14T10:58:12.872057+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:12.872057+0000","last_undegraded":"2024-09-14T10:58:12.872057+0000","last_fullsized":"2024-09-14T10:58:12.872057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:11.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744220+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:55:41.744220+0000","last_peered":"2024-09-14T10:55:41.744220+0000","last_clean":"2024-09-14T10:55:41.744220+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:55:41.744220+0000","last_undegraded":"2024-09-14T10:55:41.744220+0000","last_fullsized":"2024-09-14T10:55:41.744220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787486+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:08.787486+0000","last_peered":"2024-09-14T10:58:08.787486+0000","last_clean":"2024-09-14T10:58:08.787486+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:08.787486+0000","last_undegraded":"2024-09-14T10:58:08.787486+0000","last_fullsized":"2024-09-14T10:58:08.787486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.576048+0000","last_change":"2024-09-14T10:55:06.700418+0000","last_active":"2024-09-14T10:57:12.576048+0000","last_peered":"2024-09-14T10:57:12.576048+0000","last_clean":"2024-09-14T10:57:12.576048+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:57:12.576048+0000","last_undegraded":"2024-09-14T10:57:12.576048+0000","last_fullsized":"2024-09-14T10:57:12.576048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.529891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747368+0000","last_change":"2024-09-14T10:55:04.701334+0000","last_active":"2024-09-14T10:55:41.747368+0000","last_peered":"2024-09-14T10:55:41.747368+0000","last_clean":"2024-09-14T10:55:41.747368+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:55:41.747368+0000","last_undegraded":"2024-09-14T10:55:41.747368+0000","last_fullsized":"2024-09-14T10:55:41.747368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:44.481979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747311+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:55:41.747311+0000","last_peered":"2024-09-14T10:55:41.747311+0000","last_clean":"2024-09-14T10:55:41.747311+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:55:41.747311+0000","last_undegraded":"2024-09-14T10:55:41.747311+0000","last_fullsized":"2024-09-14T10:55:41.747311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206572+0000","last_change":"2024-09-14T10:55:06.696240+0000","last_active":"2024-09-14T10:58:13.206572+0000","last_peered":"2024-09-14T10:58:13.206572+0000","last_clean":"2024-09-14T10:58:13.206572+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:13.206572+0000","last_undegraded":"2024-09-14T10:58:13.206572+0000","last_fullsized":"2024-09-14T10:58:13.206572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:55.340683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747296+0000","last_change":"2024-09-14T10:55:04.711259+0000","last_active":"2024-09-14T10:55:41.747296+0000","last_peered":"2024-09-14T10:55:41.747296+0000","last_clean":"2024-09-14T10:55:41.747296+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:55:41.747296+0000","last_undegraded":"2024-09-14T10:55:41.747296+0000","last_fullsized":"2024-09-14T10:55:41.747296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:39.310566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746456+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:55:41.746456+0000","last_peered":"2024-09-14T10:55:41.746456+0000","last_clean":"2024-09-14T10:55:41.746456+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:55:41.746456+0000","last_undegraded":"2024-09-14T10:55:41.746456+0000","last_fullsized":"2024-09-14T10:55:41.746456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.205970+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:57:12.205970+0000","last_peered":"2024-09-14T10:57:12.205970+0000","last_clean":"2024-09-14T10:57:12.205970+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:57:12.205970+0000","last_undegraded":"2024-09-14T10:57:12.205970+0000","last_fullsized":"2024-09-14T10:57:12.205970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'84","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096443+0000","last_change":"2024-09-14T10:55:10.706862+0000","last_active":"2024-09-14T10:57:17.096443+0000","last_peered":"2024-09-14T10:57:17.096443+0000","last_clean":"2024-09-14T10:57:17.096443+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:57:17.096443+0000","last_undegraded":"2024-09-14T10:57:17.096443+0000","last_fullsized":"2024-09-14T10:57:17.096443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:12.621258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584503+0000","last_change":"2024-09-14T10:55:06.704098+0000","last_active":"2024-09-14T10:57:12.584503+0000","last_peered":"2024-09-14T10:57:12.584503+0000","last_clean":"2024-09-14T10:57:12.584503+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:57:12.584503+0000","last_undegraded":"2024-09-14T10:57:12.584503+0000","last_fullsized":"2024-09-14T10:57:12.584503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:55.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743912+0000","last_change":"2024-09-14T10:55:04.711613+0000","last_active":"2024-09-14T10:55:41.743912+0000","last_peered":"2024-09-14T10:55:41.743912+0000","last_clean":"2024-09-14T10:55:41.743912+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:55:41.743912+0000","last_undegraded":"2024-09-14T10:55:41.743912+0000","last_fullsized":"2024-09-14T10:55:41.743912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:11.362054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.755110+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:55:41.755110+0000","last_peered":"2024-09-14T10:55:41.755110+0000","last_clean":"2024-09-14T10:55:41.755110+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:55:41.755110+0000","last_undegraded":"2024-09-14T10:55:41.755110+0000","last_fullsized":"2024-09-14T10:55:41.755110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:31.114647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.165855+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:57:11.165855+0000","last_peered":"2024-09-14T10:57:11.165855+0000","last_clean":"2024-09-14T10:57:11.165855+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:57:11.165855+0000","last_undegraded":"2024-09-14T10:57:11.165855+0000","last_fullsized":"2024-09-14T10:57:11.165855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072086+0000","last_change":"2024-09-14T10:55:06.706869+0000","last_active":"2024-09-14T10:56:29.072086+0000","last_peered":"2024-09-14T10:56:29.072086+0000","last_clean":"2024-09-14T10:56:29.072086+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:56:29.072086+0000","last_undegraded":"2024-09-14T10:56:29.072086+0000","last_fullsized":"2024-09-14T10:56:29.072086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:29.765849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.528232+0000","last_change":"2024-09-14T10:55:04.701437+0000","last_active":"2024-09-14T10:55:46.528232+0000","last_peered":"2024-09-14T10:55:46.528232+0000","last_clean":"2024-09-14T10:55:46.528232+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:55:46.528232+0000","last_undegraded":"2024-09-14T10:55:46.528232+0000","last_fullsized":"2024-09-14T10:55:46.528232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:36.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255000+0000","last_change":"2024-09-14T10:55:06.693983+0000","last_active":"2024-09-14T10:58:13.255000+0000","last_peered":"2024-09-14T10:58:13.255000+0000","last_clean":"2024-09-14T10:58:13.255000+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:13.255000+0000","last_undegraded":"2024-09-14T10:58:13.255000+0000","last_fullsized":"2024-09-14T10:58:13.255000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.880458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750801+0000","last_change":"2024-09-14T10:55:04.698396+0000","last_active":"2024-09-14T10:55:41.750801+0000","last_peered":"2024-09-14T10:55:41.750801+0000","last_clean":"2024-09-14T10:55:41.750801+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:55:41.750801+0000","last_undegraded":"2024-09-14T10:55:41.750801+0000","last_fullsized":"2024-09-14T10:55:41.750801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:53.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749782+0000","last_change":"2024-09-14T10:55:08.706267+0000","last_active":"2024-09-14T10:55:41.749782+0000","last_peered":"2024-09-14T10:55:41.749782+0000","last_clean":"2024-09-14T10:55:41.749782+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:55:41.749782+0000","last_undegraded":"2024-09-14T10:55:41.749782+0000","last_fullsized":"2024-09-14T10:55:41.749782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:55.090960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:27.098679+0000","last_change":"2024-09-14T10:55:06.700291+0000","last_active":"2024-09-14T10:57:27.098679+0000","last_peered":"2024-09-14T10:57:27.098679+0000","last_clean":"2024-09-14T10:57:27.098679+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:57:27.098679+0000","last_undegraded":"2024-09-14T10:57:27.098679+0000","last_fullsized":"2024-09-14T10:57:27.098679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:17.660782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748263+0000","last_change":"2024-09-14T10:55:04.699426+0000","last_active":"2024-09-14T10:55:41.748263+0000","last_peered":"2024-09-14T10:55:41.748263+0000","last_clean":"2024-09-14T10:55:41.748263+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:55:41.748263+0000","last_undegraded":"2024-09-14T10:55:41.748263+0000","last_fullsized":"2024-09-14T10:55:41.748263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:02.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.150888+0000","last_change":"2024-09-14T10:55:10.702656+0000","last_active":"2024-09-14T10:57:11.150888+0000","last_peered":"2024-09-14T10:57:11.150888+0000","last_clean":"2024-09-14T10:57:11.150888+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:57:11.150888+0000","last_undegraded":"2024-09-14T10:57:11.150888+0000","last_fullsized":"2024-09-14T10:57:11.150888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:11.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741582+0000","last_change":"2024-09-14T10:55:04.710135+0000","last_active":"2024-09-14T10:55:41.741582+0000","last_peered":"2024-09-14T10:55:41.741582+0000","last_clean":"2024-09-14T10:55:41.741582+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:55:41.741582+0000","last_undegraded":"2024-09-14T10:55:41.741582+0000","last_fullsized":"2024-09-14T10:55:41.741582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:45.412903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065142+0000","last_change":"2024-09-14T10:55:06.697498+0000","last_active":"2024-09-14T10:58:13.065142+0000","last_peered":"2024-09-14T10:58:13.065142+0000","last_clean":"2024-09-14T10:58:13.065142+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:13.065142+0000","last_undegraded":"2024-09-14T10:58:13.065142+0000","last_fullsized":"2024-09-14T10:58:13.065142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:39.956062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.516347+0000","last_change":"2024-09-14T10:55:04.709771+0000","last_active":"2024-09-14T10:55:46.516347+0000","last_peered":"2024-09-14T10:55:46.516347+0000","last_clean":"2024-09-14T10:55:46.516347+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:55:46.516347+0000","last_undegraded":"2024-09-14T10:55:46.516347+0000","last_fullsized":"2024-09-14T10:55:46.516347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:06.645182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751169+0000","last_change":"2024-09-14T10:55:08.699650+0000","last_active":"2024-09-14T10:55:41.751169+0000","last_peered":"2024-09-14T10:55:41.751169+0000","last_clean":"2024-09-14T10:55:41.751169+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:55:41.751169+0000","last_undegraded":"2024-09-14T10:55:41.751169+0000","last_fullsized":"2024-09-14T10:55:41.751169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:29.469388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.151854+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:57:11.151854+0000","last_peered":"2024-09-14T10:57:11.151854+0000","last_clean":"2024-09-14T10:57:11.151854+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:57:11.151854+0000","last_undegraded":"2024-09-14T10:57:11.151854+0000","last_fullsized":"2024-09-14T10:57:11.151854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744988+0000","last_change":"2024-09-14T10:55:04.711540+0000","last_active":"2024-09-14T10:55:41.744988+0000","last_peered":"2024-09-14T10:55:41.744988+0000","last_clean":"2024-09-14T10:55:41.744988+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:55:41.744988+0000","last_undegraded":"2024-09-14T10:55:41.744988+0000","last_fullsized":"2024-09-14T10:55:41.744988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:34.258135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746905+0000","last_change":"2024-09-14T10:55:08.696759+0000","last_active":"2024-09-14T10:55:41.746905+0000","last_peered":"2024-09-14T10:55:41.746905+0000","last_clean":"2024-09-14T10:55:41.746905+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:55:41.746905+0000","last_undegraded":"2024-09-14T10:55:41.746905+0000","last_fullsized":"2024-09-14T10:55:41.746905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.250751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.213430+0000","last_change":"2024-09-14T10:55:06.687522+0000","last_active":"2024-09-14T10:58:13.213430+0000","last_peered":"2024-09-14T10:58:13.213430+0000","last_clean":"2024-09-14T10:58:13.213430+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:13.213430+0000","last_undegraded":"2024-09-14T10:58:13.213430+0000","last_fullsized":"2024-09-14T10:58:13.213430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.424148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742424+0000","last_change":"2024-09-14T10:55:04.707600+0000","last_active":"2024-09-14T10:55:41.742424+0000","last_peered":"2024-09-14T10:55:41.742424+0000","last_clean":"2024-09-14T10:55:41.742424+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:55:41.742424+0000","last_undegraded":"2024-09-14T10:55:41.742424+0000","last_fullsized":"2024-09-14T10:55:41.742424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:35.430004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.392241+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:13.392241+0000","last_peered":"2024-09-14T10:58:13.392241+0000","last_clean":"2024-09-14T10:58:13.392241+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:13.392241+0000","last_undegraded":"2024-09-14T10:58:13.392241+0000","last_fullsized":"2024-09-14T10:58:13.392241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099899+0000","last_change":"2024-09-14T10:55:06.687803+0000","last_active":"2024-09-14T10:57:37.099899+0000","last_peered":"2024-09-14T10:57:37.099899+0000","last_clean":"2024-09-14T10:57:37.099899+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:57:37.099899+0000","last_undegraded":"2024-09-14T10:57:37.099899+0000","last_fullsized":"2024-09-14T10:57:37.099899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:19.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099990+0000","last_change":"2024-09-14T10:55:04.697878+0000","last_active":"2024-09-14T10:57:37.099990+0000","last_peered":"2024-09-14T10:57:37.099990+0000","last_clean":"2024-09-14T10:57:37.099990+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:57:37.099990+0000","last_undegraded":"2024-09-14T10:57:37.099990+0000","last_fullsized":"2024-09-14T10:57:37.099990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.142769+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:57:11.142769+0000","last_peered":"2024-09-14T10:57:11.142769+0000","last_clean":"2024-09-14T10:57:11.142769+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:57:11.142769+0000","last_undegraded":"2024-09-14T10:57:11.142769+0000","last_fullsized":"2024-09-14T10:57:11.142769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282026+0000","last_change":"2024-09-14T10:55:06.687347+0000","last_active":"2024-09-14T10:58:13.282026+0000","last_peered":"2024-09-14T10:58:13.282026+0000","last_clean":"2024-09-14T10:58:13.282026+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:13.282026+0000","last_undegraded":"2024-09-14T10:58:13.282026+0000","last_fullsized":"2024-09-14T10:58:13.282026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:08.040457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744386+0000","last_change":"2024-09-14T10:55:04.711139+0000","last_active":"2024-09-14T10:55:41.744386+0000","last_peered":"2024-09-14T10:55:41.744386+0000","last_clean":"2024-09-14T10:55:41.744386+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:55:41.744386+0000","last_undegraded":"2024-09-14T10:55:41.744386+0000","last_fullsized":"2024-09-14T10:55:41.744386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.640526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750062+0000","last_change":"2024-09-14T10:55:08.697330+0000","last_active":"2024-09-14T10:55:41.750062+0000","last_peered":"2024-09-14T10:55:41.750062+0000","last_clean":"2024-09-14T10:55:41.750062+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:55:41.750062+0000","last_undegraded":"2024-09-14T10:55:41.750062+0000","last_fullsized":"2024-09-14T10:55:41.750062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.585707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.261968+0000","last_change":"2024-09-14T10:55:06.701898+0000","last_active":"2024-09-14T10:58:13.261968+0000","last_peered":"2024-09-14T10:58:13.261968+0000","last_clean":"2024-09-14T10:58:13.261968+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:58:13.261968+0000","last_undegraded":"2024-09-14T10:58:13.261968+0000","last_fullsized":"2024-09-14T10:58:13.261968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:01.158624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747660+0000","last_change":"2024-09-14T10:55:04.693915+0000","last_active":"2024-09-14T10:55:41.747660+0000","last_peered":"2024-09-14T10:55:41.747660+0000","last_clean":"2024-09-14T10:55:41.747660+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:55:41.747660+0000","last_undegraded":"2024-09-14T10:55:41.747660+0000","last_fullsized":"2024-09-14T10:55:41.747660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:42.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749018+0000","last_change":"2024-09-14T10:55:08.705127+0000","last_active":"2024-09-14T10:55:41.749018+0000","last_peered":"2024-09-14T10:55:41.749018+0000","last_clean":"2024-09-14T10:55:41.749018+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:55:41.749018+0000","last_undegraded":"2024-09-14T10:55:41.749018+0000","last_fullsized":"2024-09-14T10:55:41.749018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:13.732662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.167639+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:57:11.167639+0000","last_peered":"2024-09-14T10:57:11.167639+0000","last_clean":"2024-09-14T10:57:11.167639+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:57:11.167639+0000","last_undegraded":"2024-09-14T10:57:11.167639+0000","last_fullsized":"2024-09-14T10:57:11.167639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206948+0000","last_change":"2024-09-14T10:55:06.685023+0000","last_active":"2024-09-14T10:58:13.206948+0000","last_peered":"2024-09-14T10:58:13.206948+0000","last_clean":"2024-09-14T10:58:13.206948+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:13.206948+0000","last_undegraded":"2024-09-14T10:58:13.206948+0000","last_fullsized":"2024-09-14T10:58:13.206948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.730948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.095656+0000","last_change":"2024-09-14T10:55:04.699747+0000","last_active":"2024-09-14T10:57:12.095656+0000","last_peered":"2024-09-14T10:57:12.095656+0000","last_clean":"2024-09-14T10:57:12.095656+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:57:12.095656+0000","last_undegraded":"2024-09-14T10:57:12.095656+0000","last_fullsized":"2024-09-14T10:57:12.095656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:31.195740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224838+0000","last_change":"2024-09-14T10:55:08.704615+0000","last_active":"2024-09-14T10:57:12.224838+0000","last_peered":"2024-09-14T10:57:12.224838+0000","last_clean":"2024-09-14T10:57:12.224838+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:57:12.224838+0000","last_undegraded":"2024-09-14T10:57:12.224838+0000","last_fullsized":"2024-09-14T10:57:12.224838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:58.840952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'32","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.603846+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:12.603846+0000","last_peered":"2024-09-14T10:58:12.603846+0000","last_clean":"2024-09-14T10:58:12.603846+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:12.603846+0000","last_undegraded":"2024-09-14T10:58:12.603846+0000","last_fullsized":"2024-09-14T10:58:12.603846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970449+0000","last_change":"2024-09-14T10:55:06.706262+0000","last_active":"2024-09-14T10:58:12.970449+0000","last_peered":"2024-09-14T10:58:12.970449+0000","last_clean":"2024-09-14T10:58:12.970449+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:12.970449+0000","last_undegraded":"2024-09-14T10:58:12.970449+0000","last_fullsized":"2024-09-14T10:58:12.970449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:47.079971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745287+0000","last_change":"2024-09-14T10:55:04.692001+0000","last_active":"2024-09-14T10:55:41.745287+0000","last_peered":"2024-09-14T10:55:41.745287+0000","last_clean":"2024-09-14T10:55:41.745287+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:55:41.745287+0000","last_undegraded":"2024-09-14T10:55:41.745287+0000","last_fullsized":"2024-09-14T10:55:41.745287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:53.842302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071299+0000","last_change":"2024-09-14T10:55:06.687507+0000","last_active":"2024-09-14T10:58:13.071299+0000","last_peered":"2024-09-14T10:58:13.071299+0000","last_clean":"2024-09-14T10:58:13.071299+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:13.071299+0000","last_undegraded":"2024-09-14T10:58:13.071299+0000","last_fullsized":"2024-09-14T10:58:13.071299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:25.386577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745168+0000","last_change":"2024-09-14T10:55:04.688069+0000","last_active":"2024-09-14T10:55:41.745168+0000","last_peered":"2024-09-14T10:55:41.745168+0000","last_clean":"2024-09-14T10:55:41.745168+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:55:41.745168+0000","last_undegraded":"2024-09-14T10:55:41.745168+0000","last_fullsized":"2024-09-14T10:55:41.745168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.177526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.906651+0000","last_change":"2024-09-14T10:55:04.710926+0000","last_active":"2024-09-14T10:55:45.906651+0000","last_peered":"2024-09-14T10:55:45.906651+0000","last_clean":"2024-09-14T10:55:45.906651+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:55:45.906651+0000","last_undegraded":"2024-09-14T10:55:45.906651+0000","last_fullsized":"2024-09-14T10:55:45.906651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:49.684958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288727+0000","last_change":"2024-09-14T10:55:06.696409+0000","last_active":"2024-09-14T10:58:13.288727+0000","last_peered":"2024-09-14T10:58:13.288727+0000","last_clean":"2024-09-14T10:58:13.288727+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:13.288727+0000","last_undegraded":"2024-09-14T10:58:13.288727+0000","last_fullsized":"2024-09-14T10:58:13.288727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:21.339716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.853982+0000","last_change":"2024-09-14T10:55:04.692725+0000","last_active":"2024-09-14T10:58:12.853982+0000","last_peered":"2024-09-14T10:58:12.853982+0000","last_clean":"2024-09-14T10:58:12.853982+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:12.853982+0000","last_undegraded":"2024-09-14T10:58:12.853982+0000","last_fullsized":"2024-09-14T10:58:12.853982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:11.121584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584098+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:57:12.584098+0000","last_peered":"2024-09-14T10:57:12.584098+0000","last_clean":"2024-09-14T10:57:12.584098+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:57:12.584098+0000","last_undegraded":"2024-09-14T10:57:12.584098+0000","last_fullsized":"2024-09-14T10:57:12.584098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:07.392085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747193+0000","last_change":"2024-09-14T10:55:04.688186+0000","last_active":"2024-09-14T10:55:41.747193+0000","last_peered":"2024-09-14T10:55:41.747193+0000","last_clean":"2024-09-14T10:55:41.747193+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:55:41.747193+0000","last_undegraded":"2024-09-14T10:55:41.747193+0000","last_fullsized":"2024-09-14T10:55:41.747193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:00.846319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747700+0000","last_change":"2024-09-14T10:55:06.706855+0000","last_active":"2024-09-14T10:55:41.747700+0000","last_peered":"2024-09-14T10:55:41.747700+0000","last_clean":"2024-09-14T10:55:41.747700+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:55:41.747700+0000","last_undegraded":"2024-09-14T10:55:41.747700+0000","last_fullsized":"2024-09-14T10:55:41.747700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:37.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745885+0000","last_change":"2024-09-14T10:55:04.713422+0000","last_active":"2024-09-14T10:55:41.745885+0000","last_peered":"2024-09-14T10:55:41.745885+0000","last_clean":"2024-09-14T10:55:41.745885+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:55:41.745885+0000","last_undegraded":"2024-09-14T10:55:41.745885+0000","last_fullsized":"2024-09-14T10:55:41.745885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.810507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254690+0000","last_change":"2024-09-14T10:55:06.693603+0000","last_active":"2024-09-14T10:58:13.254690+0000","last_peered":"2024-09-14T10:58:13.254690+0000","last_clean":"2024-09-14T10:58:13.254690+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:13.254690+0000","last_undegraded":"2024-09-14T10:58:13.254690+0000","last_fullsized":"2024-09-14T10:58:13.254690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.667603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750884+0000","last_change":"2024-09-14T10:55:04.703452+0000","last_active":"2024-09-14T10:55:41.750884+0000","last_peered":"2024-09-14T10:55:41.750884+0000","last_clean":"2024-09-14T10:55:41.750884+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:55:41.750884+0000","last_undegraded":"2024-09-14T10:55:41.750884+0000","last_fullsized":"2024-09-14T10:55:41.750884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:00.261748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.269807+0000","last_change":"2024-09-14T10:55:06.695095+0000","last_active":"2024-09-14T10:55:46.269807+0000","last_peered":"2024-09-14T10:55:46.269807+0000","last_clean":"2024-09-14T10:55:46.269807+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:55:46.269807+0000","last_undegraded":"2024-09-14T10:55:46.269807+0000","last_fullsized":"2024-09-14T10:55:46.269807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:34.488242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747648+0000","last_change":"2024-09-14T10:55:04.692552+0000","last_active":"2024-09-14T10:55:41.747648+0000","last_peered":"2024-09-14T10:55:41.747648+0000","last_clean":"2024-09-14T10:55:41.747648+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:55:41.747648+0000","last_undegraded":"2024-09-14T10:55:41.747648+0000","last_fullsized":"2024-09-14T10:55:41.747648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:21.177487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.063117+0000","last_change":"2024-09-14T10:55:06.701407+0000","last_active":"2024-09-14T10:58:13.063117+0000","last_peered":"2024-09-14T10:58:13.063117+0000","last_clean":"2024-09-14T10:58:13.063117+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:13.063117+0000","last_undegraded":"2024-09-14T10:58:13.063117+0000","last_fullsized":"2024-09-14T10:58:13.063117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:37.860704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741718+0000","last_change":"2024-09-14T10:55:04.710334+0000","last_active":"2024-09-14T10:55:41.741718+0000","last_peered":"2024-09-14T10:55:41.741718+0000","last_clean":"2024-09-14T10:55:41.741718+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:55:41.741718+0000","last_undegraded":"2024-09-14T10:55:41.741718+0000","last_fullsized":"2024-09-14T10:55:41.741718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.591594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.933306+0000","last_change":"2024-09-14T10:55:04.708511+0000","last_active":"2024-09-14T10:58:12.933306+0000","last_peered":"2024-09-14T10:58:12.933306+0000","last_clean":"2024-09-14T10:58:12.933306+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:12.933306+0000","last_undegraded":"2024-09-14T10:58:12.933306+0000","last_fullsized":"2024-09-14T10:58:12.933306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.156640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'5","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:25.087198+0000","last_change":"2024-09-14T10:55:41.752889+0000","last_active":"2024-09-14T10:57:25.087198+0000","last_peered":"2024-09-14T10:57:25.087198+0000","last_clean":"2024-09-14T10:57:25.087198+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:57:25.087198+0000","last_undegraded":"2024-09-14T10:57:25.087198+0000","last_fullsized":"2024-09-14T10:57:25.087198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:42.730360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745601+0000","last_change":"2024-09-14T10:55:04.711861+0000","last_active":"2024-09-14T10:55:41.745601+0000","last_peered":"2024-09-14T10:55:41.745601+0000","last_clean":"2024-09-14T10:55:41.745601+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:55:41.745601+0000","last_undegraded":"2024-09-14T10:55:41.745601+0000","last_fullsized":"2024-09-14T10:55:41.745601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:53.636737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.585870+0000","last_change":"2024-09-14T10:55:06.693977+0000","last_active":"2024-09-14T10:57:12.585870+0000","last_peered":"2024-09-14T10:57:12.585870+0000","last_clean":"2024-09-14T10:57:12.585870+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:57:12.585870+0000","last_undegraded":"2024-09-14T10:57:12.585870+0000","last_fullsized":"2024-09-14T10:57:12.585870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:37.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745837+0000","last_change":"2024-09-14T10:55:04.709726+0000","last_active":"2024-09-14T10:55:41.745837+0000","last_peered":"2024-09-14T10:55:41.745837+0000","last_clean":"2024-09-14T10:55:41.745837+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:55:41.745837+0000","last_undegraded":"2024-09-14T10:55:41.745837+0000","last_fullsized":"2024-09-14T10:55:41.745837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:48.224901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206534+0000","last_change":"2024-09-14T10:55:06.706605+0000","last_active":"2024-09-14T10:58:13.206534+0000","last_peered":"2024-09-14T10:58:13.206534+0000","last_clean":"2024-09-14T10:58:13.206534+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:13.206534+0000","last_undegraded":"2024-09-14T10:58:13.206534+0000","last_fullsized":"2024-09-14T10:58:13.206534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:52.689688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743268+0000","last_change":"2024-09-14T10:55:04.699774+0000","last_active":"2024-09-14T10:55:41.743268+0000","last_peered":"2024-09-14T10:55:41.743268+0000","last_clean":"2024-09-14T10:55:41.743268+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:55:41.743268+0000","last_undegraded":"2024-09-14T10:55:41.743268+0000","last_fullsized":"2024-09-14T10:55:41.743268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:35.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288869+0000","last_change":"2024-09-14T10:55:06.699736+0000","last_active":"2024-09-14T10:58:13.288869+0000","last_peered":"2024-09-14T10:58:13.288869+0000","last_clean":"2024-09-14T10:58:13.288869+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:13.288869+0000","last_undegraded":"2024-09-14T10:58:13.288869+0000","last_fullsized":"2024-09-14T10:58:13.288869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.763519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744546+0000","last_change":"2024-09-14T10:55:04.709992+0000","last_active":"2024-09-14T10:55:41.744546+0000","last_peered":"2024-09-14T10:55:41.744546+0000","last_clean":"2024-09-14T10:55:41.744546+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:55:41.744546+0000","last_undegraded":"2024-09-14T10:55:41.744546+0000","last_fullsized":"2024-09-14T10:55:41.744546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:50.555115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.185204+0000","last_change":"2024-09-14T10:55:04.699259+0000","last_active":"2024-09-14T10:58:13.185204+0000","last_peered":"2024-09-14T10:58:13.185204+0000","last_clean":"2024-09-14T10:58:13.185204+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:13.185204+0000","last_undegraded":"2024-09-14T10:58:13.185204+0000","last_fullsized":"2024-09-14T10:58:13.185204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:40.790660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254366+0000","last_change":"2024-09-14T10:55:06.695857+0000","last_active":"2024-09-14T10:58:13.254366+0000","last_peered":"2024-09-14T10:58:13.254366+0000","last_clean":"2024-09-14T10:58:13.254366+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:13.254366+0000","last_undegraded":"2024-09-14T10:58:13.254366+0000","last_fullsized":"2024-09-14T10:58:13.254366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.647597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747002+0000","last_change":"2024-09-14T10:55:04.708597+0000","last_active":"2024-09-14T10:55:41.747002+0000","last_peered":"2024-09-14T10:55:41.747002+0000","last_clean":"2024-09-14T10:55:41.747002+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:55:41.747002+0000","last_undegraded":"2024-09-14T10:55:41.747002+0000","last_fullsized":"2024-09-14T10:55:41.747002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:23.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742085+0000","last_change":"2024-09-14T10:55:04.710032+0000","last_active":"2024-09-14T10:55:41.742085+0000","last_peered":"2024-09-14T10:55:41.742085+0000","last_clean":"2024-09-14T10:55:41.742085+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:55:41.742085+0000","last_undegraded":"2024-09-14T10:55:41.742085+0000","last_fullsized":"2024-09-14T10:55:41.742085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:53.935014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970776+0000","last_change":"2024-09-14T10:55:06.697653+0000","last_active":"2024-09-14T10:58:12.970776+0000","last_peered":"2024-09-14T10:58:12.970776+0000","last_clean":"2024-09-14T10:58:12.970776+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:12.970776+0000","last_undegraded":"2024-09-14T10:58:12.970776+0000","last_fullsized":"2024-09-14T10:58:12.970776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:19.133663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.907988+0000","last_change":"2024-09-14T10:55:04.708709+0000","last_active":"2024-09-14T10:58:12.907988+0000","last_peered":"2024-09-14T10:58:12.907988+0000","last_clean":"2024-09-14T10:58:12.907988+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:12.907988+0000","last_undegraded":"2024-09-14T10:58:12.907988+0000","last_fullsized":"2024-09-14T10:58:12.907988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.909709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.289007+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:58:13.289007+0000","last_peered":"2024-09-14T10:58:13.289007+0000","last_clean":"2024-09-14T10:58:13.289007+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:13.289007+0000","last_undegraded":"2024-09-14T10:58:13.289007+0000","last_fullsized":"2024-09-14T10:58:13.289007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:19.903453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":9028480,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26136576,"data_stored":26136576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":9012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":9228288,"data_stored":8874188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44856,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326984,"statfs":{"total":96636764160,"available":96590831616,"internally_reserved":0,"allocated":9740288,"data_stored":9460416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44892,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326948,"statfs":{"total":96636764160,"available":96590794752,"internally_reserved":0,"allocated":9777152,"data_stored":9463327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52260,"kb_used_data":12756,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319580,"statfs":{"total":96636764160,"available":96583249920,"internally_reserved":0,"allocated":13062144,"data_stored":12744757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:58:20.710 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:58:20.711 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:58:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.834+0000 7fcaf0a47640 1 Processor -- start 2024-09-14T10:58:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.834+0000 7fcaf0a47640 1 -- start start 2024-09-14T10:58:20.834 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.834+0000 7fcaf0a47640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcaec06dfb0 0x7fcaec06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.834+0000 7fcaf0a47640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaec071660 con 0x7fcaec06e8d0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.834+0000 7fcaf0a47640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fcaec072550 con 0x7fcaec06dfb0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcaea59c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcaec06dfb0 0x7fcaec06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcae3fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fcaec06e8d0 0x7fcaec097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:40240/0 (socket says 172.21.15.116:40240) 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcae3fff640 1 -- 172.21.15.116:0/1343381032 learned_addr learned my addr 172.21.15.116:0/1343381032 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcaea59c640 1 -- 172.21.15.116:0/1343381032 >> v1:172.21.15.116:6789/0 conn(0x7fcaec06e8d0 legacy=0x7fcaec097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcaea59c640 1 -- 172.21.15.116:0/1343381032 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec099e20 con 0x7fcaec06dfb0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.835+0000 7fcaea59c640 1 --2- 172.21.15.116:0/1343381032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec06e390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009720 tx=0x7fcadc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936a89eda162c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcae9d9b640 1 -- 172.21.15.116:0/1343381032 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcadc037070 con 0x7fcaec06dfb0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcae9d9b640 1 -- 172.21.15.116:0/1343381032 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc02ae20 con 0x7fcaec06dfb0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcae9d9b640 1 -- 172.21.15.116:0/1343381032 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcadc032590 con 0x7fcaec06dfb0 2024-09-14T10:58:20.835 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1343381032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 msgr2=0x7fcaec06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1343381032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec06e390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009720 tx=0x7fcadc02a1a0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1343381032 shutdown_connections 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1343381032 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec06e390 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1343381032 >> 172.21.15.116:0/1343381032 conn(0x7fcaec09abc0 msgr2=0x7fcaec098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1343381032 shutdown_connections 2024-09-14T10:58:20.836 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.836+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1343381032 wait complete. 2024-09-14T10:58:20.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.837+0000 7fcaf0a47640 1 Processor -- start 2024-09-14T10:58:20.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.837+0000 7fcaf0a47640 1 -- start start 2024-09-14T10:58:20.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaf0a47640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaf0a47640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcaec06ece0 con 0x7fcaec06dfb0 2024-09-14T10:58:20.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaea59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaea59c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:41352/0 (socket says 172.21.15.116:41352) 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaea59c640 1 -- 172.21.15.116:0/1314790819 learned_addr learned my addr 172.21.15.116:0/1314790819 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaea59c640 1 -- 172.21.15.116:0/1314790819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaec074110 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaea59c640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcadc02a1e0 tx=0x7fcadc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcadc042070 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc03e590 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaec070da0 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcadc037040 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.838+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaec0701f0 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.839+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcadc045070 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.839+0000 7fcae2ffd640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 0x7fcacc040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.839+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fcadc073e30 con 0x7fcaec06dfb0 2024-09-14T10:58:20.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.839+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaec06f0c0 con 0x7fcaec06dfb0 2024-09-14T10:58:20.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.840+0000 7fcae3fff640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 0x7fcacc040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:20.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.840+0000 7fcae3fff640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 0x7fcacc040a30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007fd0 tx=0x7fcad4007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:20.842 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:20.844+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fcadc02ae20 con 0x7fcaec06dfb0 2024-09-14T10:58:21.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.014+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcaec071290 con 0x7fcacc03e570 2024-09-14T10:58:21.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.025+0000 7fcae2ffd640 1 -- 172.21.15.116:0/1314790819 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665751 (secure 0 0 0) 0x7fcad40058b0 con 0x7fcacc03e570 2024-09-14T10:58:21.030 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:21.036 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:58:21.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 msgr2=0x7fcacc040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 0x7fcacc040a30 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fcad4007fd0 tx=0x7fcad4007aa0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 msgr2=0x7fcaec1c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcadc02a1e0 tx=0x7fcadc0046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 shutdown_connections 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcacc03e570 0x7fcacc040a30 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 --2- 172.21.15.116:0/1314790819 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcaec06dfb0 0x7fcaec1c4560 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 >> 172.21.15.116:0/1314790819 conn(0x7fcaec09abc0 msgr2=0x7fcaec09c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 shutdown_connections 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.029+0000 7fcaf0a47640 1 -- 172.21.15.116:0/1314790819 wait complete. 2024-09-14T10:58:21.039 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-14T10:58:20.119844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9635600,"num_objects":225,"num_object_clones":0,"num_object_copies":453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":225,"num_whiteouts":0,"num_read":4978,"num_read_kb":4512,"num_write":2066,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4468,"ondisk_log_size":4468,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186364,"kb_used_data":40828,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377300996,"statfs":{"total":386547056640,"available":386356219904,"internally_reserved":0,"allocated":41807872,"data_stored":40542688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9034471,"num_objects":5,"num_object_clones":0,"num_object_copies":13,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":574,"num_read_kb":513,"num_write":402,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004082"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751151+0000","last_change":"2024-09-14T10:55:04.693957+0000","last_active":"2024-09-14T10:55:41.751151+0000","last_peered":"2024-09-14T10:55:41.751151+0000","last_clean":"2024-09-14T10:55:41.751151+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:55:41.751151+0000","last_undegraded":"2024-09-14T10:55:41.751151+0000","last_fullsized":"2024-09-14T10:55:41.751151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.408068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099828+0000","last_change":"2024-09-14T10:55:06.701780+0000","last_active":"2024-09-14T10:57:37.099828+0000","last_peered":"2024-09-14T10:57:37.099828+0000","last_clean":"2024-09-14T10:57:37.099828+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:57:37.099828+0000","last_undegraded":"2024-09-14T10:57:37.099828+0000","last_fullsized":"2024-09-14T10:57:37.099828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:25.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747843+0000","last_change":"2024-09-14T10:55:04.693160+0000","last_active":"2024-09-14T10:55:41.747843+0000","last_peered":"2024-09-14T10:55:41.747843+0000","last_clean":"2024-09-14T10:55:41.747843+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:55:41.747843+0000","last_undegraded":"2024-09-14T10:55:41.747843+0000","last_fullsized":"2024-09-14T10:55:41.747843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:56.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.044322+0000","last_change":"2024-09-14T10:55:41.755184+0000","last_active":"2024-09-14T10:55:47.044322+0000","last_peered":"2024-09-14T10:55:47.044322+0000","last_clean":"2024-09-14T10:55:47.044322+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:55:47.044322+0000","last_undegraded":"2024-09-14T10:55:47.044322+0000","last_fullsized":"2024-09-14T10:55:47.044322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:40.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.486444+0000","last_change":"2024-09-14T10:55:04.710321+0000","last_active":"2024-09-14T10:57:12.486444+0000","last_peered":"2024-09-14T10:57:12.486444+0000","last_clean":"2024-09-14T10:57:12.486444+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:57:12.486444+0000","last_undegraded":"2024-09-14T10:57:12.486444+0000","last_fullsized":"2024-09-14T10:57:12.486444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:23.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.536080+0000","last_change":"2024-09-14T10:55:04.691950+0000","last_active":"2024-09-14T10:57:12.536080+0000","last_peered":"2024-09-14T10:57:12.536080+0000","last_clean":"2024-09-14T10:57:12.536080+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:57:12.536080+0000","last_undegraded":"2024-09-14T10:57:12.536080+0000","last_fullsized":"2024-09-14T10:57:12.536080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065448+0000","last_change":"2024-09-14T10:55:41.752605+0000","last_active":"2024-09-14T10:58:13.065448+0000","last_peered":"2024-09-14T10:58:13.065448+0000","last_clean":"2024-09-14T10:58:13.065448+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:13.065448+0000","last_undegraded":"2024-09-14T10:58:13.065448+0000","last_fullsized":"2024-09-14T10:58:13.065448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.626179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.952023+0000","last_change":"2024-09-14T10:55:04.693896+0000","last_active":"2024-09-14T10:58:12.952023+0000","last_peered":"2024-09-14T10:58:12.952023+0000","last_clean":"2024-09-14T10:58:12.952023+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:12.952023+0000","last_undegraded":"2024-09-14T10:58:12.952023+0000","last_fullsized":"2024-09-14T10:58:12.952023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:25.363300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282107+0000","last_change":"2024-09-14T10:55:06.694032+0000","last_active":"2024-09-14T10:58:13.282107+0000","last_peered":"2024-09-14T10:58:13.282107+0000","last_clean":"2024-09-14T10:58:13.282107+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:13.282107+0000","last_undegraded":"2024-09-14T10:58:13.282107+0000","last_fullsized":"2024-09-14T10:58:13.282107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:52.564428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747657+0000","last_change":"2024-09-14T10:55:04.691521+0000","last_active":"2024-09-14T10:55:41.747657+0000","last_peered":"2024-09-14T10:55:41.747657+0000","last_clean":"2024-09-14T10:55:41.747657+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:55:41.747657+0000","last_undegraded":"2024-09-14T10:55:41.747657+0000","last_fullsized":"2024-09-14T10:55:41.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:36.146379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194738+0000","last_change":"2024-09-14T10:55:04.699709+0000","last_active":"2024-09-14T10:58:13.194738+0000","last_peered":"2024-09-14T10:58:13.194738+0000","last_clean":"2024-09-14T10:58:13.194738+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:13.194738+0000","last_undegraded":"2024-09-14T10:58:13.194738+0000","last_fullsized":"2024-09-14T10:58:13.194738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:53.785449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751899+0000","last_change":"2024-09-14T10:55:06.698420+0000","last_active":"2024-09-14T10:55:41.751899+0000","last_peered":"2024-09-14T10:55:41.751899+0000","last_clean":"2024-09-14T10:55:41.751899+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:55:41.751899+0000","last_undegraded":"2024-09-14T10:55:41.751899+0000","last_fullsized":"2024-09-14T10:55:41.751899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:37.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745255+0000","last_change":"2024-09-14T10:55:04.692677+0000","last_active":"2024-09-14T10:55:41.745255+0000","last_peered":"2024-09-14T10:55:41.745255+0000","last_clean":"2024-09-14T10:55:41.745255+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:55:41.745255+0000","last_undegraded":"2024-09-14T10:55:41.745255+0000","last_fullsized":"2024-09-14T10:55:41.745255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:19.955381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071556+0000","last_change":"2024-09-14T10:55:06.695226+0000","last_active":"2024-09-14T10:56:29.071556+0000","last_peered":"2024-09-14T10:56:29.071556+0000","last_clean":"2024-09-14T10:56:29.071556+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:56:29.071556+0000","last_undegraded":"2024-09-14T10:56:29.071556+0000","last_fullsized":"2024-09-14T10:56:29.071556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:25.288530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'7","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.190959+0000","last_change":"2024-09-14T10:55:04.710323+0000","last_active":"2024-09-14T10:58:13.190959+0000","last_peered":"2024-09-14T10:58:13.190959+0000","last_clean":"2024-09-14T10:58:13.190959+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:13.190959+0000","last_undegraded":"2024-09-14T10:58:13.190959+0000","last_fullsized":"2024-09-14T10:58:13.190959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:30.799795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":7,"num_write":23,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.281969+0000","last_change":"2024-09-14T10:55:06.699438+0000","last_active":"2024-09-14T10:58:13.281969+0000","last_peered":"2024-09-14T10:58:13.281969+0000","last_clean":"2024-09-14T10:58:13.281969+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:13.281969+0000","last_undegraded":"2024-09-14T10:58:13.281969+0000","last_fullsized":"2024-09-14T10:58:13.281969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.481249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751744+0000","last_change":"2024-09-14T10:55:04.699550+0000","last_active":"2024-09-14T10:55:41.751744+0000","last_peered":"2024-09-14T10:55:41.751744+0000","last_clean":"2024-09-14T10:55:41.751744+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:55:41.751744+0000","last_undegraded":"2024-09-14T10:55:41.751744+0000","last_fullsized":"2024-09-14T10:55:41.751744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:02.897364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584049+0000","last_change":"2024-09-14T10:55:06.699540+0000","last_active":"2024-09-14T10:57:12.584049+0000","last_peered":"2024-09-14T10:57:12.584049+0000","last_clean":"2024-09-14T10:57:12.584049+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:57:12.584049+0000","last_undegraded":"2024-09-14T10:57:12.584049+0000","last_fullsized":"2024-09-14T10:57:12.584049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:32.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.410027+0000","last_change":"2024-09-14T10:55:04.710493+0000","last_active":"2024-09-14T10:55:45.410027+0000","last_peered":"2024-09-14T10:55:45.410027+0000","last_clean":"2024-09-14T10:55:45.410027+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:55:45.410027+0000","last_undegraded":"2024-09-14T10:55:45.410027+0000","last_fullsized":"2024-09-14T10:55:45.410027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:11.097667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254829+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:58:13.254829+0000","last_peered":"2024-09-14T10:58:13.254829+0000","last_clean":"2024-09-14T10:58:13.254829+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:13.254829+0000","last_undegraded":"2024-09-14T10:58:13.254829+0000","last_fullsized":"2024-09-14T10:58:13.254829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745936+0000","last_change":"2024-09-14T10:55:04.697066+0000","last_active":"2024-09-14T10:55:41.745936+0000","last_peered":"2024-09-14T10:55:41.745936+0000","last_clean":"2024-09-14T10:55:41.745936+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:55:41.745936+0000","last_undegraded":"2024-09-14T10:55:41.745936+0000","last_fullsized":"2024-09-14T10:55:41.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:54.003676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747047+0000","last_change":"2024-09-14T10:55:06.695487+0000","last_active":"2024-09-14T10:55:41.747047+0000","last_peered":"2024-09-14T10:55:41.747047+0000","last_clean":"2024-09-14T10:55:41.747047+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:55:41.747047+0000","last_undegraded":"2024-09-14T10:55:41.747047+0000","last_fullsized":"2024-09-14T10:55:41.747047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:37.971520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746476+0000","last_change":"2024-09-14T10:55:04.708722+0000","last_active":"2024-09-14T10:55:41.746476+0000","last_peered":"2024-09-14T10:55:41.746476+0000","last_clean":"2024-09-14T10:55:41.746476+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:55:41.746476+0000","last_undegraded":"2024-09-14T10:55:41.746476+0000","last_fullsized":"2024-09-14T10:55:41.746476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:12.437345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071829+0000","last_change":"2024-09-14T10:55:06.697009+0000","last_active":"2024-09-14T10:56:29.071829+0000","last_peered":"2024-09-14T10:56:29.071829+0000","last_clean":"2024-09-14T10:56:29.071829+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:56:29.071829+0000","last_undegraded":"2024-09-14T10:56:29.071829+0000","last_fullsized":"2024-09-14T10:56:29.071829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.649839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.200303+0000","last_change":"2024-09-14T10:55:04.701290+0000","last_active":"2024-09-14T10:58:13.200303+0000","last_peered":"2024-09-14T10:58:13.200303+0000","last_clean":"2024-09-14T10:58:13.200303+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:13.200303+0000","last_undegraded":"2024-09-14T10:58:13.200303+0000","last_fullsized":"2024-09-14T10:58:13.200303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.929907+0000","last_change":"2024-09-14T10:55:06.689207+0000","last_active":"2024-09-14T10:55:45.929907+0000","last_peered":"2024-09-14T10:55:45.929907+0000","last_clean":"2024-09-14T10:55:45.929907+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:55:45.929907+0000","last_undegraded":"2024-09-14T10:55:45.929907+0000","last_fullsized":"2024-09-14T10:55:45.929907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:51.007328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742523+0000","last_change":"2024-09-14T10:55:04.707857+0000","last_active":"2024-09-14T10:55:41.742523+0000","last_peered":"2024-09-14T10:55:41.742523+0000","last_clean":"2024-09-14T10:55:41.742523+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:55:41.742523+0000","last_undegraded":"2024-09-14T10:55:41.742523+0000","last_fullsized":"2024-09-14T10:55:41.742523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.756536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.160376+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:57:11.160376+0000","last_peered":"2024-09-14T10:57:11.160376+0000","last_clean":"2024-09-14T10:57:11.160376+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:57:11.160376+0000","last_undegraded":"2024-09-14T10:57:11.160376+0000","last_fullsized":"2024-09-14T10:57:11.160376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'17","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.982652+0000","last_change":"2024-09-14T10:55:06.692424+0000","last_active":"2024-09-14T10:58:12.982652+0000","last_peered":"2024-09-14T10:58:12.982652+0000","last_clean":"2024-09-14T10:58:12.982652+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:58:12.982652+0000","last_undegraded":"2024-09-14T10:58:12.982652+0000","last_fullsized":"2024-09-14T10:58:12.982652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:34.169033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745404+0000","last_change":"2024-09-14T10:55:04.702312+0000","last_active":"2024-09-14T10:55:41.745404+0000","last_peered":"2024-09-14T10:55:41.745404+0000","last_clean":"2024-09-14T10:55:41.745404+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:55:41.745404+0000","last_undegraded":"2024-09-14T10:55:41.745404+0000","last_fullsized":"2024-09-14T10:55:41.745404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:33.119288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746096+0000","last_change":"2024-09-14T10:55:08.697901+0000","last_active":"2024-09-14T10:55:41.746096+0000","last_peered":"2024-09-14T10:55:41.746096+0000","last_clean":"2024-09-14T10:55:41.746096+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:55:41.746096+0000","last_undegraded":"2024-09-14T10:55:41.746096+0000","last_fullsized":"2024-09-14T10:55:41.746096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:51.107343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.521522+0000","last_change":"2024-09-14T10:55:04.705534+0000","last_active":"2024-09-14T10:55:46.521522+0000","last_peered":"2024-09-14T10:55:46.521522+0000","last_clean":"2024-09-14T10:55:46.521522+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:55:46.521522+0000","last_undegraded":"2024-09-14T10:55:46.521522+0000","last_fullsized":"2024-09-14T10:55:46.521522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:26.471935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747967+0000","last_change":"2024-09-14T10:55:08.703383+0000","last_active":"2024-09-14T10:55:41.747967+0000","last_peered":"2024-09-14T10:55:41.747967+0000","last_clean":"2024-09-14T10:55:41.747967+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:55:41.747967+0000","last_undegraded":"2024-09-14T10:55:41.747967+0000","last_fullsized":"2024-09-14T10:55:41.747967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:03.440350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787559+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:08.787559+0000","last_peered":"2024-09-14T10:58:08.787559+0000","last_clean":"2024-09-14T10:58:08.787559+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:08.787559+0000","last_undegraded":"2024-09-14T10:58:08.787559+0000","last_fullsized":"2024-09-14T10:58:08.787559+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270140+0000","last_change":"2024-09-14T10:55:06.697810+0000","last_active":"2024-09-14T10:55:46.270140+0000","last_peered":"2024-09-14T10:55:46.270140+0000","last_clean":"2024-09-14T10:55:46.270140+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:55:46.270140+0000","last_undegraded":"2024-09-14T10:55:46.270140+0000","last_fullsized":"2024-09-14T10:55:46.270140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:09.071738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.562476+0000","last_change":"2024-09-14T10:55:04.697949+0000","last_active":"2024-09-14T10:57:12.562476+0000","last_peered":"2024-09-14T10:57:12.562476+0000","last_clean":"2024-09-14T10:57:12.562476+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:57:12.562476+0000","last_undegraded":"2024-09-14T10:57:12.562476+0000","last_fullsized":"2024-09-14T10:57:12.562476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:06.191131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099957+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:57:37.099957+0000","last_peered":"2024-09-14T10:57:37.099957+0000","last_clean":"2024-09-14T10:57:37.099957+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:57:37.099957+0000","last_undegraded":"2024-09-14T10:57:37.099957+0000","last_fullsized":"2024-09-14T10:57:37.099957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071993+0000","last_change":"2024-09-14T10:55:06.700108+0000","last_active":"2024-09-14T10:58:13.071993+0000","last_peered":"2024-09-14T10:58:13.071993+0000","last_clean":"2024-09-14T10:58:13.071993+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:13.071993+0000","last_undegraded":"2024-09-14T10:58:13.071993+0000","last_fullsized":"2024-09-14T10:58:13.071993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:18.353830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751377+0000","last_change":"2024-09-14T10:55:04.703179+0000","last_active":"2024-09-14T10:55:41.751377+0000","last_peered":"2024-09-14T10:55:41.751377+0000","last_clean":"2024-09-14T10:55:41.751377+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:55:41.751377+0000","last_undegraded":"2024-09-14T10:55:41.751377+0000","last_fullsized":"2024-09-14T10:55:41.751377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.756195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743711+0000","last_change":"2024-09-14T10:55:08.703801+0000","last_active":"2024-09-14T10:55:41.743711+0000","last_peered":"2024-09-14T10:55:41.743711+0000","last_clean":"2024-09-14T10:55:41.743711+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:55:41.743711+0000","last_undegraded":"2024-09-14T10:55:41.743711+0000","last_fullsized":"2024-09-14T10:55:41.743711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:30.805117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.164937+0000","last_change":"2024-09-14T10:55:10.711150+0000","last_active":"2024-09-14T10:57:11.164937+0000","last_peered":"2024-09-14T10:57:11.164937+0000","last_clean":"2024-09-14T10:57:11.164937+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:57:11.164937+0000","last_undegraded":"2024-09-14T10:57:11.164937+0000","last_fullsized":"2024-09-14T10:57:11.164937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.611145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071856+0000","last_change":"2024-09-14T10:55:06.693096+0000","last_active":"2024-09-14T10:56:29.071856+0000","last_peered":"2024-09-14T10:56:29.071856+0000","last_clean":"2024-09-14T10:56:29.071856+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:56:29.071856+0000","last_undegraded":"2024-09-14T10:56:29.071856+0000","last_fullsized":"2024-09-14T10:56:29.071856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:46.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750779+0000","last_change":"2024-09-14T10:55:04.703485+0000","last_active":"2024-09-14T10:55:41.750779+0000","last_peered":"2024-09-14T10:55:41.750779+0000","last_clean":"2024-09-14T10:55:41.750779+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:55:41.750779+0000","last_undegraded":"2024-09-14T10:55:41.750779+0000","last_fullsized":"2024-09-14T10:55:41.750779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:22.991367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745415+0000","last_change":"2024-09-14T10:55:08.703463+0000","last_active":"2024-09-14T10:55:41.745415+0000","last_peered":"2024-09-14T10:55:41.745415+0000","last_clean":"2024-09-14T10:55:41.745415+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:55:41.745415+0000","last_undegraded":"2024-09-14T10:55:41.745415+0000","last_fullsized":"2024-09-14T10:55:41.745415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.948464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.144736+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:57:11.144736+0000","last_peered":"2024-09-14T10:57:11.144736+0000","last_clean":"2024-09-14T10:57:11.144736+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:57:11.144736+0000","last_undegraded":"2024-09-14T10:57:11.144736+0000","last_fullsized":"2024-09-14T10:57:11.144736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254953+0000","last_change":"2024-09-14T10:55:06.695110+0000","last_active":"2024-09-14T10:58:13.254953+0000","last_peered":"2024-09-14T10:58:13.254953+0000","last_clean":"2024-09-14T10:58:13.254953+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:13.254953+0000","last_undegraded":"2024-09-14T10:58:13.254953+0000","last_fullsized":"2024-09-14T10:58:13.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:34.398479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744632+0000","last_change":"2024-09-14T10:55:04.702159+0000","last_active":"2024-09-14T10:55:41.744632+0000","last_peered":"2024-09-14T10:55:41.744632+0000","last_clean":"2024-09-14T10:55:41.744632+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:55:41.744632+0000","last_undegraded":"2024-09-14T10:55:41.744632+0000","last_fullsized":"2024-09-14T10:55:41.744632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:32.478928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747579+0000","last_change":"2024-09-14T10:55:08.700971+0000","last_active":"2024-09-14T10:55:41.747579+0000","last_peered":"2024-09-14T10:55:41.747579+0000","last_clean":"2024-09-14T10:55:41.747579+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:55:41.747579+0000","last_undegraded":"2024-09-14T10:55:41.747579+0000","last_fullsized":"2024-09-14T10:55:41.747579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:53.973360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.166761+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:57:11.166761+0000","last_peered":"2024-09-14T10:57:11.166761+0000","last_clean":"2024-09-14T10:57:11.166761+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:57:11.166761+0000","last_undegraded":"2024-09-14T10:57:11.166761+0000","last_fullsized":"2024-09-14T10:57:11.166761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.883679+0000","last_change":"2024-09-14T10:55:06.687352+0000","last_active":"2024-09-14T10:56:28.883679+0000","last_peered":"2024-09-14T10:56:28.883679+0000","last_clean":"2024-09-14T10:56:28.883679+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:56:28.883679+0000","last_undegraded":"2024-09-14T10:56:28.883679+0000","last_fullsized":"2024-09-14T10:56:28.883679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.409908+0000","last_change":"2024-09-14T10:55:04.711138+0000","last_active":"2024-09-14T10:55:45.409908+0000","last_peered":"2024-09-14T10:55:45.409908+0000","last_clean":"2024-09-14T10:55:45.409908+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:55:45.409908+0000","last_undegraded":"2024-09-14T10:55:45.409908+0000","last_fullsized":"2024-09-14T10:55:45.409908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:30.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:42.082259+0000","last_change":"2024-09-14T10:55:41.752599+0000","last_active":"2024-09-14T10:55:42.082259+0000","last_peered":"2024-09-14T10:55:42.082259+0000","last_clean":"2024-09-14T10:55:42.082259+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:55:42.082259+0000","last_undegraded":"2024-09-14T10:55:42.082259+0000","last_fullsized":"2024-09-14T10:55:42.082259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'54","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.168560+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:57:11.168560+0000","last_peered":"2024-09-14T10:57:11.168560+0000","last_clean":"2024-09-14T10:57:11.168560+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:57:11.168560+0000","last_undegraded":"2024-09-14T10:57:11.168560+0000","last_fullsized":"2024-09-14T10:57:11.168560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744942+0000","last_change":"2024-09-14T10:55:06.703711+0000","last_active":"2024-09-14T10:55:41.744942+0000","last_peered":"2024-09-14T10:55:41.744942+0000","last_clean":"2024-09-14T10:55:41.744942+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:55:41.744942+0000","last_undegraded":"2024-09-14T10:55:41.744942+0000","last_fullsized":"2024-09-14T10:55:41.744942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:13.371367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746090+0000","last_change":"2024-09-14T10:55:04.691040+0000","last_active":"2024-09-14T10:55:41.746090+0000","last_peered":"2024-09-14T10:55:41.746090+0000","last_clean":"2024-09-14T10:55:41.746090+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:55:41.746090+0000","last_undegraded":"2024-09-14T10:55:41.746090+0000","last_fullsized":"2024-09-14T10:55:41.746090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:07.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747621+0000","last_change":"2024-09-14T10:55:08.699358+0000","last_active":"2024-09-14T10:55:41.747621+0000","last_peered":"2024-09-14T10:55:41.747621+0000","last_clean":"2024-09-14T10:55:41.747621+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:55:41.747621+0000","last_undegraded":"2024-09-14T10:55:41.747621+0000","last_fullsized":"2024-09-14T10:55:41.747621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'34","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.937869+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:12.937869+0000","last_peered":"2024-09-14T10:58:12.937869+0000","last_clean":"2024-09-14T10:58:12.937869+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:12.937869+0000","last_undegraded":"2024-09-14T10:58:12.937869+0000","last_fullsized":"2024-09-14T10:58:12.937869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270233+0000","last_change":"2024-09-14T10:55:06.701991+0000","last_active":"2024-09-14T10:55:46.270233+0000","last_peered":"2024-09-14T10:55:46.270233+0000","last_clean":"2024-09-14T10:55:46.270233+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:55:46.270233+0000","last_undegraded":"2024-09-14T10:55:46.270233+0000","last_fullsized":"2024-09-14T10:55:46.270233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:45.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743476+0000","last_change":"2024-09-14T10:55:04.700925+0000","last_active":"2024-09-14T10:55:41.743476+0000","last_peered":"2024-09-14T10:55:41.743476+0000","last_clean":"2024-09-14T10:55:41.743476+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:55:41.743476+0000","last_undegraded":"2024-09-14T10:55:41.743476+0000","last_fullsized":"2024-09-14T10:55:41.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:49.933927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746151+0000","last_change":"2024-09-14T10:55:08.703241+0000","last_active":"2024-09-14T10:55:41.746151+0000","last_peered":"2024-09-14T10:55:41.746151+0000","last_clean":"2024-09-14T10:55:41.746151+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:55:41.746151+0000","last_undegraded":"2024-09-14T10:55:41.746151+0000","last_fullsized":"2024-09-14T10:55:41.746151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.686570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'39","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.174674+0000","last_change":"2024-09-14T10:55:10.703424+0000","last_active":"2024-09-14T10:57:11.174674+0000","last_peered":"2024-09-14T10:57:11.174674+0000","last_clean":"2024-09-14T10:57:11.174674+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:57:11.174674+0000","last_undegraded":"2024-09-14T10:57:11.174674+0000","last_fullsized":"2024-09-14T10:57:11.174674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:42.700099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.381724+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:13.381724+0000","last_peered":"2024-09-14T10:58:13.381724+0000","last_clean":"2024-09-14T10:58:13.381724+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:13.381724+0000","last_undegraded":"2024-09-14T10:58:13.381724+0000","last_fullsized":"2024-09-14T10:58:13.381724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065459+0000","last_change":"2024-09-14T10:55:06.695542+0000","last_active":"2024-09-14T10:58:13.065459+0000","last_peered":"2024-09-14T10:58:13.065459+0000","last_clean":"2024-09-14T10:58:13.065459+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:13.065459+0000","last_undegraded":"2024-09-14T10:58:13.065459+0000","last_fullsized":"2024-09-14T10:58:13.065459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.739856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742547+0000","last_change":"2024-09-14T10:55:04.707433+0000","last_active":"2024-09-14T10:55:41.742547+0000","last_peered":"2024-09-14T10:55:41.742547+0000","last_clean":"2024-09-14T10:55:41.742547+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:55:41.742547+0000","last_undegraded":"2024-09-14T10:55:41.742547+0000","last_fullsized":"2024-09-14T10:55:41.742547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.332597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224554+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:57:12.224554+0000","last_peered":"2024-09-14T10:57:12.224554+0000","last_clean":"2024-09-14T10:57:12.224554+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:57:12.224554+0000","last_undegraded":"2024-09-14T10:57:12.224554+0000","last_fullsized":"2024-09-14T10:57:12.224554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":459,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.337503+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:13.337503+0000","last_peered":"2024-09-14T10:58:13.337503+0000","last_clean":"2024-09-14T10:58:13.337503+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:13.337503+0000","last_undegraded":"2024-09-14T10:58:13.337503+0000","last_fullsized":"2024-09-14T10:58:13.337503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:22.097476+0000","last_change":"2024-09-14T10:55:06.706335+0000","last_active":"2024-09-14T10:57:22.097476+0000","last_peered":"2024-09-14T10:57:22.097476+0000","last_clean":"2024-09-14T10:57:22.097476+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:57:22.097476+0000","last_undegraded":"2024-09-14T10:57:22.097476+0000","last_fullsized":"2024-09-14T10:57:22.097476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.143962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.411031+0000","last_change":"2024-09-14T10:55:04.710463+0000","last_active":"2024-09-14T10:55:45.411031+0000","last_peered":"2024-09-14T10:55:45.411031+0000","last_clean":"2024-09-14T10:55:45.411031+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:55:45.411031+0000","last_undegraded":"2024-09-14T10:55:45.411031+0000","last_fullsized":"2024-09-14T10:55:45.411031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:37.366298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'39","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.161657+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:57:11.161657+0000","last_peered":"2024-09-14T10:57:11.161657+0000","last_clean":"2024-09-14T10:57:11.161657+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:57:11.161657+0000","last_undegraded":"2024-09-14T10:57:11.161657+0000","last_fullsized":"2024-09-14T10:57:11.161657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072341+0000","last_change":"2024-09-14T10:55:06.700492+0000","last_active":"2024-09-14T10:56:29.072341+0000","last_peered":"2024-09-14T10:56:29.072341+0000","last_clean":"2024-09-14T10:56:29.072341+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:56:29.072341+0000","last_undegraded":"2024-09-14T10:56:29.072341+0000","last_fullsized":"2024-09-14T10:56:29.072341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:08.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743002+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:55:41.743002+0000","last_peered":"2024-09-14T10:55:41.743002+0000","last_clean":"2024-09-14T10:55:41.743002+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:55:41.743002+0000","last_undegraded":"2024-09-14T10:55:41.743002+0000","last_fullsized":"2024-09-14T10:55:41.743002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742229+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:55:41.742229+0000","last_peered":"2024-09-14T10:55:41.742229+0000","last_clean":"2024-09-14T10:55:41.742229+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:55:41.742229+0000","last_undegraded":"2024-09-14T10:55:41.742229+0000","last_fullsized":"2024-09-14T10:55:41.742229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.277466+0000","last_change":"2024-09-14T10:55:04.711278+0000","last_active":"2024-09-14T10:58:13.277466+0000","last_peered":"2024-09-14T10:58:13.277466+0000","last_clean":"2024-09-14T10:58:13.277466+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:13.277466+0000","last_undegraded":"2024-09-14T10:58:13.277466+0000","last_fullsized":"2024-09-14T10:58:13.277466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:22.252465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746166+0000","last_change":"2024-09-14T10:55:08.700288+0000","last_active":"2024-09-14T10:55:41.746166+0000","last_peered":"2024-09-14T10:55:41.746166+0000","last_clean":"2024-09-14T10:55:41.746166+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:55:41.746166+0000","last_undegraded":"2024-09-14T10:55:41.746166+0000","last_fullsized":"2024-09-14T10:55:41.746166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:02.043861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.172718+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:57:11.172718+0000","last_peered":"2024-09-14T10:57:11.172718+0000","last_clean":"2024-09-14T10:57:11.172718+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:57:11.172718+0000","last_undegraded":"2024-09-14T10:57:11.172718+0000","last_fullsized":"2024-09-14T10:57:11.172718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971149+0000","last_change":"2024-09-14T10:55:06.692907+0000","last_active":"2024-09-14T10:58:12.971149+0000","last_peered":"2024-09-14T10:58:12.971149+0000","last_clean":"2024-09-14T10:58:12.971149+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:12.971149+0000","last_undegraded":"2024-09-14T10:58:12.971149+0000","last_fullsized":"2024-09-14T10:58:12.971149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:04.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741463+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:55:41.741463+0000","last_peered":"2024-09-14T10:55:41.741463+0000","last_clean":"2024-09-14T10:55:41.741463+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:55:41.741463+0000","last_undegraded":"2024-09-14T10:55:41.741463+0000","last_fullsized":"2024-09-14T10:55:41.741463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745280+0000","last_change":"2024-09-14T10:55:04.692738+0000","last_active":"2024-09-14T10:55:41.745280+0000","last_peered":"2024-09-14T10:55:41.745280+0000","last_clean":"2024-09-14T10:55:41.745280+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:55:41.745280+0000","last_undegraded":"2024-09-14T10:55:41.745280+0000","last_fullsized":"2024-09-14T10:55:41.745280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.808200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787545+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:08.787545+0000","last_peered":"2024-09-14T10:58:08.787545+0000","last_clean":"2024-09-14T10:58:08.787545+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:08.787545+0000","last_undegraded":"2024-09-14T10:58:08.787545+0000","last_fullsized":"2024-09-14T10:58:08.787545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971995+0000","last_change":"2024-09-14T10:55:06.697381+0000","last_active":"2024-09-14T10:58:12.971995+0000","last_peered":"2024-09-14T10:58:12.971995+0000","last_clean":"2024-09-14T10:58:12.971995+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:12.971995+0000","last_undegraded":"2024-09-14T10:58:12.971995+0000","last_fullsized":"2024-09-14T10:58:12.971995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:17.404755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746730+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:55:41.746730+0000","last_peered":"2024-09-14T10:55:41.746730+0000","last_clean":"2024-09-14T10:55:41.746730+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:55:41.746730+0000","last_undegraded":"2024-09-14T10:55:41.746730+0000","last_fullsized":"2024-09-14T10:55:41.746730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.883807+0000","last_change":"2024-09-14T10:55:04.703428+0000","last_active":"2024-09-14T10:58:12.883807+0000","last_peered":"2024-09-14T10:58:12.883807+0000","last_clean":"2024-09-14T10:58:12.883807+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:12.883807+0000","last_undegraded":"2024-09-14T10:58:12.883807+0000","last_fullsized":"2024-09-14T10:58:12.883807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:53.536029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750615+0000","last_change":"2024-09-14T10:55:08.699744+0000","last_active":"2024-09-14T10:55:41.750615+0000","last_peered":"2024-09-14T10:55:41.750615+0000","last_clean":"2024-09-14T10:55:41.750615+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:55:41.750615+0000","last_undegraded":"2024-09-14T10:55:41.750615+0000","last_fullsized":"2024-09-14T10:55:41.750615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:26.469946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787613+0000","last_change":"2024-09-14T10:55:10.711152+0000","last_active":"2024-09-14T10:58:08.787613+0000","last_peered":"2024-09-14T10:58:08.787613+0000","last_clean":"2024-09-14T10:58:08.787613+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:08.787613+0000","last_undegraded":"2024-09-14T10:58:08.787613+0000","last_fullsized":"2024-09-14T10:58:08.787613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:00.848960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254782+0000","last_change":"2024-09-14T10:55:06.696400+0000","last_active":"2024-09-14T10:58:13.254782+0000","last_peered":"2024-09-14T10:58:13.254782+0000","last_clean":"2024-09-14T10:58:13.254782+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:13.254782+0000","last_undegraded":"2024-09-14T10:58:13.254782+0000","last_fullsized":"2024-09-14T10:58:13.254782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:27.637523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742327+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:55:41.742327+0000","last_peered":"2024-09-14T10:55:41.742327+0000","last_clean":"2024-09-14T10:55:41.742327+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:55:41.742327+0000","last_undegraded":"2024-09-14T10:55:41.742327+0000","last_fullsized":"2024-09-14T10:55:41.742327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746853+0000","last_change":"2024-09-14T10:55:04.701485+0000","last_active":"2024-09-14T10:55:41.746853+0000","last_peered":"2024-09-14T10:55:41.746853+0000","last_clean":"2024-09-14T10:55:41.746853+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:55:41.746853+0000","last_undegraded":"2024-09-14T10:55:41.746853+0000","last_fullsized":"2024-09-14T10:55:41.746853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:55.465771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747177+0000","last_change":"2024-09-14T10:55:08.697214+0000","last_active":"2024-09-14T10:55:41.747177+0000","last_peered":"2024-09-14T10:55:41.747177+0000","last_clean":"2024-09-14T10:55:41.747177+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:55:41.747177+0000","last_undegraded":"2024-09-14T10:55:41.747177+0000","last_fullsized":"2024-09-14T10:55:41.747177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:19.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.216318+0000","last_change":"2024-09-14T10:55:06.706535+0000","last_active":"2024-09-14T10:58:13.216318+0000","last_peered":"2024-09-14T10:58:13.216318+0000","last_clean":"2024-09-14T10:58:13.216318+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:13.216318+0000","last_undegraded":"2024-09-14T10:58:13.216318+0000","last_fullsized":"2024-09-14T10:58:13.216318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:55.794763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745720+0000","last_change":"2024-09-14T10:55:04.700577+0000","last_active":"2024-09-14T10:55:41.745720+0000","last_peered":"2024-09-14T10:55:41.745720+0000","last_clean":"2024-09-14T10:55:41.745720+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:55:41.745720+0000","last_undegraded":"2024-09-14T10:55:41.745720+0000","last_fullsized":"2024-09-14T10:55:41.745720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:41.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746368+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:55:41.746368+0000","last_peered":"2024-09-14T10:55:41.746368+0000","last_clean":"2024-09-14T10:55:41.746368+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:55:41.746368+0000","last_undegraded":"2024-09-14T10:55:41.746368+0000","last_fullsized":"2024-09-14T10:55:41.746368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.400872+0000","last_change":"2024-09-14T10:55:08.697596+0000","last_active":"2024-09-14T10:58:13.400872+0000","last_peered":"2024-09-14T10:58:13.400872+0000","last_clean":"2024-09-14T10:58:13.400872+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:13.400872+0000","last_undegraded":"2024-09-14T10:58:13.400872+0000","last_fullsized":"2024-09-14T10:58:13.400872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:19.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288374+0000","last_change":"2024-09-14T10:55:06.706584+0000","last_active":"2024-09-14T10:58:13.288374+0000","last_peered":"2024-09-14T10:58:13.288374+0000","last_clean":"2024-09-14T10:58:13.288374+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:13.288374+0000","last_undegraded":"2024-09-14T10:58:13.288374+0000","last_fullsized":"2024-09-14T10:58:13.288374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.341911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.872057+0000","last_change":"2024-09-14T10:55:04.693803+0000","last_active":"2024-09-14T10:58:12.872057+0000","last_peered":"2024-09-14T10:58:12.872057+0000","last_clean":"2024-09-14T10:58:12.872057+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:12.872057+0000","last_undegraded":"2024-09-14T10:58:12.872057+0000","last_fullsized":"2024-09-14T10:58:12.872057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:11.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744220+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:55:41.744220+0000","last_peered":"2024-09-14T10:55:41.744220+0000","last_clean":"2024-09-14T10:55:41.744220+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:55:41.744220+0000","last_undegraded":"2024-09-14T10:55:41.744220+0000","last_fullsized":"2024-09-14T10:55:41.744220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":346,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787486+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:08.787486+0000","last_peered":"2024-09-14T10:58:08.787486+0000","last_clean":"2024-09-14T10:58:08.787486+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:08.787486+0000","last_undegraded":"2024-09-14T10:58:08.787486+0000","last_fullsized":"2024-09-14T10:58:08.787486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.576048+0000","last_change":"2024-09-14T10:55:06.700418+0000","last_active":"2024-09-14T10:57:12.576048+0000","last_peered":"2024-09-14T10:57:12.576048+0000","last_clean":"2024-09-14T10:57:12.576048+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:57:12.576048+0000","last_undegraded":"2024-09-14T10:57:12.576048+0000","last_fullsized":"2024-09-14T10:57:12.576048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.529891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747368+0000","last_change":"2024-09-14T10:55:04.701334+0000","last_active":"2024-09-14T10:55:41.747368+0000","last_peered":"2024-09-14T10:55:41.747368+0000","last_clean":"2024-09-14T10:55:41.747368+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:55:41.747368+0000","last_undegraded":"2024-09-14T10:55:41.747368+0000","last_fullsized":"2024-09-14T10:55:41.747368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:44.481979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747311+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:55:41.747311+0000","last_peered":"2024-09-14T10:55:41.747311+0000","last_clean":"2024-09-14T10:55:41.747311+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:55:41.747311+0000","last_undegraded":"2024-09-14T10:55:41.747311+0000","last_fullsized":"2024-09-14T10:55:41.747311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206572+0000","last_change":"2024-09-14T10:55:06.696240+0000","last_active":"2024-09-14T10:58:13.206572+0000","last_peered":"2024-09-14T10:58:13.206572+0000","last_clean":"2024-09-14T10:58:13.206572+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:13.206572+0000","last_undegraded":"2024-09-14T10:58:13.206572+0000","last_fullsized":"2024-09-14T10:58:13.206572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:55.340683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747296+0000","last_change":"2024-09-14T10:55:04.711259+0000","last_active":"2024-09-14T10:55:41.747296+0000","last_peered":"2024-09-14T10:55:41.747296+0000","last_clean":"2024-09-14T10:55:41.747296+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:55:41.747296+0000","last_undegraded":"2024-09-14T10:55:41.747296+0000","last_fullsized":"2024-09-14T10:55:41.747296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:39.310566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746456+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:55:41.746456+0000","last_peered":"2024-09-14T10:55:41.746456+0000","last_clean":"2024-09-14T10:55:41.746456+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:55:41.746456+0000","last_undegraded":"2024-09-14T10:55:41.746456+0000","last_fullsized":"2024-09-14T10:55:41.746456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.205970+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:57:12.205970+0000","last_peered":"2024-09-14T10:57:12.205970+0000","last_clean":"2024-09-14T10:57:12.205970+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:57:12.205970+0000","last_undegraded":"2024-09-14T10:57:12.205970+0000","last_fullsized":"2024-09-14T10:57:12.205970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'84","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096443+0000","last_change":"2024-09-14T10:55:10.706862+0000","last_active":"2024-09-14T10:57:17.096443+0000","last_peered":"2024-09-14T10:57:17.096443+0000","last_clean":"2024-09-14T10:57:17.096443+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:57:17.096443+0000","last_undegraded":"2024-09-14T10:57:17.096443+0000","last_fullsized":"2024-09-14T10:57:17.096443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:12.621258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584503+0000","last_change":"2024-09-14T10:55:06.704098+0000","last_active":"2024-09-14T10:57:12.584503+0000","last_peered":"2024-09-14T10:57:12.584503+0000","last_clean":"2024-09-14T10:57:12.584503+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:57:12.584503+0000","last_undegraded":"2024-09-14T10:57:12.584503+0000","last_fullsized":"2024-09-14T10:57:12.584503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:55.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743912+0000","last_change":"2024-09-14T10:55:04.711613+0000","last_active":"2024-09-14T10:55:41.743912+0000","last_peered":"2024-09-14T10:55:41.743912+0000","last_clean":"2024-09-14T10:55:41.743912+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:55:41.743912+0000","last_undegraded":"2024-09-14T10:55:41.743912+0000","last_fullsized":"2024-09-14T10:55:41.743912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:11.362054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.755110+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:55:41.755110+0000","last_peered":"2024-09-14T10:55:41.755110+0000","last_clean":"2024-09-14T10:55:41.755110+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:55:41.755110+0000","last_undegraded":"2024-09-14T10:55:41.755110+0000","last_fullsized":"2024-09-14T10:55:41.755110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:31.114647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.165855+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:57:11.165855+0000","last_peered":"2024-09-14T10:57:11.165855+0000","last_clean":"2024-09-14T10:57:11.165855+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:57:11.165855+0000","last_undegraded":"2024-09-14T10:57:11.165855+0000","last_fullsized":"2024-09-14T10:57:11.165855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072086+0000","last_change":"2024-09-14T10:55:06.706869+0000","last_active":"2024-09-14T10:56:29.072086+0000","last_peered":"2024-09-14T10:56:29.072086+0000","last_clean":"2024-09-14T10:56:29.072086+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:56:29.072086+0000","last_undegraded":"2024-09-14T10:56:29.072086+0000","last_fullsized":"2024-09-14T10:56:29.072086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:29.765849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.528232+0000","last_change":"2024-09-14T10:55:04.701437+0000","last_active":"2024-09-14T10:55:46.528232+0000","last_peered":"2024-09-14T10:55:46.528232+0000","last_clean":"2024-09-14T10:55:46.528232+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:55:46.528232+0000","last_undegraded":"2024-09-14T10:55:46.528232+0000","last_fullsized":"2024-09-14T10:55:46.528232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:36.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255000+0000","last_change":"2024-09-14T10:55:06.693983+0000","last_active":"2024-09-14T10:58:13.255000+0000","last_peered":"2024-09-14T10:58:13.255000+0000","last_clean":"2024-09-14T10:58:13.255000+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:13.255000+0000","last_undegraded":"2024-09-14T10:58:13.255000+0000","last_fullsized":"2024-09-14T10:58:13.255000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.880458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750801+0000","last_change":"2024-09-14T10:55:04.698396+0000","last_active":"2024-09-14T10:55:41.750801+0000","last_peered":"2024-09-14T10:55:41.750801+0000","last_clean":"2024-09-14T10:55:41.750801+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:55:41.750801+0000","last_undegraded":"2024-09-14T10:55:41.750801+0000","last_fullsized":"2024-09-14T10:55:41.750801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:53.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749782+0000","last_change":"2024-09-14T10:55:08.706267+0000","last_active":"2024-09-14T10:55:41.749782+0000","last_peered":"2024-09-14T10:55:41.749782+0000","last_clean":"2024-09-14T10:55:41.749782+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:55:41.749782+0000","last_undegraded":"2024-09-14T10:55:41.749782+0000","last_fullsized":"2024-09-14T10:55:41.749782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:55.090960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:27.098679+0000","last_change":"2024-09-14T10:55:06.700291+0000","last_active":"2024-09-14T10:57:27.098679+0000","last_peered":"2024-09-14T10:57:27.098679+0000","last_clean":"2024-09-14T10:57:27.098679+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:57:27.098679+0000","last_undegraded":"2024-09-14T10:57:27.098679+0000","last_fullsized":"2024-09-14T10:57:27.098679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:17.660782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748263+0000","last_change":"2024-09-14T10:55:04.699426+0000","last_active":"2024-09-14T10:55:41.748263+0000","last_peered":"2024-09-14T10:55:41.748263+0000","last_clean":"2024-09-14T10:55:41.748263+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:55:41.748263+0000","last_undegraded":"2024-09-14T10:55:41.748263+0000","last_fullsized":"2024-09-14T10:55:41.748263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:02.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'31","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.150888+0000","last_change":"2024-09-14T10:55:10.702656+0000","last_active":"2024-09-14T10:57:11.150888+0000","last_peered":"2024-09-14T10:57:11.150888+0000","last_clean":"2024-09-14T10:57:11.150888+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:57:11.150888+0000","last_undegraded":"2024-09-14T10:57:11.150888+0000","last_fullsized":"2024-09-14T10:57:11.150888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:11.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741582+0000","last_change":"2024-09-14T10:55:04.710135+0000","last_active":"2024-09-14T10:55:41.741582+0000","last_peered":"2024-09-14T10:55:41.741582+0000","last_clean":"2024-09-14T10:55:41.741582+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:55:41.741582+0000","last_undegraded":"2024-09-14T10:55:41.741582+0000","last_fullsized":"2024-09-14T10:55:41.741582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:45.412903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065142+0000","last_change":"2024-09-14T10:55:06.697498+0000","last_active":"2024-09-14T10:58:13.065142+0000","last_peered":"2024-09-14T10:58:13.065142+0000","last_clean":"2024-09-14T10:58:13.065142+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:13.065142+0000","last_undegraded":"2024-09-14T10:58:13.065142+0000","last_fullsized":"2024-09-14T10:58:13.065142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:39.956062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.516347+0000","last_change":"2024-09-14T10:55:04.709771+0000","last_active":"2024-09-14T10:55:46.516347+0000","last_peered":"2024-09-14T10:55:46.516347+0000","last_clean":"2024-09-14T10:55:46.516347+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:55:46.516347+0000","last_undegraded":"2024-09-14T10:55:46.516347+0000","last_fullsized":"2024-09-14T10:55:46.516347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:06.645182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751169+0000","last_change":"2024-09-14T10:55:08.699650+0000","last_active":"2024-09-14T10:55:41.751169+0000","last_peered":"2024-09-14T10:55:41.751169+0000","last_clean":"2024-09-14T10:55:41.751169+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:55:41.751169+0000","last_undegraded":"2024-09-14T10:55:41.751169+0000","last_fullsized":"2024-09-14T10:55:41.751169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:29.469388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.151854+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:57:11.151854+0000","last_peered":"2024-09-14T10:57:11.151854+0000","last_clean":"2024-09-14T10:57:11.151854+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:57:11.151854+0000","last_undegraded":"2024-09-14T10:57:11.151854+0000","last_fullsized":"2024-09-14T10:57:11.151854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744988+0000","last_change":"2024-09-14T10:55:04.711540+0000","last_active":"2024-09-14T10:55:41.744988+0000","last_peered":"2024-09-14T10:55:41.744988+0000","last_clean":"2024-09-14T10:55:41.744988+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:55:41.744988+0000","last_undegraded":"2024-09-14T10:55:41.744988+0000","last_fullsized":"2024-09-14T10:55:41.744988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:34.258135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746905+0000","last_change":"2024-09-14T10:55:08.696759+0000","last_active":"2024-09-14T10:55:41.746905+0000","last_peered":"2024-09-14T10:55:41.746905+0000","last_clean":"2024-09-14T10:55:41.746905+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:55:41.746905+0000","last_undegraded":"2024-09-14T10:55:41.746905+0000","last_fullsized":"2024-09-14T10:55:41.746905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.250751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.213430+0000","last_change":"2024-09-14T10:55:06.687522+0000","last_active":"2024-09-14T10:58:13.213430+0000","last_peered":"2024-09-14T10:58:13.213430+0000","last_clean":"2024-09-14T10:58:13.213430+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:13.213430+0000","last_undegraded":"2024-09-14T10:58:13.213430+0000","last_fullsized":"2024-09-14T10:58:13.213430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.424148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742424+0000","last_change":"2024-09-14T10:55:04.707600+0000","last_active":"2024-09-14T10:55:41.742424+0000","last_peered":"2024-09-14T10:55:41.742424+0000","last_clean":"2024-09-14T10:55:41.742424+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:55:41.742424+0000","last_undegraded":"2024-09-14T10:55:41.742424+0000","last_fullsized":"2024-09-14T10:55:41.742424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:35.430004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.392241+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:13.392241+0000","last_peered":"2024-09-14T10:58:13.392241+0000","last_clean":"2024-09-14T10:58:13.392241+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:13.392241+0000","last_undegraded":"2024-09-14T10:58:13.392241+0000","last_fullsized":"2024-09-14T10:58:13.392241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099899+0000","last_change":"2024-09-14T10:55:06.687803+0000","last_active":"2024-09-14T10:57:37.099899+0000","last_peered":"2024-09-14T10:57:37.099899+0000","last_clean":"2024-09-14T10:57:37.099899+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:57:37.099899+0000","last_undegraded":"2024-09-14T10:57:37.099899+0000","last_fullsized":"2024-09-14T10:57:37.099899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:19.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099990+0000","last_change":"2024-09-14T10:55:04.697878+0000","last_active":"2024-09-14T10:57:37.099990+0000","last_peered":"2024-09-14T10:57:37.099990+0000","last_clean":"2024-09-14T10:57:37.099990+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:57:37.099990+0000","last_undegraded":"2024-09-14T10:57:37.099990+0000","last_fullsized":"2024-09-14T10:57:37.099990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.142769+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:57:11.142769+0000","last_peered":"2024-09-14T10:57:11.142769+0000","last_clean":"2024-09-14T10:57:11.142769+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:57:11.142769+0000","last_undegraded":"2024-09-14T10:57:11.142769+0000","last_fullsized":"2024-09-14T10:57:11.142769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282026+0000","last_change":"2024-09-14T10:55:06.687347+0000","last_active":"2024-09-14T10:58:13.282026+0000","last_peered":"2024-09-14T10:58:13.282026+0000","last_clean":"2024-09-14T10:58:13.282026+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:13.282026+0000","last_undegraded":"2024-09-14T10:58:13.282026+0000","last_fullsized":"2024-09-14T10:58:13.282026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:08.040457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744386+0000","last_change":"2024-09-14T10:55:04.711139+0000","last_active":"2024-09-14T10:55:41.744386+0000","last_peered":"2024-09-14T10:55:41.744386+0000","last_clean":"2024-09-14T10:55:41.744386+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:55:41.744386+0000","last_undegraded":"2024-09-14T10:55:41.744386+0000","last_fullsized":"2024-09-14T10:55:41.744386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.640526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750062+0000","last_change":"2024-09-14T10:55:08.697330+0000","last_active":"2024-09-14T10:55:41.750062+0000","last_peered":"2024-09-14T10:55:41.750062+0000","last_clean":"2024-09-14T10:55:41.750062+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:55:41.750062+0000","last_undegraded":"2024-09-14T10:55:41.750062+0000","last_fullsized":"2024-09-14T10:55:41.750062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.585707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.261968+0000","last_change":"2024-09-14T10:55:06.701898+0000","last_active":"2024-09-14T10:58:13.261968+0000","last_peered":"2024-09-14T10:58:13.261968+0000","last_clean":"2024-09-14T10:58:13.261968+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:58:13.261968+0000","last_undegraded":"2024-09-14T10:58:13.261968+0000","last_fullsized":"2024-09-14T10:58:13.261968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:01.158624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747660+0000","last_change":"2024-09-14T10:55:04.693915+0000","last_active":"2024-09-14T10:55:41.747660+0000","last_peered":"2024-09-14T10:55:41.747660+0000","last_clean":"2024-09-14T10:55:41.747660+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:55:41.747660+0000","last_undegraded":"2024-09-14T10:55:41.747660+0000","last_fullsized":"2024-09-14T10:55:41.747660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:42.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749018+0000","last_change":"2024-09-14T10:55:08.705127+0000","last_active":"2024-09-14T10:55:41.749018+0000","last_peered":"2024-09-14T10:55:41.749018+0000","last_clean":"2024-09-14T10:55:41.749018+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:55:41.749018+0000","last_undegraded":"2024-09-14T10:55:41.749018+0000","last_fullsized":"2024-09-14T10:55:41.749018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:13.732662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.167639+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:57:11.167639+0000","last_peered":"2024-09-14T10:57:11.167639+0000","last_clean":"2024-09-14T10:57:11.167639+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:57:11.167639+0000","last_undegraded":"2024-09-14T10:57:11.167639+0000","last_fullsized":"2024-09-14T10:57:11.167639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206948+0000","last_change":"2024-09-14T10:55:06.685023+0000","last_active":"2024-09-14T10:58:13.206948+0000","last_peered":"2024-09-14T10:58:13.206948+0000","last_clean":"2024-09-14T10:58:13.206948+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:13.206948+0000","last_undegraded":"2024-09-14T10:58:13.206948+0000","last_fullsized":"2024-09-14T10:58:13.206948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.730948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.095656+0000","last_change":"2024-09-14T10:55:04.699747+0000","last_active":"2024-09-14T10:57:12.095656+0000","last_peered":"2024-09-14T10:57:12.095656+0000","last_clean":"2024-09-14T10:57:12.095656+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:57:12.095656+0000","last_undegraded":"2024-09-14T10:57:12.095656+0000","last_fullsized":"2024-09-14T10:57:12.095656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:31.195740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":13,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.224838+0000","last_change":"2024-09-14T10:55:08.704615+0000","last_active":"2024-09-14T10:57:12.224838+0000","last_peered":"2024-09-14T10:57:12.224838+0000","last_clean":"2024-09-14T10:57:12.224838+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:57:12.224838+0000","last_undegraded":"2024-09-14T10:57:12.224838+0000","last_fullsized":"2024-09-14T10:57:12.224838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:58.840952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'32","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.603846+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:12.603846+0000","last_peered":"2024-09-14T10:58:12.603846+0000","last_clean":"2024-09-14T10:58:12.603846+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:12.603846+0000","last_undegraded":"2024-09-14T10:58:12.603846+0000","last_fullsized":"2024-09-14T10:58:12.603846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970449+0000","last_change":"2024-09-14T10:55:06.706262+0000","last_active":"2024-09-14T10:58:12.970449+0000","last_peered":"2024-09-14T10:58:12.970449+0000","last_clean":"2024-09-14T10:58:12.970449+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:12.970449+0000","last_undegraded":"2024-09-14T10:58:12.970449+0000","last_fullsized":"2024-09-14T10:58:12.970449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:47.079971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745287+0000","last_change":"2024-09-14T10:55:04.692001+0000","last_active":"2024-09-14T10:55:41.745287+0000","last_peered":"2024-09-14T10:55:41.745287+0000","last_clean":"2024-09-14T10:55:41.745287+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:55:41.745287+0000","last_undegraded":"2024-09-14T10:55:41.745287+0000","last_fullsized":"2024-09-14T10:55:41.745287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:53.842302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071299+0000","last_change":"2024-09-14T10:55:06.687507+0000","last_active":"2024-09-14T10:58:13.071299+0000","last_peered":"2024-09-14T10:58:13.071299+0000","last_clean":"2024-09-14T10:58:13.071299+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:13.071299+0000","last_undegraded":"2024-09-14T10:58:13.071299+0000","last_fullsized":"2024-09-14T10:58:13.071299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:25.386577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745168+0000","last_change":"2024-09-14T10:55:04.688069+0000","last_active":"2024-09-14T10:55:41.745168+0000","last_peered":"2024-09-14T10:55:41.745168+0000","last_clean":"2024-09-14T10:55:41.745168+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:55:41.745168+0000","last_undegraded":"2024-09-14T10:55:41.745168+0000","last_fullsized":"2024-09-14T10:55:41.745168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.177526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.906651+0000","last_change":"2024-09-14T10:55:04.710926+0000","last_active":"2024-09-14T10:55:45.906651+0000","last_peered":"2024-09-14T10:55:45.906651+0000","last_clean":"2024-09-14T10:55:45.906651+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:55:45.906651+0000","last_undegraded":"2024-09-14T10:55:45.906651+0000","last_fullsized":"2024-09-14T10:55:45.906651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:49.684958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288727+0000","last_change":"2024-09-14T10:55:06.696409+0000","last_active":"2024-09-14T10:58:13.288727+0000","last_peered":"2024-09-14T10:58:13.288727+0000","last_clean":"2024-09-14T10:58:13.288727+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:13.288727+0000","last_undegraded":"2024-09-14T10:58:13.288727+0000","last_fullsized":"2024-09-14T10:58:13.288727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:21.339716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.853982+0000","last_change":"2024-09-14T10:55:04.692725+0000","last_active":"2024-09-14T10:58:12.853982+0000","last_peered":"2024-09-14T10:58:12.853982+0000","last_clean":"2024-09-14T10:58:12.853982+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:12.853982+0000","last_undegraded":"2024-09-14T10:58:12.853982+0000","last_fullsized":"2024-09-14T10:58:12.853982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:11.121584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584098+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:57:12.584098+0000","last_peered":"2024-09-14T10:57:12.584098+0000","last_clean":"2024-09-14T10:57:12.584098+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:57:12.584098+0000","last_undegraded":"2024-09-14T10:57:12.584098+0000","last_fullsized":"2024-09-14T10:57:12.584098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:07.392085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747193+0000","last_change":"2024-09-14T10:55:04.688186+0000","last_active":"2024-09-14T10:55:41.747193+0000","last_peered":"2024-09-14T10:55:41.747193+0000","last_clean":"2024-09-14T10:55:41.747193+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:55:41.747193+0000","last_undegraded":"2024-09-14T10:55:41.747193+0000","last_fullsized":"2024-09-14T10:55:41.747193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:00.846319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747700+0000","last_change":"2024-09-14T10:55:06.706855+0000","last_active":"2024-09-14T10:55:41.747700+0000","last_peered":"2024-09-14T10:55:41.747700+0000","last_clean":"2024-09-14T10:55:41.747700+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:55:41.747700+0000","last_undegraded":"2024-09-14T10:55:41.747700+0000","last_fullsized":"2024-09-14T10:55:41.747700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:37.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745885+0000","last_change":"2024-09-14T10:55:04.713422+0000","last_active":"2024-09-14T10:55:41.745885+0000","last_peered":"2024-09-14T10:55:41.745885+0000","last_clean":"2024-09-14T10:55:41.745885+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:55:41.745885+0000","last_undegraded":"2024-09-14T10:55:41.745885+0000","last_fullsized":"2024-09-14T10:55:41.745885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.810507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254690+0000","last_change":"2024-09-14T10:55:06.693603+0000","last_active":"2024-09-14T10:58:13.254690+0000","last_peered":"2024-09-14T10:58:13.254690+0000","last_clean":"2024-09-14T10:58:13.254690+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:13.254690+0000","last_undegraded":"2024-09-14T10:58:13.254690+0000","last_fullsized":"2024-09-14T10:58:13.254690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.667603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750884+0000","last_change":"2024-09-14T10:55:04.703452+0000","last_active":"2024-09-14T10:55:41.750884+0000","last_peered":"2024-09-14T10:55:41.750884+0000","last_clean":"2024-09-14T10:55:41.750884+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:55:41.750884+0000","last_undegraded":"2024-09-14T10:55:41.750884+0000","last_fullsized":"2024-09-14T10:55:41.750884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:00.261748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.269807+0000","last_change":"2024-09-14T10:55:06.695095+0000","last_active":"2024-09-14T10:55:46.269807+0000","last_peered":"2024-09-14T10:55:46.269807+0000","last_clean":"2024-09-14T10:55:46.269807+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:55:46.269807+0000","last_undegraded":"2024-09-14T10:55:46.269807+0000","last_fullsized":"2024-09-14T10:55:46.269807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:34.488242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747648+0000","last_change":"2024-09-14T10:55:04.692552+0000","last_active":"2024-09-14T10:55:41.747648+0000","last_peered":"2024-09-14T10:55:41.747648+0000","last_clean":"2024-09-14T10:55:41.747648+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:55:41.747648+0000","last_undegraded":"2024-09-14T10:55:41.747648+0000","last_fullsized":"2024-09-14T10:55:41.747648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:21.177487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.063117+0000","last_change":"2024-09-14T10:55:06.701407+0000","last_active":"2024-09-14T10:58:13.063117+0000","last_peered":"2024-09-14T10:58:13.063117+0000","last_clean":"2024-09-14T10:58:13.063117+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:13.063117+0000","last_undegraded":"2024-09-14T10:58:13.063117+0000","last_fullsized":"2024-09-14T10:58:13.063117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:37.860704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741718+0000","last_change":"2024-09-14T10:55:04.710334+0000","last_active":"2024-09-14T10:55:41.741718+0000","last_peered":"2024-09-14T10:55:41.741718+0000","last_clean":"2024-09-14T10:55:41.741718+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:55:41.741718+0000","last_undegraded":"2024-09-14T10:55:41.741718+0000","last_fullsized":"2024-09-14T10:55:41.741718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.591594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.933306+0000","last_change":"2024-09-14T10:55:04.708511+0000","last_active":"2024-09-14T10:58:12.933306+0000","last_peered":"2024-09-14T10:58:12.933306+0000","last_clean":"2024-09-14T10:58:12.933306+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:12.933306+0000","last_undegraded":"2024-09-14T10:58:12.933306+0000","last_fullsized":"2024-09-14T10:58:12.933306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.156640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'5","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:25.087198+0000","last_change":"2024-09-14T10:55:41.752889+0000","last_active":"2024-09-14T10:57:25.087198+0000","last_peered":"2024-09-14T10:57:25.087198+0000","last_clean":"2024-09-14T10:57:25.087198+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:57:25.087198+0000","last_undegraded":"2024-09-14T10:57:25.087198+0000","last_fullsized":"2024-09-14T10:57:25.087198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:42.730360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745601+0000","last_change":"2024-09-14T10:55:04.711861+0000","last_active":"2024-09-14T10:55:41.745601+0000","last_peered":"2024-09-14T10:55:41.745601+0000","last_clean":"2024-09-14T10:55:41.745601+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:55:41.745601+0000","last_undegraded":"2024-09-14T10:55:41.745601+0000","last_fullsized":"2024-09-14T10:55:41.745601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:53.636737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.585870+0000","last_change":"2024-09-14T10:55:06.693977+0000","last_active":"2024-09-14T10:57:12.585870+0000","last_peered":"2024-09-14T10:57:12.585870+0000","last_clean":"2024-09-14T10:57:12.585870+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:57:12.585870+0000","last_undegraded":"2024-09-14T10:57:12.585870+0000","last_fullsized":"2024-09-14T10:57:12.585870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:37.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745837+0000","last_change":"2024-09-14T10:55:04.709726+0000","last_active":"2024-09-14T10:55:41.745837+0000","last_peered":"2024-09-14T10:55:41.745837+0000","last_clean":"2024-09-14T10:55:41.745837+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:55:41.745837+0000","last_undegraded":"2024-09-14T10:55:41.745837+0000","last_fullsized":"2024-09-14T10:55:41.745837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:48.224901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206534+0000","last_change":"2024-09-14T10:55:06.706605+0000","last_active":"2024-09-14T10:58:13.206534+0000","last_peered":"2024-09-14T10:58:13.206534+0000","last_clean":"2024-09-14T10:58:13.206534+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:13.206534+0000","last_undegraded":"2024-09-14T10:58:13.206534+0000","last_fullsized":"2024-09-14T10:58:13.206534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:52.689688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743268+0000","last_change":"2024-09-14T10:55:04.699774+0000","last_active":"2024-09-14T10:55:41.743268+0000","last_peered":"2024-09-14T10:55:41.743268+0000","last_clean":"2024-09-14T10:55:41.743268+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:55:41.743268+0000","last_undegraded":"2024-09-14T10:55:41.743268+0000","last_fullsized":"2024-09-14T10:55:41.743268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:35.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288869+0000","last_change":"2024-09-14T10:55:06.699736+0000","last_active":"2024-09-14T10:58:13.288869+0000","last_peered":"2024-09-14T10:58:13.288869+0000","last_clean":"2024-09-14T10:58:13.288869+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:13.288869+0000","last_undegraded":"2024-09-14T10:58:13.288869+0000","last_fullsized":"2024-09-14T10:58:13.288869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.763519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744546+0000","last_change":"2024-09-14T10:55:04.709992+0000","last_active":"2024-09-14T10:55:41.744546+0000","last_peered":"2024-09-14T10:55:41.744546+0000","last_clean":"2024-09-14T10:55:41.744546+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:55:41.744546+0000","last_undegraded":"2024-09-14T10:55:41.744546+0000","last_fullsized":"2024-09-14T10:55:41.744546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:50.555115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.185204+0000","last_change":"2024-09-14T10:55:04.699259+0000","last_active":"2024-09-14T10:58:13.185204+0000","last_peered":"2024-09-14T10:58:13.185204+0000","last_clean":"2024-09-14T10:58:13.185204+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:13.185204+0000","last_undegraded":"2024-09-14T10:58:13.185204+0000","last_fullsized":"2024-09-14T10:58:13.185204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:40.790660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254366+0000","last_change":"2024-09-14T10:55:06.695857+0000","last_active":"2024-09-14T10:58:13.254366+0000","last_peered":"2024-09-14T10:58:13.254366+0000","last_clean":"2024-09-14T10:58:13.254366+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:13.254366+0000","last_undegraded":"2024-09-14T10:58:13.254366+0000","last_fullsized":"2024-09-14T10:58:13.254366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.647597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747002+0000","last_change":"2024-09-14T10:55:04.708597+0000","last_active":"2024-09-14T10:55:41.747002+0000","last_peered":"2024-09-14T10:55:41.747002+0000","last_clean":"2024-09-14T10:55:41.747002+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:55:41.747002+0000","last_undegraded":"2024-09-14T10:55:41.747002+0000","last_fullsized":"2024-09-14T10:55:41.747002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:23.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742085+0000","last_change":"2024-09-14T10:55:04.710032+0000","last_active":"2024-09-14T10:55:41.742085+0000","last_peered":"2024-09-14T10:55:41.742085+0000","last_clean":"2024-09-14T10:55:41.742085+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:55:41.742085+0000","last_undegraded":"2024-09-14T10:55:41.742085+0000","last_fullsized":"2024-09-14T10:55:41.742085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:53.935014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970776+0000","last_change":"2024-09-14T10:55:06.697653+0000","last_active":"2024-09-14T10:58:12.970776+0000","last_peered":"2024-09-14T10:58:12.970776+0000","last_clean":"2024-09-14T10:58:12.970776+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:12.970776+0000","last_undegraded":"2024-09-14T10:58:12.970776+0000","last_fullsized":"2024-09-14T10:58:12.970776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:19.133663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.907988+0000","last_change":"2024-09-14T10:55:04.708709+0000","last_active":"2024-09-14T10:58:12.907988+0000","last_peered":"2024-09-14T10:58:12.907988+0000","last_clean":"2024-09-14T10:58:12.907988+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:12.907988+0000","last_undegraded":"2024-09-14T10:58:12.907988+0000","last_fullsized":"2024-09-14T10:58:12.907988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.909709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.289007+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:58:13.289007+0000","last_peered":"2024-09-14T10:58:13.289007+0000","last_clean":"2024-09-14T10:58:13.289007+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:13.289007+0000","last_undegraded":"2024-09-14T10:58:13.289007+0000","last_fullsized":"2024-09-14T10:58:13.289007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:19.903453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":9028480,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":87,"num_write":313,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26136576,"data_stored":26136576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44356,"kb_used_data":9012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327484,"statfs":{"total":96636764160,"available":96591343616,"internally_reserved":0,"allocated":9228288,"data_stored":8874188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44856,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326984,"statfs":{"total":96636764160,"available":96590831616,"internally_reserved":0,"allocated":9740288,"data_stored":9460416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44892,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326948,"statfs":{"total":96636764160,"available":96590794752,"internally_reserved":0,"allocated":9777152,"data_stored":9463327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52260,"kb_used_data":12756,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319580,"statfs":{"total":96636764160,"available":96583249920,"internally_reserved":0,"allocated":13062144,"data_stored":12744757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:58:21.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:58:21.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449ce41640 1 Processor -- start 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449ce41640 1 -- start start 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449ce41640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f449806efc0 0x7f4498130e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449ce41640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f449806f9f0 con 0x7f449812be50 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449ce41640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f449806f580 con 0x7f449806efc0 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f448ffff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f449806efc0 0x7f4498130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449659c640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f449812be50 0x7f449812c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41380/0 (socket says 172.21.15.116:41380) 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.177+0000 7f449659c640 1 -- 172.21.15.116:0/1822188172 learned_addr learned my addr 172.21.15.116:0/1822188172 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f448ffff640 1 -- 172.21.15.116:0/1822188172 >> v1:172.21.15.116:6789/0 conn(0x7f449812be50 legacy=0x7f449812c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f448ffff640 1 -- 172.21.15.116:0/1822188172 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4498070f50 con 0x7f449806efc0 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f448ffff640 1 --2- 172.21.15.116:0/1822188172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f4498130e20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4480009720 tx=0x7f448002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7512262e20f10c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f4495d9b640 1 -- 172.21.15.116:0/1822188172 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4480037070 con 0x7f449806efc0 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f4495d9b640 1 -- 172.21.15.116:0/1822188172 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f448002ad90 con 0x7f449806efc0 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.178+0000 7f4495d9b640 1 -- 172.21.15.116:0/1822188172 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4480032590 con 0x7f449806efc0 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 -- 172.21.15.116:0/1822188172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 msgr2=0x7f4498130e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 --2- 172.21.15.116:0/1822188172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f4498130e20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4480009720 tx=0x7f448002a110 comp rx=0 tx=0).stop 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 -- 172.21.15.116:0/1822188172 shutdown_connections 2024-09-14T10:58:21.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 --2- 172.21.15.116:0/1822188172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f4498130e20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 -- 172.21.15.116:0/1822188172 >> 172.21.15.116:0/1822188172 conn(0x7f449809abc0 msgr2=0x7f4498098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 -- 172.21.15.116:0/1822188172 shutdown_connections 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.179+0000 7f449ce41640 1 -- 172.21.15.116:0/1822188172 wait complete. 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449ce41640 1 Processor -- start 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449ce41640 1 -- start start 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449ce41640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449ce41640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f4498099bb0 con 0x7f449806efc0 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43518/0 (socket says 172.21.15.116:43518) 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.180+0000 7f449659c640 1 -- 172.21.15.116:0/628843307 learned_addr learned my addr 172.21.15.116:0/628843307 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f449659c640 1 -- 172.21.15.116:0/628843307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4498129df0 con 0x7f449806efc0 2024-09-14T10:58:21.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f449659c640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f448800c480 tx=0x7f448800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:21.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4488017070 con 0x7f449806efc0 2024-09-14T10:58:21.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4488005c10 con 0x7f449806efc0 2024-09-14T10:58:21.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4488007070 con 0x7f449806efc0 2024-09-14T10:58:21.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44981325e0 con 0x7f449806efc0 2024-09-14T10:58:21.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.181+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4498128c80 con 0x7f449806efc0 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.182+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449809a110 con 0x7f449806efc0 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.182+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f448801a070 con 0x7f449806efc0 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.182+0000 7f448effd640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 0x7f4478040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.182+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f4488052970 con 0x7f449806efc0 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.182+0000 7f448ffff640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 0x7f4478040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:21.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.183+0000 7f448ffff640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 0x7f4478040a30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4480034000 tx=0x7f448002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:21.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.186+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f4498129df0 con 0x7f449806efc0 2024-09-14T10:58:21.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.359+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f449806eda0 con 0x7f449806efc0 2024-09-14T10:58:21.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.360+0000 7f448effd640 1 -- 172.21.15.116:0/628843307 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+21189 (secure 0 0 0) 0x7f4488019cd0 con 0x7f449806efc0 2024-09-14T10:58:21.359 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:21.359 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":37,"fsid":"7b7ae84a-db16-40d6-b8d8-00c489fcd057","created":"2024-09-14T10:54:35.665949+0000","modified":"2024-09-14T10:55:41.735580+0000","last_up_change":"2024-09-14T10:54:46.775997+0000","last_in_change":"2024-09-14T10:54:36.736511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:54:48.071849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:54:51.203142+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:55:02.664151+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:55:04.991059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:55:06.979784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:55:08.773435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:55:10.720730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:55:12.791353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d968f5c3-c7f1-4e12-8531-2194aa167d4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6801","nonce":1614093354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6803","nonce":1614093354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6807","nonce":1614093354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":1614093354},{"type":"v1","addr":"172.21.15.116:6805","nonce":1614093354}]},"public_addr":"172.21.15.116:6801/1614093354","cluster_addr":"172.21.15.116:6803/1614093354","heartbeat_back_addr":"172.21.15.116:6807/1614093354","heartbeat_front_addr":"172.21.15.116:6805/1614093354","state":["exists","up"]},{"osd":1,"uuid":"6dc56737-f3c6-4bcc-ab17-1b5b8ace4592","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6804","nonce":3845281611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6808","nonce":3845281611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6815","nonce":3845281611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":3845281611},{"type":"v1","addr":"172.21.15.164:6812","nonce":3845281611}]},"public_addr":"172.21.15.164:6804/3845281611","cluster_addr":"172.21.15.164:6808/3845281611","heartbeat_back_addr":"172.21.15.164:6815/3845281611","heartbeat_front_addr":"172.21.15.164:6812/3845281611","state":["exists","up"]},{"osd":2,"uuid":"be1f280b-51cf-499b-9163-01191ffe1ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6801","nonce":813620551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6803","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6805","nonce":813620551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6811","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6813","nonce":813620551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6807","nonce":813620551},{"type":"v1","addr":"172.21.15.164:6809","nonce":813620551}]},"public_addr":"172.21.15.164:6801/813620551","cluster_addr":"172.21.15.164:6805/813620551","heartbeat_back_addr":"172.21.15.164:6813/813620551","heartbeat_front_addr":"172.21.15.164:6809/813620551","state":["exists","up"]},{"osd":3,"uuid":"511e0723-5c72-47fc-8bde-5f4106483858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6817","nonce":3361197980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6819","nonce":3361197980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6823","nonce":3361197980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":3361197980},{"type":"v1","addr":"172.21.15.164:6821","nonce":3361197980}]},"public_addr":"172.21.15.164:6817/3361197980","cluster_addr":"172.21.15.164:6819/3361197980","heartbeat_back_addr":"172.21.15.164:6823/3361197980","heartbeat_front_addr":"172.21.15.164:6821/3361197980","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:42.887950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.053178+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.353606+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:54:43.316128+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2d","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:58:21.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 msgr2=0x7f4478040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 0x7f4478040a30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4480034000 tx=0x7f448002e000 comp rx=0 tx=0).stop 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 msgr2=0x7f44981c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f448800c480 tx=0x7f448800c940 comp rx=0 tx=0).stop 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 shutdown_connections 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f447803e570 0x7f4478040a30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 --2- 172.21.15.116:0/628843307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f449806efc0 0x7f44981c2230 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.362+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 >> 172.21.15.116:0/628843307 conn(0x7f449809abc0 msgr2=0x7f4498071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.363+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 shutdown_connections 2024-09-14T10:58:21.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:21.363+0000 7f449ce41640 1 -- 172.21.15.116:0/628843307 wait complete. 2024-09-14T10:58:22.372 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T10:58:22.372 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:58:22.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f28313c6640 1 Processor -- start 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f28313c6640 1 -- start start 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f28313c6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f282c12dd50 0x7f282c132790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f28313c6640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282c09c0c0 con 0x7f282c12d260 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f28313c6640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f282c09c580 con 0x7f282c12dd50 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.487+0000 7f282a7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f282c12dd50 0x7f282c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.488+0000 7f282affd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f282c12d260 0x7f282c12d640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41394/0 (socket says 172.21.15.116:41394) 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.488+0000 7f282affd640 1 -- 172.21.15.116:0/1178459405 learned_addr learned my addr 172.21.15.116:0/1178459405 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.488+0000 7f282a7fc640 1 -- 172.21.15.116:0/1178459405 >> v1:172.21.15.116:6789/0 conn(0x7f282c12d260 legacy=0x7f282c12d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.488+0000 7f282a7fc640 1 -- 172.21.15.116:0/1178459405 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c098af0 con 0x7f282c12dd50 2024-09-14T10:58:22.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.488+0000 7f2829ffb640 1 -- 172.21.15.116:0/1178459405 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949643168 0 0) 0x7f282c09c0c0 con 0x7f282c12d260 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f282a7fc640 1 --2- 172.21.15.116:0/1178459405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12dd50 0x7f282c132790 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2820009750 tx=0x7f282002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f7ca69f2360cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f2829ffb640 1 -- 172.21.15.116:0/1178459405 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2820037070 con 0x7f282c12dd50 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f2829ffb640 1 -- 172.21.15.116:0/1178459405 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282002ad80 con 0x7f282c12dd50 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f2829ffb640 1 -- 172.21.15.116:0/1178459405 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2820032590 con 0x7f282c12dd50 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 -- 172.21.15.116:0/1178459405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12dd50 msgr2=0x7f282c132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 --2- 172.21.15.116:0/1178459405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12dd50 0x7f282c132790 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2820009750 tx=0x7f282002a140 comp rx=0 tx=0).stop 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 -- 172.21.15.116:0/1178459405 shutdown_connections 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 --2- 172.21.15.116:0/1178459405 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12dd50 0x7f282c132790 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 -- 172.21.15.116:0/1178459405 >> 172.21.15.116:0/1178459405 conn(0x7f282c09ce60 msgr2=0x7f282c09a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 -- 172.21.15.116:0/1178459405 shutdown_connections 2024-09-14T10:58:22.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.489+0000 7f28313c6640 1 -- 172.21.15.116:0/1178459405 wait complete. 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.490+0000 7f28313c6640 1 Processor -- start 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.490+0000 7f28313c6640 1 -- start start 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28313c6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28313c6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f282c133060 con 0x7f282c12d260 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f282affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f282affd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43528/0 (socket says 172.21.15.116:43528) 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f282affd640 1 -- 172.21.15.116:0/3978726568 learned_addr learned my addr 172.21.15.116:0/3978726568 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f282affd640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c132480 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f282affd640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c3d0 tx=0x7f281c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c0074d0 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c0047e0 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c007670 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.491+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c074570 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.492+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c06f830 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.492+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f281c011070 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.492+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f282c06fac0 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f28137fe640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 0x7f2818040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f281c0532a0 con 0x7f282c12d260 2024-09-14T10:58:22.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f28137fe640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 0x7f281804ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f281c015e70 con 0x7f281804a9d0 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f281c05a050 con 0x7f282c12d260 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f282b7fe640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 0x7f281804ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f282a7fc640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 0x7f2818040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f282b7fe640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 0x7f281804ce70 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.493+0000 7f282a7fc640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 0x7f2818040a30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2820009750 tx=0x7f282002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.494+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== osd.0 v2:172.21.15.116:6800/1614093354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f281c015e70 con 0x7f281804a9d0 2024-09-14T10:58:22.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.506+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 --> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f282c12d640 con 0x7f281804a9d0 2024-09-14T10:58:22.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.506+0000 7f28137fe640 1 -- 172.21.15.116:0/3978726568 <== osd.0 v2:172.21.15.116:6800/1614093354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f282c12d640 con 0x7f281804a9d0 2024-09-14T10:58:22.505 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T10:58:22.505 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:58:22.505 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 msgr2=0x7f281804ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 0x7f281804ce70 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 msgr2=0x7f2818040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 0x7f2818040a30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2820009750 tx=0x7f282002e000 comp rx=0 tx=0).stop 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 msgr2=0x7f282c129200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c3d0 tx=0x7f281c00c890 comp rx=0 tx=0).stop 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 shutdown_connections 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:6800/1614093354,v1:172.21.15.116:6801/1614093354] conn(0x7f281804a9d0 0x7f281804ce70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f281803e570 0x7f2818040a30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 --2- 172.21.15.116:0/3978726568 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f282c12d260 0x7f282c129200 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 >> 172.21.15.116:0/3978726568 conn(0x7f282c09ce60 msgr2=0x7f282c09af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 shutdown_connections 2024-09-14T10:58:22.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.507+0000 7f28313c6640 1 -- 172.21.15.116:0/3978726568 wait complete. 2024-09-14T10:58:22.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T10:58:22.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.614+0000 7f9232f0e640 1 Processor -- start 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.614+0000 7f9232f0e640 1 -- start start 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f9232f0e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f922c09bf90 0x7f922c134a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f9232f0e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922c0706a0 con 0x7f922c09b4a0 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f9232f0e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f922c09f400 con 0x7f922c09bf90 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f9230caa640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f922c09b4a0 0x7f922c09b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41400/0 (socket says 172.21.15.116:41400) 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f9230caa640 1 -- 172.21.15.116:0/366554906 learned_addr learned my addr 172.21.15.116:0/366554906 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f922bfff640 1 --2- 172.21.15.116:0/366554906 >> v2:172.21.15.116:3300/0 conn(0x7f922c09bf90 0x7f922c134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f922b7fe640 1 -- 172.21.15.116:0/366554906 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527662754 0 0) 0x7f922c0706a0 con 0x7f922c09b4a0 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f922b7fe640 1 -- 172.21.15.116:0/366554906 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9214003520 con 0x7f922c09b4a0 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f922bfff640 1 -- 172.21.15.116:0/366554906 >> v1:172.21.15.116:6789/0 conn(0x7f922c09b4a0 legacy=0x7f922c09b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.615+0000 7f922bfff640 1 -- 172.21.15.116:0/366554906 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c09f950 con 0x7f922c09bf90 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.616+0000 7f922bfff640 1 --2- 172.21.15.116:0/366554906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09bf90 0x7f922c134a10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9220009720 tx=0x7f922002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c820669c6de31c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.616+0000 7f922b7fe640 1 -- 172.21.15.116:0/366554906 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9220037070 con 0x7f922c09bf90 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.616+0000 7f922b7fe640 1 -- 172.21.15.116:0/366554906 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922002ae20 con 0x7f922c09bf90 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.616+0000 7f922b7fe640 1 -- 172.21.15.116:0/366554906 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9220032590 con 0x7f922c09bf90 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 -- 172.21.15.116:0/366554906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09bf90 msgr2=0x7f922c134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 --2- 172.21.15.116:0/366554906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09bf90 0x7f922c134a10 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9220009720 tx=0x7f922002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 -- 172.21.15.116:0/366554906 shutdown_connections 2024-09-14T10:58:22.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 --2- 172.21.15.116:0/366554906 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09bf90 0x7f922c134a10 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 -- 172.21.15.116:0/366554906 >> 172.21.15.116:0/366554906 conn(0x7f922c0a25b0 msgr2=0x7f922c09ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 -- 172.21.15.116:0/366554906 shutdown_connections 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 -- 172.21.15.116:0/366554906 wait complete. 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.617+0000 7f9232f0e640 1 Processor -- start 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9232f0e640 1 -- start start 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9232f0e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9232f0e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f922c1350d0 con 0x7f922c09b4a0 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9230caa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9230caa640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43546/0 (socket says 172.21.15.116:43546) 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9230caa640 1 -- 172.21.15.116:0/155206181 learned_addr learned my addr 172.21.15.116:0/155206181 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.618+0000 7f9230caa640 1 -- 172.21.15.116:0/155206181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c073850 con 0x7f922c09b4a0 2024-09-14T10:58:22.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f9230caa640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c480 tx=0x7f921c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c017070 con 0x7f922c09b4a0 2024-09-14T10:58:22.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c005cd0 con 0x7f922c09b4a0 2024-09-14T10:58:22.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c007200 con 0x7f922c09b4a0 2024-09-14T10:58:22.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c131040 con 0x7f922c09b4a0 2024-09-14T10:58:22.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.619+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c1c4b10 con 0x7f922c09b4a0 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.620+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f921c01a070 con 0x7f922c09b4a0 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.620+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c073170 con 0x7f922c09b4a0 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.620+0000 7f92297fa640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 0x7f9218040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.620+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f921c0529e0 con 0x7f922c09b4a0 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.620+0000 7f922bfff640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 0x7f9218040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.621+0000 7f922bfff640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 0x7f9218040a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9220034000 tx=0x7f922002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.624+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f921c01bdc0 con 0x7f922c09b4a0 2024-09-14T10:58:22.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.803+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f922c1316d0 con 0x7f921803e5a0 2024-09-14T10:58:22.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.804+0000 7f92297fa640 1 -- 172.21.15.116:0/155206181 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f922c1316d0 con 0x7f921803e5a0 2024-09-14T10:58:22.802 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.806+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 msgr2=0x7f9218040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.806+0000 7f9232f0e640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 0x7f9218040a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9220034000 tx=0x7f922002e000 comp rx=0 tx=0).stop 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.806+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 msgr2=0x7f922c1c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.806+0000 7f9232f0e640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f921c00c480 tx=0x7f921c00c940 comp rx=0 tx=0).stop 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 shutdown_connections 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f921803e5a0 0x7f9218040a60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 --2- 172.21.15.116:0/155206181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f922c09b4a0 0x7f922c1c43f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 >> 172.21.15.116:0/155206181 conn(0x7f922c0a25b0 msgr2=0x7f922c12d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 shutdown_connections 2024-09-14T10:58:22.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.807+0000 7f9232f0e640 1 -- 172.21.15.116:0/155206181 wait complete. 2024-09-14T10:58:22.815 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T10:58:22.815 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:58:22.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.920+0000 7f0aef040640 1 Processor -- start 2024-09-14T10:58:22.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aef040640 1 -- start start 2024-09-14T10:58:22.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aef040640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ae806efc0 0x7f0ae8130e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aef040640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8070c00 con 0x7f0ae812bec0 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aef040640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae8070e70 con 0x7f0ae806efc0 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0ae7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0ae806efc0 0x7f0ae8130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aecddc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0ae812bec0 0x7f0ae812c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41402/0 (socket says 172.21.15.116:41402) 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0aecddc640 1 -- 172.21.15.116:0/4096268749 learned_addr learned my addr 172.21.15.116:0/4096268749 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0ae7fff640 1 -- 172.21.15.116:0/4096268749 >> v1:172.21.15.116:6789/0 conn(0x7f0ae812bec0 legacy=0x7f0ae812c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0ae77fe640 1 -- 172.21.15.116:0/4096268749 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457123258 0 0) 0x7f0ae8070c00 con 0x7f0ae812bec0 2024-09-14T10:58:22.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.921+0000 7f0ae7fff640 1 -- 172.21.15.116:0/4096268749 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae806f930 con 0x7f0ae806efc0 2024-09-14T10:58:22.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.922+0000 7f0ae7fff640 1 --2- 172.21.15.116:0/4096268749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8130e90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009720 tx=0x7f0ad402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dda0217904ccb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.922+0000 7f0ae77fe640 1 -- 172.21.15.116:0/4096268749 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4037070 con 0x7f0ae806efc0 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.922+0000 7f0ae77fe640 1 -- 172.21.15.116:0/4096268749 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad402ad90 con 0x7f0ae806efc0 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.922+0000 7f0ae77fe640 1 -- 172.21.15.116:0/4096268749 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ad4032590 con 0x7f0ae806efc0 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 -- 172.21.15.116:0/4096268749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 msgr2=0x7f0ae8130e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 --2- 172.21.15.116:0/4096268749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8130e90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009720 tx=0x7f0ad402a110 comp rx=0 tx=0).stop 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 -- 172.21.15.116:0/4096268749 shutdown_connections 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 --2- 172.21.15.116:0/4096268749 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8130e90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 -- 172.21.15.116:0/4096268749 >> 172.21.15.116:0/4096268749 conn(0x7f0ae809a9f0 msgr2=0x7f0ae809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 -- 172.21.15.116:0/4096268749 shutdown_connections 2024-09-14T10:58:22.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.923+0000 7f0aef040640 1 -- 172.21.15.116:0/4096268749 wait complete. 2024-09-14T10:58:22.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aef040640 1 Processor -- start 2024-09-14T10:58:22.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aef040640 1 -- start start 2024-09-14T10:58:22.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aef040640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aef040640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae812c9b0 con 0x7f0ae806efc0 2024-09-14T10:58:22.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aecddc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aecddc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43558/0 (socket says 172.21.15.116:43558) 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aecddc640 1 -- 172.21.15.116:0/1757343480 learned_addr learned my addr 172.21.15.116:0/1757343480 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.924+0000 7f0aecddc640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80736f0 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0aecddc640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c3e0 tx=0x7f0adc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc017070 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc005c10 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae8134e30 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0adc0070d0 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.925+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae812b900 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f0adc01a070 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ae81290e0 con 0x7f0ae806efc0 2024-09-14T10:58:22.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 0x7f0acc040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f0adc052a60 con 0x7f0ae806efc0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 0x7f0acc04ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0adc013e50 con 0x7f0acc04a9d0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0adc0572a0 con 0x7f0ae806efc0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0ae7fff640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 0x7f0acc040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.926+0000 7f0aed5dd640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 0x7f0acc04ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.927+0000 7f0aed5dd640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 0x7f0acc04ce70 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.927+0000 7f0ae7fff640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 0x7f0acc040a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009720 tx=0x7f0ad402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:22.927 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.928+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== osd.1 v2:172.21.15.164:6802/3845281611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0adc013e50 con 0x7f0acc04a9d0 2024-09-14T10:58:22.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.940+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 --> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ae8128640 con 0x7f0acc04a9d0 2024-09-14T10:58:22.938 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.940+0000 7f0ae57fa640 1 -- 172.21.15.116:0/1757343480 <== osd.1 v2:172.21.15.164:6802/3845281611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0ae000ad10 con 0x7f0acc04a9d0 2024-09-14T10:58:22.939 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T10:58:22.939 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:58:22.939 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T10:58:22.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 msgr2=0x7f0acc04ce70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 0x7f0acc04ce70 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 msgr2=0x7f0acc040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 0x7f0acc040a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4009720 tx=0x7f0ad402e000 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 msgr2=0x7f0ae8129cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c3e0 tx=0x7f0adc00c8a0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 shutdown_connections 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6802/3845281611,v1:172.21.15.164:6804/3845281611] conn(0x7f0acc04a9d0 0x7f0acc04ce70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f0acc03e570 0x7f0acc040a30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 --2- 172.21.15.116:0/1757343480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae806efc0 0x7f0ae8129cc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 >> 172.21.15.116:0/1757343480 conn(0x7f0ae809a9f0 msgr2=0x7f0ae809c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 shutdown_connections 2024-09-14T10:58:22.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:22.941+0000 7f0aef040640 1 -- 172.21.15.116:0/1757343480 wait complete. 2024-09-14T10:58:22.949 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T10:58:23.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.048+0000 7fe7c622b640 1 Processor -- start 2024-09-14T10:58:23.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7c622b640 1 -- start start 2024-09-14T10:58:23.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7c622b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe7c012c0b0 0x7fe7c012c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7c622b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c009a290 con 0x7fe7c012c9d0 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7c622b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c0071860 con 0x7fe7c012c0b0 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7bf7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe7c012c0b0 0x7fe7c012c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7b6ffd640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe7c012c9d0 0x7fe7c0097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41406/0 (socket says 172.21.15.116:41406) 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7b6ffd640 1 -- 172.21.15.116:0/2834754499 learned_addr learned my addr 172.21.15.116:0/2834754499 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7bf7fe640 1 -- 172.21.15.116:0/2834754499 >> v1:172.21.15.116:6789/0 conn(0x7fe7c012c9d0 legacy=0x7fe7c0097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7bf7fe640 1 -- 172.21.15.116:0/2834754499 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c0099e20 con 0x7fe7c012c0b0 2024-09-14T10:58:23.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.049+0000 7fe7beffd640 1 -- 172.21.15.116:0/2834754499 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912371319 0 0) 0x7fe7c009a290 con 0x7fe7c012c9d0 2024-09-14T10:58:23.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.050+0000 7fe7bf7fe640 1 --2- 172.21.15.116:0/2834754499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c012c490 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009750 tx=0x7fe7b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ccfb5e25e5209b server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.050+0000 7fe7beffd640 1 -- 172.21.15.116:0/2834754499 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0037070 con 0x7fe7c012c0b0 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.050+0000 7fe7beffd640 1 -- 172.21.15.116:0/2834754499 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b002ad80 con 0x7fe7c012c0b0 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.050+0000 7fe7beffd640 1 -- 172.21.15.116:0/2834754499 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0032590 con 0x7fe7c012c0b0 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 -- 172.21.15.116:0/2834754499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 msgr2=0x7fe7c012c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 --2- 172.21.15.116:0/2834754499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c012c490 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009750 tx=0x7fe7b002a140 comp rx=0 tx=0).stop 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 -- 172.21.15.116:0/2834754499 shutdown_connections 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 --2- 172.21.15.116:0/2834754499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c012c490 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 -- 172.21.15.116:0/2834754499 >> 172.21.15.116:0/2834754499 conn(0x7fe7c009abc0 msgr2=0x7fe7c0098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 -- 172.21.15.116:0/2834754499 shutdown_connections 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.051+0000 7fe7c622b640 1 -- 172.21.15.116:0/2834754499 wait complete. 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7c622b640 1 Processor -- start 2024-09-14T10:58:23.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7c622b640 1 -- start start 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7c622b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7c622b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c012ce00 con 0x7fe7c012c0b0 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7bf7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43586/0 (socket says 172.21.15.116:43586) 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7bf7fe640 1 -- 172.21.15.116:0/3255311234 learned_addr learned my addr 172.21.15.116:0/3255311234 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.052+0000 7fe7bf7fe640 1 -- 172.21.15.116:0/3255311234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c0074090 con 0x7fe7c012c0b0 2024-09-14T10:58:23.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7bf7fe640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009750 tx=0x7fe7b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0041070 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b003c590 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c0097bd0 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b0037040 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.053+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c008f2a0 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.054+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fe7b0044070 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.054+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c008ec70 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.054+0000 7fe7bcff9640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 0x7fe7a0040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.054+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fe7b0073fb0 con 0x7fe7c012c0b0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.054+0000 7fe7b6ffd640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 0x7fe7a0040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.055+0000 7fe7b6ffd640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 0x7fe7a0040a60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8005880 tx=0x7fe7a8007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.058+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fe7b00723b0 con 0x7fe7c012c0b0 2024-09-14T10:58:23.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.232+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe7c012c490 con 0x7fe7a003e5a0 2024-09-14T10:58:23.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.233+0000 7fe7bcff9640 1 -- 172.21.15.116:0/3255311234 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe7c012c490 con 0x7fe7a003e5a0 2024-09-14T10:58:23.231 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T10:58:23.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 msgr2=0x7fe7a0040a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 0x7fe7a0040a60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8005880 tx=0x7fe7a8007970 comp rx=0 tx=0).stop 2024-09-14T10:58:23.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 msgr2=0x7fe7c008c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009750 tx=0x7fe7b00046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 shutdown_connections 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fe7a003e5a0 0x7fe7a0040a60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 --2- 172.21.15.116:0/3255311234 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7c012c0b0 0x7fe7c008c5f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 >> 172.21.15.116:0/3255311234 conn(0x7fe7c009abc0 msgr2=0x7fe7c0129040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 shutdown_connections 2024-09-14T10:58:23.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.235+0000 7fe7c622b640 1 -- 172.21.15.116:0/3255311234 wait complete. 2024-09-14T10:58:23.243 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T10:58:23.244 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.347+0000 7fb2bb62a640 1 Processor -- start 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.347+0000 7fb2bb62a640 1 -- start start 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.347+0000 7fb2bb62a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2b406f4f0 0x7fb2b406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.347+0000 7fb2bb62a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b406f0c0 con 0x7fb2b4070b40 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.347+0000 7fb2bb62a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b4099ba0 con 0x7fb2b406f4f0 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b93c6640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2b406f4f0 0x7fb2b406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b8bc5640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb2b4070b40 0x7fb2b412bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41418/0 (socket says 172.21.15.116:41418) 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b8bc5640 1 -- 172.21.15.116:0/3289767741 learned_addr learned my addr 172.21.15.116:0/3289767741 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b93c6640 1 --2- 172.21.15.116:0/3289767741 >> v2:172.21.15.116:3300/0 conn(0x7fb2b406f4f0 0x7fb2b406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43596/0 (socket says 172.21.15.116:43596) 2024-09-14T10:58:23.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b93c6640 1 -- 172.21.15.116:0/3289767741 >> v1:172.21.15.116:6789/0 conn(0x7fb2b4070b40 legacy=0x7fb2b412bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2abfff640 1 -- 172.21.15.116:0/3289767741 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932914500 0 0) 0x7fb2b406f0c0 con 0x7fb2b4070b40 2024-09-14T10:58:23.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b93c6640 1 -- 172.21.15.116:0/3289767741 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40712b0 con 0x7fb2b406f4f0 2024-09-14T10:58:23.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.348+0000 7fb2b93c6640 1 --2- 172.21.15.116:0/3289767741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b406f8d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009720 tx=0x7fb2b002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747b1a932a30a737 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2abfff640 1 -- 172.21.15.116:0/3289767741 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0037070 con 0x7fb2b406f4f0 2024-09-14T10:58:23.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2abfff640 1 -- 172.21.15.116:0/3289767741 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b002ad90 con 0x7fb2b406f4f0 2024-09-14T10:58:23.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2abfff640 1 -- 172.21.15.116:0/3289767741 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0032590 con 0x7fb2b406f4f0 2024-09-14T10:58:23.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 -- 172.21.15.116:0/3289767741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 msgr2=0x7fb2b406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/3289767741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b406f8d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009720 tx=0x7fb2b002a110 comp rx=0 tx=0).stop 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 -- 172.21.15.116:0/3289767741 shutdown_connections 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/3289767741 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b406f8d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 -- 172.21.15.116:0/3289767741 >> 172.21.15.116:0/3289767741 conn(0x7fb2b409a9f0 msgr2=0x7fb2b409ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 -- 172.21.15.116:0/3289767741 shutdown_connections 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.349+0000 7fb2bb62a640 1 -- 172.21.15.116:0/3289767741 wait complete. 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.350+0000 7fb2bb62a640 1 Processor -- start 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.350+0000 7fb2bb62a640 1 -- start start 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.350+0000 7fb2bb62a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.350+0000 7fb2bb62a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40701a0 con 0x7fb2b406f4f0 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2b93c6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2b93c6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43602/0 (socket says 172.21.15.116:43602) 2024-09-14T10:58:23.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2b93c6640 1 -- 172.21.15.116:0/1852656346 learned_addr learned my addr 172.21.15.116:0/1852656346 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2b93c6640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b406e500 con 0x7fb2b406f4f0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2b93c6640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009720 tx=0x7fb2b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0041070 con 0x7fb2b406f4f0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b003c460 con 0x7fb2b406f4f0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b406e220 con 0x7fb2b406f4f0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b0037040 con 0x7fb2b406f4f0 2024-09-14T10:58:23.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.351+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b408f930 con 0x7fb2b406f4f0 2024-09-14T10:58:23.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2b412cb70 con 0x7fb2b406f4f0 2024-09-14T10:58:23.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fb2b0044070 con 0x7fb2b406f4f0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 0x7fb298040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fb2b0073ec0 con 0x7fb2b406f4f0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 0x7fb29804ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2b004be80 con 0x7fb29804a970 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.352+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb2b007b050 con 0x7fb2b406f4f0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.353+0000 7fb2b8bc5640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 0x7fb298040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.353+0000 7fb2b9bc7640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 0x7fb29804ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.353+0000 7fb2b9bc7640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 0x7fb29804ce10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.353+0000 7fb2b8bc5640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 0x7fb298040a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a40078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.354+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== osd.2 v2:172.21.15.164:6800/813620551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2b004be80 con 0x7fb29804a970 2024-09-14T10:58:23.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.366+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 --> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb2b4073e60 con 0x7fb29804a970 2024-09-14T10:58:23.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2a9ffb640 1 -- 172.21.15.116:0/1852656346 <== osd.2 v2:172.21.15.164:6800/813620551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb2b4073e60 con 0x7fb29804a970 2024-09-14T10:58:23.365 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T10:58:23.365 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:58:23.365 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 msgr2=0x7fb29804ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 0x7fb29804ce10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 msgr2=0x7fb298040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 0x7fb298040a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4000c00 tx=0x7fb2a40078f0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 msgr2=0x7fb2b408e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009720 tx=0x7fb2b00046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 shutdown_connections 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6800/813620551,v1:172.21.15.164:6801/813620551] conn(0x7fb29804a970 0x7fb29804ce10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fb29803e570 0x7fb298040a30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 --2- 172.21.15.116:0/1852656346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2b406f4f0 0x7fb2b408e1f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 >> 172.21.15.116:0/1852656346 conn(0x7fb2b409a9f0 msgr2=0x7fb2b4122bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 shutdown_connections 2024-09-14T10:58:23.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.367+0000 7fb2bb62a640 1 -- 172.21.15.116:0/1852656346 wait complete. 2024-09-14T10:58:23.375 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T10:58:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.475+0000 7fa098c39640 1 Processor -- start 2024-09-14T10:58:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa098c39640 1 -- start start 2024-09-14T10:58:23.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa098c39640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa09412be50 0x7fa09412c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa098c39640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09406f9f0 con 0x7fa09412c770 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa098c39640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fa09406f580 con 0x7fa09412be50 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa09259c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa09412be50 0x7fa09412c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa08bfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa09412c770 0x7fa09406dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41432/0 (socket says 172.21.15.116:41432) 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa08bfff640 1 -- 172.21.15.116:0/556690620 learned_addr learned my addr 172.21.15.116:0/556690620 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa09259c640 1 -- 172.21.15.116:0/556690620 >> v1:172.21.15.116:6789/0 conn(0x7fa09412c770 legacy=0x7fa09406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.476+0000 7fa09259c640 1 -- 172.21.15.116:0/556690620 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa094070f50 con 0x7fa09412be50 2024-09-14T10:58:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.477+0000 7fa09259c640 1 --2- 172.21.15.116:0/556690620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa09412c230 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa084009720 tx=0x7fa08402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490113c2276d4d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.477+0000 7fa091d9b640 1 -- 172.21.15.116:0/556690620 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084037070 con 0x7fa09412be50 2024-09-14T10:58:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.477+0000 7fa091d9b640 1 -- 172.21.15.116:0/556690620 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08402ad90 con 0x7fa09412be50 2024-09-14T10:58:23.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.477+0000 7fa091d9b640 1 -- 172.21.15.116:0/556690620 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084032590 con 0x7fa09412be50 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 -- 172.21.15.116:0/556690620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 msgr2=0x7fa09412c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 --2- 172.21.15.116:0/556690620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa09412c230 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa084009720 tx=0x7fa08402a110 comp rx=0 tx=0).stop 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 -- 172.21.15.116:0/556690620 shutdown_connections 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 --2- 172.21.15.116:0/556690620 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa09412c230 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 -- 172.21.15.116:0/556690620 >> 172.21.15.116:0/556690620 conn(0x7fa09409abc0 msgr2=0x7fa094098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 -- 172.21.15.116:0/556690620 shutdown_connections 2024-09-14T10:58:23.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.478+0000 7fa098c39640 1 -- 172.21.15.116:0/556690620 wait complete. 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa098c39640 1 Processor -- start 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa098c39640 1 -- start start 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa098c39640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa098c39640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fa094099f40 con 0x7fa09412be50 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa09259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa09259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43634/0 (socket says 172.21.15.116:43634) 2024-09-14T10:58:23.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa09259c640 1 -- 172.21.15.116:0/3146457871 learned_addr learned my addr 172.21.15.116:0/3146457871 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.479+0000 7fa09259c640 1 -- 172.21.15.116:0/3146457871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa094127080 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa09259c640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa084009840 tx=0x7fa0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084041020 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08403d550 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0941c1130 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa084037040 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.480+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa094128200 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.481+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fa084044020 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.481+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09412c230 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.481+0000 7fa08affd640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 0x7fa074040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.481+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fa084073ce0 con 0x7fa09412be50 2024-09-14T10:58:23.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.481+0000 7fa08bfff640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 0x7fa074040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.482+0000 7fa08bfff640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 0x7fa074040a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007fd0 tx=0x7fa07c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.485+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fa08404b030 con 0x7fa09412be50 2024-09-14T10:58:23.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.659+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa094128a30 con 0x7fa07403e570 2024-09-14T10:58:23.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.660+0000 7fa08affd640 1 -- 172.21.15.116:0/3146457871 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa094128a30 con 0x7fa07403e570 2024-09-14T10:58:23.658 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 msgr2=0x7fa074040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 0x7fa074040a30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa07c007fd0 tx=0x7fa07c007aa0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 msgr2=0x7fa0941c1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fa084009840 tx=0x7fa0840046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 shutdown_connections 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fa07403e570 0x7fa074040a30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 --2- 172.21.15.116:0/3146457871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa09412be50 0x7fa0941c1570 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 >> 172.21.15.116:0/3146457871 conn(0x7fa09409abc0 msgr2=0x7fa094071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 shutdown_connections 2024-09-14T10:58:23.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.662+0000 7fa098c39640 1 -- 172.21.15.116:0/3146457871 wait complete. 2024-09-14T10:58:23.671 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T10:58:23.671 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T10:58:23.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.774+0000 7f06d1182640 1 Processor -- start 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06d1182640 1 -- start start 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06d1182640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06cc06f4f0 0x7f06cc06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06d1182640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc06f0c0 con 0x7f06cc070b40 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06d1182640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f06cc099ba0 con 0x7f06cc06f4f0 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06cad9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06cc06f4f0 0x7f06cc06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06c3fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f06cc070b40 0x7f06cc12bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41436/0 (socket says 172.21.15.116:41436) 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06c3fff640 1 -- 172.21.15.116:0/3345407241 learned_addr learned my addr 172.21.15.116:0/3345407241 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:23.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06cad9d640 1 -- 172.21.15.116:0/3345407241 >> v1:172.21.15.116:6789/0 conn(0x7f06cc070b40 legacy=0x7f06cc12bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06cad9d640 1 -- 172.21.15.116:0/3345407241 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc0712b0 con 0x7f06cc06f4f0 2024-09-14T10:58:23.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.775+0000 7f06ca59c640 1 -- 172.21.15.116:0/3345407241 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239158418 0 0) 0x7f06cc06f0c0 con 0x7f06cc070b40 2024-09-14T10:58:23.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.776+0000 7f06cad9d640 1 --2- 172.21.15.116:0/3345407241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc06f8d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009720 tx=0x7f06bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdccb1d21c2df4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.776+0000 7f06ca59c640 1 -- 172.21.15.116:0/3345407241 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06bc037070 con 0x7f06cc06f4f0 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.776+0000 7f06ca59c640 1 -- 172.21.15.116:0/3345407241 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc02ad90 con 0x7f06cc06f4f0 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.776+0000 7f06ca59c640 1 -- 172.21.15.116:0/3345407241 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06bc032590 con 0x7f06cc06f4f0 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 -- 172.21.15.116:0/3345407241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 msgr2=0x7f06cc06f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 --2- 172.21.15.116:0/3345407241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc06f8d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009720 tx=0x7f06bc02a110 comp rx=0 tx=0).stop 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 -- 172.21.15.116:0/3345407241 shutdown_connections 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 --2- 172.21.15.116:0/3345407241 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc06f8d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 -- 172.21.15.116:0/3345407241 >> 172.21.15.116:0/3345407241 conn(0x7f06cc09a9f0 msgr2=0x7f06cc09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 -- 172.21.15.116:0/3345407241 shutdown_connections 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.777+0000 7f06d1182640 1 -- 172.21.15.116:0/3345407241 wait complete. 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06d1182640 1 Processor -- start 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06d1182640 1 -- start start 2024-09-14T10:58:23.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06d1182640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06d1182640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc0701a0 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06cad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06cad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43654/0 (socket says 172.21.15.116:43654) 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06cad9d640 1 -- 172.21.15.116:0/1451205545 learned_addr learned my addr 172.21.15.116:0/1451205545 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.778+0000 7f06cad9d640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc08d540 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06cad9d640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009720 tx=0x7f06bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06bc0433f0 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06bc043590 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc08e670 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06bc043870 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.779+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc1c17b0 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06cc08e950 con 0x7f06cc06f4f0 2024-09-14T10:58:23.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f06bc04a060 con 0x7f06cc06f4f0 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 0x7f06ac040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f06bc075580 con 0x7f06cc06f4f0 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 0x7f06ac04ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06bc0067f0 con 0x7f06ac04a970 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f06bc07c050 con 0x7f06cc06f4f0 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06c3fff640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 0x7f06ac040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.780+0000 7f06cb59e640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 0x7f06ac04ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.781+0000 7f06cb59e640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 0x7f06ac04ce10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.781+0000 7f06c3fff640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 0x7f06ac040a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f06b4000c00 tx=0x7f06b40078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.782+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== osd.3 v2:172.21.15.164:6816/3361197980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06bc0067f0 con 0x7f06ac04a970 2024-09-14T10:58:23.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.794+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 --> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f06cc08d9e0 con 0x7f06ac04a970 2024-09-14T10:58:23.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.794+0000 7f06c37fe640 1 -- 172.21.15.116:0/1451205545 <== osd.3 v2:172.21.15.164:6816/3361197980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f06cc08d9e0 con 0x7f06ac04a970 2024-09-14T10:58:23.793 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-09-14T10:58:23.793 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T10:58:23.793 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 msgr2=0x7f06ac04ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 0x7f06ac04ce10 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 msgr2=0x7f06ac040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 0x7f06ac040a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f06b4000c00 tx=0x7f06b40078f0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 msgr2=0x7f06cc1c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009720 tx=0x7f06bc0046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 shutdown_connections 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6816/3361197980,v1:172.21.15.164:6817/3361197980] conn(0x7f06ac04a970 0x7f06ac04ce10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f06ac03e570 0x7f06ac040a30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 --2- 172.21.15.116:0/1451205545 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06cc06f4f0 0x7f06cc1c1090 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 >> 172.21.15.116:0/1451205545 conn(0x7f06cc09a9f0 msgr2=0x7f06cc122bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 shutdown_connections 2024-09-14T10:58:23.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.795+0000 7f06d1182640 1 -- 172.21.15.116:0/1451205545 wait complete. 2024-09-14T10:58:23.803 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.903+0000 7f14b56b1640 1 Processor -- start 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.903+0000 7f14b56b1640 1 -- start start 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.903+0000 7f14b56b1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f14b006dfb0 0x7f14b006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.903+0000 7f14b56b1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b0071660 con 0x7f14b006e8d0 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.903+0000 7f14b56b1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f14b0072550 con 0x7f14b006dfb0 2024-09-14T10:58:23.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14aeffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f14b006dfb0 0x7f14b006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14a7fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f14b006e8d0 0x7f14b0097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41448/0 (socket says 172.21.15.116:41448) 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14aeffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f14b006dfb0 0x7f14b006e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43668/0 (socket says 172.21.15.116:43668) 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14a7fff640 1 -- 172.21.15.116:0/526148866 learned_addr learned my addr 172.21.15.116:0/526148866 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14aeffd640 1 -- 172.21.15.116:0/526148866 >> v1:172.21.15.116:6789/0 conn(0x7f14b006e8d0 legacy=0x7f14b0097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14ae7fc640 1 -- 172.21.15.116:0/526148866 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2663587533 0 0) 0x7f14b0071660 con 0x7f14b006e8d0 2024-09-14T10:58:23.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.904+0000 7f14aeffd640 1 -- 172.21.15.116:0/526148866 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b0099e20 con 0x7f14b006dfb0 2024-09-14T10:58:23.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14aeffd640 1 --2- 172.21.15.116:0/526148866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b006e390 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009720 tx=0x7f14a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6fdb7a01a58e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14ae7fc640 1 -- 172.21.15.116:0/526148866 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0037070 con 0x7f14b006dfb0 2024-09-14T10:58:23.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14ae7fc640 1 -- 172.21.15.116:0/526148866 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a002ae20 con 0x7f14b006dfb0 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14ae7fc640 1 -- 172.21.15.116:0/526148866 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0032590 con 0x7f14b006dfb0 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 -- 172.21.15.116:0/526148866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 msgr2=0x7f14b006e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 --2- 172.21.15.116:0/526148866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b006e390 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009720 tx=0x7f14a002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 -- 172.21.15.116:0/526148866 shutdown_connections 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 --2- 172.21.15.116:0/526148866 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b006e390 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 -- 172.21.15.116:0/526148866 >> 172.21.15.116:0/526148866 conn(0x7f14b009abc0 msgr2=0x7f14b0098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 -- 172.21.15.116:0/526148866 shutdown_connections 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.905+0000 7f14b56b1640 1 -- 172.21.15.116:0/526148866 wait complete. 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.906+0000 7f14b56b1640 1 Processor -- start 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.906+0000 7f14b56b1640 1 -- start start 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14b56b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14b56b1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f14b006ece0 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14aeffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14aeffd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43682/0 (socket says 172.21.15.116:43682) 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14aeffd640 1 -- 172.21.15.116:0/1419220502 learned_addr learned my addr 172.21.15.116:0/1419220502 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14aeffd640 1 -- 172.21.15.116:0/1419220502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b008cc40 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14aeffd640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f14a002a1e0 tx=0x7f14a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0042070 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a003e590 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b008c640 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14a0037040 con 0x7f14b006dfb0 2024-09-14T10:58:23.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.907+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b0096b30 con 0x7f14b006dfb0 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.908+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f14a0045070 con 0x7f14b006dfb0 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.908+0000 7f14a77fe640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 0x7f1490040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.908+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b008bfe0 con 0x7f14b006dfb0 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.908+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f14a0073e30 con 0x7f14b006dfb0 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.909+0000 7f14a7fff640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 0x7f1490040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:23.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.909+0000 7f14a7fff640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 0x7f1490040a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c00 tx=0x7f14980078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:23.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:23.913+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f14a0077030 con 0x7f14b006dfb0 2024-09-14T10:58:24.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.090+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f14b0074110 con 0x7f149003e570 2024-09-14T10:58:24.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.091+0000 7f14a77fe640 1 -- 172.21.15.116:0/1419220502 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f14980058d0 con 0x7f149003e570 2024-09-14T10:58:24.089 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 msgr2=0x7f1490040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 0x7f1490040a30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1498000c00 tx=0x7f14980078f0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 msgr2=0x7f14b0129280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f14a002a1e0 tx=0x7f14a00046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 shutdown_connections 2024-09-14T10:58:24.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f149003e570 0x7f1490040a30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 --2- 172.21.15.116:0/1419220502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14b006dfb0 0x7f14b0129280 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 >> 172.21.15.116:0/1419220502 conn(0x7f14b009abc0 msgr2=0x7f14b012d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:24.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 shutdown_connections 2024-09-14T10:58:24.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.093+0000 7f14b56b1640 1 -- 172.21.15.116:0/1419220502 wait complete. 2024-09-14T10:58:24.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.200+0000 7f7fcdd9b640 1 Processor -- start 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.200+0000 7f7fcdd9b640 1 -- start start 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fcdd9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7fc806eaa0 0x7f7fc81326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fcdd9b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc8071660 con 0x7f7fc806dfb0 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fcdd9b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc8072550 con 0x7f7fc806eaa0 2024-09-14T10:58:24.199 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fbeffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7fc806eaa0 0x7f7fc81326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:24.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fc77fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7fc806dfb0 0x7f7fc806e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:41460/0 (socket says 172.21.15.116:41460) 2024-09-14T10:58:24.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fc77fe640 1 -- 172.21.15.116:0/2351015935 learned_addr learned my addr 172.21.15.116:0/2351015935 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:24.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fbeffd640 1 -- 172.21.15.116:0/2351015935 >> v1:172.21.15.116:6789/0 conn(0x7f7fc806dfb0 legacy=0x7f7fc806e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fbeffd640 1 -- 172.21.15.116:0/2351015935 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8099e20 con 0x7f7fc806eaa0 2024-09-14T10:58:24.200 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.201+0000 7f7fc6ffd640 1 -- 172.21.15.116:0/2351015935 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949744927 0 0) 0x7f7fc8071660 con 0x7f7fc806dfb0 2024-09-14T10:58:24.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.202+0000 7f7fbeffd640 1 --2- 172.21.15.116:0/2351015935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806eaa0 0x7f7fc81326d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009720 tx=0x7f7fb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ee886470bf9632 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:24.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.202+0000 7f7fc6ffd640 1 -- 172.21.15.116:0/2351015935 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0037070 con 0x7f7fc806eaa0 2024-09-14T10:58:24.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.202+0000 7f7fc6ffd640 1 -- 172.21.15.116:0/2351015935 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb002ae20 con 0x7f7fc806eaa0 2024-09-14T10:58:24.201 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.202+0000 7f7fc6ffd640 1 -- 172.21.15.116:0/2351015935 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0032590 con 0x7f7fc806eaa0 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/2351015935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806eaa0 msgr2=0x7f7fc81326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/2351015935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806eaa0 0x7f7fc81326d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009720 tx=0x7f7fb002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/2351015935 shutdown_connections 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/2351015935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806eaa0 0x7f7fc81326d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/2351015935 >> 172.21.15.116:0/2351015935 conn(0x7f7fc809abc0 msgr2=0x7f7fc8098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/2351015935 shutdown_connections 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/2351015935 wait complete. 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.203+0000 7f7fcdd9b640 1 Processor -- start 2024-09-14T10:58:24.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fcdd9b640 1 -- start start 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fcdd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fcdd9b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80712d0 con 0x7f7fc806dfb0 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fc77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fc77fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43700/0 (socket says 172.21.15.116:43700) 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fc77fe640 1 -- 172.21.15.116:0/1540287935 learned_addr learned my addr 172.21.15.116:0/1540287935 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.204+0000 7f7fc77fe640 1 -- 172.21.15.116:0/1540287935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8071000 con 0x7f7fc806dfb0 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fc77fe640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3d0 tx=0x7f7fb800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80074d0 con 0x7f7fc806dfb0 2024-09-14T10:58:24.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb80047e0 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8007670 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc808c190 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.205+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc812a110 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.206+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f7fb8011070 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.206+0000 7f7fc4ff9640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 0x7f7fa8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.206+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc806e390 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.206+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f7fb8053220 con 0x7f7fc806dfb0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.206+0000 7f7fbeffd640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 0x7f7fa8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:24.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.207+0000 7f7fbeffd640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 0x7f7fa8040a30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034000 tx=0x7f7fb002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:24.208 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.210+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f7fc808c190 con 0x7f7fc806dfb0 2024-09-14T10:58:24.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.382+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fc812a690 con 0x7f7fa803e570 2024-09-14T10:58:24.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.392+0000 7f7fc4ff9640 1 -- 172.21.15.116:0/1540287935 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665669 (secure 0 0 0) 0x7f7fc812a690 con 0x7f7fa803e570 2024-09-14T10:58:24.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:24.403 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:58:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 msgr2=0x7f7fa8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 0x7f7fa8040a30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0034000 tx=0x7f7fb002e000 comp rx=0 tx=0).stop 2024-09-14T10:58:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 msgr2=0x7f7fc81c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c3d0 tx=0x7f7fb800c890 comp rx=0 tx=0).stop 2024-09-14T10:58:24.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 shutdown_connections 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f7fa803e570 0x7f7fa8040a30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 --2- 172.21.15.116:0/1540287935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7fc806dfb0 0x7f7fc81c3d60 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 >> 172.21.15.116:0/1540287935 conn(0x7f7fc809abc0 msgr2=0x7f7fc812e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 shutdown_connections 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:24.397+0000 7f7fcdd9b640 1 -- 172.21.15.116:0/1540287935 wait complete. 2024-09-14T10:58:24.408 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-14T10:58:24.121208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4564,"ondisk_log_size":4564,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160840,"kb_used_data":15300,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377326520,"statfs":{"total":386547056640,"available":386382356480,"internally_reserved":0,"allocated":15667200,"data_stored":14404402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":690,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751151+0000","last_change":"2024-09-14T10:55:04.693957+0000","last_active":"2024-09-14T10:55:41.751151+0000","last_peered":"2024-09-14T10:55:41.751151+0000","last_clean":"2024-09-14T10:55:41.751151+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:55:41.751151+0000","last_undegraded":"2024-09-14T10:55:41.751151+0000","last_fullsized":"2024-09-14T10:55:41.751151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:06.408068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099828+0000","last_change":"2024-09-14T10:55:06.701780+0000","last_active":"2024-09-14T10:57:37.099828+0000","last_peered":"2024-09-14T10:57:37.099828+0000","last_clean":"2024-09-14T10:57:37.099828+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:57:37.099828+0000","last_undegraded":"2024-09-14T10:57:37.099828+0000","last_fullsized":"2024-09-14T10:57:37.099828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:25.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747843+0000","last_change":"2024-09-14T10:55:04.693160+0000","last_active":"2024-09-14T10:55:41.747843+0000","last_peered":"2024-09-14T10:55:41.747843+0000","last_clean":"2024-09-14T10:55:41.747843+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:55:41.747843+0000","last_undegraded":"2024-09-14T10:55:41.747843+0000","last_fullsized":"2024-09-14T10:55:41.747843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:56.695969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.044322+0000","last_change":"2024-09-14T10:55:41.755184+0000","last_active":"2024-09-14T10:55:47.044322+0000","last_peered":"2024-09-14T10:55:47.044322+0000","last_clean":"2024-09-14T10:55:47.044322+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:55:47.044322+0000","last_undegraded":"2024-09-14T10:55:47.044322+0000","last_fullsized":"2024-09-14T10:55:47.044322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:40.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.486444+0000","last_change":"2024-09-14T10:55:04.710321+0000","last_active":"2024-09-14T10:57:12.486444+0000","last_peered":"2024-09-14T10:57:12.486444+0000","last_clean":"2024-09-14T10:57:12.486444+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:57:12.486444+0000","last_undegraded":"2024-09-14T10:57:12.486444+0000","last_fullsized":"2024-09-14T10:57:12.486444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:23.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.536080+0000","last_change":"2024-09-14T10:55:04.691950+0000","last_active":"2024-09-14T10:57:12.536080+0000","last_peered":"2024-09-14T10:57:12.536080+0000","last_clean":"2024-09-14T10:57:12.536080+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:57:12.536080+0000","last_undegraded":"2024-09-14T10:57:12.536080+0000","last_fullsized":"2024-09-14T10:57:12.536080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065448+0000","last_change":"2024-09-14T10:55:41.752605+0000","last_active":"2024-09-14T10:58:13.065448+0000","last_peered":"2024-09-14T10:58:13.065448+0000","last_clean":"2024-09-14T10:58:13.065448+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:13.065448+0000","last_undegraded":"2024-09-14T10:58:13.065448+0000","last_fullsized":"2024-09-14T10:58:13.065448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.626179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.952023+0000","last_change":"2024-09-14T10:55:04.693896+0000","last_active":"2024-09-14T10:58:12.952023+0000","last_peered":"2024-09-14T10:58:12.952023+0000","last_clean":"2024-09-14T10:58:12.952023+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:12.952023+0000","last_undegraded":"2024-09-14T10:58:12.952023+0000","last_fullsized":"2024-09-14T10:58:12.952023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:25.363300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282107+0000","last_change":"2024-09-14T10:55:06.694032+0000","last_active":"2024-09-14T10:58:13.282107+0000","last_peered":"2024-09-14T10:58:13.282107+0000","last_clean":"2024-09-14T10:58:13.282107+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:13.282107+0000","last_undegraded":"2024-09-14T10:58:13.282107+0000","last_fullsized":"2024-09-14T10:58:13.282107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:52.564428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747657+0000","last_change":"2024-09-14T10:55:04.691521+0000","last_active":"2024-09-14T10:55:41.747657+0000","last_peered":"2024-09-14T10:55:41.747657+0000","last_clean":"2024-09-14T10:55:41.747657+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:55:41.747657+0000","last_undegraded":"2024-09-14T10:55:41.747657+0000","last_fullsized":"2024-09-14T10:55:41.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:36.146379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194738+0000","last_change":"2024-09-14T10:55:04.699709+0000","last_active":"2024-09-14T10:58:13.194738+0000","last_peered":"2024-09-14T10:58:13.194738+0000","last_clean":"2024-09-14T10:58:13.194738+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:13.194738+0000","last_undegraded":"2024-09-14T10:58:13.194738+0000","last_fullsized":"2024-09-14T10:58:13.194738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:53.785449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751899+0000","last_change":"2024-09-14T10:55:06.698420+0000","last_active":"2024-09-14T10:55:41.751899+0000","last_peered":"2024-09-14T10:55:41.751899+0000","last_clean":"2024-09-14T10:55:41.751899+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:55:41.751899+0000","last_undegraded":"2024-09-14T10:55:41.751899+0000","last_fullsized":"2024-09-14T10:55:41.751899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:37.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745255+0000","last_change":"2024-09-14T10:55:04.692677+0000","last_active":"2024-09-14T10:55:41.745255+0000","last_peered":"2024-09-14T10:55:41.745255+0000","last_clean":"2024-09-14T10:55:41.745255+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:55:41.745255+0000","last_undegraded":"2024-09-14T10:55:41.745255+0000","last_fullsized":"2024-09-14T10:55:41.745255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:19.955381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071556+0000","last_change":"2024-09-14T10:55:06.695226+0000","last_active":"2024-09-14T10:56:29.071556+0000","last_peered":"2024-09-14T10:56:29.071556+0000","last_clean":"2024-09-14T10:56:29.071556+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:56:29.071556+0000","last_undegraded":"2024-09-14T10:56:29.071556+0000","last_fullsized":"2024-09-14T10:56:29.071556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:25.288530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194305+0000","last_change":"2024-09-14T10:55:04.710323+0000","last_active":"2024-09-14T10:58:13.194305+0000","last_peered":"2024-09-14T10:58:13.194305+0000","last_clean":"2024-09-14T10:58:13.194305+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:13.194305+0000","last_undegraded":"2024-09-14T10:58:13.194305+0000","last_fullsized":"2024-09-14T10:58:13.194305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:30.799795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.281969+0000","last_change":"2024-09-14T10:55:06.699438+0000","last_active":"2024-09-14T10:58:13.281969+0000","last_peered":"2024-09-14T10:58:13.281969+0000","last_clean":"2024-09-14T10:58:13.281969+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:13.281969+0000","last_undegraded":"2024-09-14T10:58:13.281969+0000","last_fullsized":"2024-09-14T10:58:13.281969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.481249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751744+0000","last_change":"2024-09-14T10:55:04.699550+0000","last_active":"2024-09-14T10:55:41.751744+0000","last_peered":"2024-09-14T10:55:41.751744+0000","last_clean":"2024-09-14T10:55:41.751744+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:55:41.751744+0000","last_undegraded":"2024-09-14T10:55:41.751744+0000","last_fullsized":"2024-09-14T10:55:41.751744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:02.897364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584049+0000","last_change":"2024-09-14T10:55:06.699540+0000","last_active":"2024-09-14T10:57:12.584049+0000","last_peered":"2024-09-14T10:57:12.584049+0000","last_clean":"2024-09-14T10:57:12.584049+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:57:12.584049+0000","last_undegraded":"2024-09-14T10:57:12.584049+0000","last_fullsized":"2024-09-14T10:57:12.584049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:32.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.410027+0000","last_change":"2024-09-14T10:55:04.710493+0000","last_active":"2024-09-14T10:55:45.410027+0000","last_peered":"2024-09-14T10:55:45.410027+0000","last_clean":"2024-09-14T10:55:45.410027+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:55:45.410027+0000","last_undegraded":"2024-09-14T10:55:45.410027+0000","last_fullsized":"2024-09-14T10:55:45.410027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:11.097667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254829+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:58:13.254829+0000","last_peered":"2024-09-14T10:58:13.254829+0000","last_clean":"2024-09-14T10:58:13.254829+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:13.254829+0000","last_undegraded":"2024-09-14T10:58:13.254829+0000","last_fullsized":"2024-09-14T10:58:13.254829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745936+0000","last_change":"2024-09-14T10:55:04.697066+0000","last_active":"2024-09-14T10:55:41.745936+0000","last_peered":"2024-09-14T10:55:41.745936+0000","last_clean":"2024-09-14T10:55:41.745936+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:55:41.745936+0000","last_undegraded":"2024-09-14T10:55:41.745936+0000","last_fullsized":"2024-09-14T10:55:41.745936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:54.003676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747047+0000","last_change":"2024-09-14T10:55:06.695487+0000","last_active":"2024-09-14T10:55:41.747047+0000","last_peered":"2024-09-14T10:55:41.747047+0000","last_clean":"2024-09-14T10:55:41.747047+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:55:41.747047+0000","last_undegraded":"2024-09-14T10:55:41.747047+0000","last_fullsized":"2024-09-14T10:55:41.747047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:37.971520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746476+0000","last_change":"2024-09-14T10:55:04.708722+0000","last_active":"2024-09-14T10:55:41.746476+0000","last_peered":"2024-09-14T10:55:41.746476+0000","last_clean":"2024-09-14T10:55:41.746476+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:55:41.746476+0000","last_undegraded":"2024-09-14T10:55:41.746476+0000","last_fullsized":"2024-09-14T10:55:41.746476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:12.437345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071829+0000","last_change":"2024-09-14T10:55:06.697009+0000","last_active":"2024-09-14T10:56:29.071829+0000","last_peered":"2024-09-14T10:56:29.071829+0000","last_clean":"2024-09-14T10:56:29.071829+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:56:29.071829+0000","last_undegraded":"2024-09-14T10:56:29.071829+0000","last_fullsized":"2024-09-14T10:56:29.071829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.649839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.200303+0000","last_change":"2024-09-14T10:55:04.701290+0000","last_active":"2024-09-14T10:58:13.200303+0000","last_peered":"2024-09-14T10:58:13.200303+0000","last_clean":"2024-09-14T10:58:13.200303+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:13.200303+0000","last_undegraded":"2024-09-14T10:58:13.200303+0000","last_fullsized":"2024-09-14T10:58:13.200303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.929907+0000","last_change":"2024-09-14T10:55:06.689207+0000","last_active":"2024-09-14T10:55:45.929907+0000","last_peered":"2024-09-14T10:55:45.929907+0000","last_clean":"2024-09-14T10:55:45.929907+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:55:45.929907+0000","last_undegraded":"2024-09-14T10:55:45.929907+0000","last_fullsized":"2024-09-14T10:55:45.929907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:51.007328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742523+0000","last_change":"2024-09-14T10:55:04.707857+0000","last_active":"2024-09-14T10:55:41.742523+0000","last_peered":"2024-09-14T10:55:41.742523+0000","last_clean":"2024-09-14T10:55:41.742523+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:55:41.742523+0000","last_undegraded":"2024-09-14T10:55:41.742523+0000","last_fullsized":"2024-09-14T10:55:41.742523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:27.756536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.938635+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:58:19.938635+0000","last_peered":"2024-09-14T10:58:19.938635+0000","last_clean":"2024-09-14T10:58:19.938635+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:58:19.938635+0000","last_undegraded":"2024-09-14T10:58:19.938635+0000","last_fullsized":"2024-09-14T10:58:19.938635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'17","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.982652+0000","last_change":"2024-09-14T10:55:06.692424+0000","last_active":"2024-09-14T10:58:12.982652+0000","last_peered":"2024-09-14T10:58:12.982652+0000","last_clean":"2024-09-14T10:58:12.982652+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:58:12.982652+0000","last_undegraded":"2024-09-14T10:58:12.982652+0000","last_fullsized":"2024-09-14T10:58:12.982652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:34.169033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745404+0000","last_change":"2024-09-14T10:55:04.702312+0000","last_active":"2024-09-14T10:55:41.745404+0000","last_peered":"2024-09-14T10:55:41.745404+0000","last_clean":"2024-09-14T10:55:41.745404+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:55:41.745404+0000","last_undegraded":"2024-09-14T10:55:41.745404+0000","last_fullsized":"2024-09-14T10:55:41.745404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:33.119288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746096+0000","last_change":"2024-09-14T10:55:08.697901+0000","last_active":"2024-09-14T10:55:41.746096+0000","last_peered":"2024-09-14T10:55:41.746096+0000","last_clean":"2024-09-14T10:55:41.746096+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:55:41.746096+0000","last_undegraded":"2024-09-14T10:55:41.746096+0000","last_fullsized":"2024-09-14T10:55:41.746096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:51.107343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.521522+0000","last_change":"2024-09-14T10:55:04.705534+0000","last_active":"2024-09-14T10:55:46.521522+0000","last_peered":"2024-09-14T10:55:46.521522+0000","last_clean":"2024-09-14T10:55:46.521522+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:55:46.521522+0000","last_undegraded":"2024-09-14T10:55:46.521522+0000","last_fullsized":"2024-09-14T10:55:46.521522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:26.471935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747967+0000","last_change":"2024-09-14T10:55:08.703383+0000","last_active":"2024-09-14T10:55:41.747967+0000","last_peered":"2024-09-14T10:55:41.747967+0000","last_clean":"2024-09-14T10:55:41.747967+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:55:41.747967+0000","last_undegraded":"2024-09-14T10:55:41.747967+0000","last_fullsized":"2024-09-14T10:55:41.747967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:03.440350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":407,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.816667+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:19.816667+0000","last_peered":"2024-09-14T10:58:19.816667+0000","last_clean":"2024-09-14T10:58:19.816667+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:19.816667+0000","last_undegraded":"2024-09-14T10:58:19.816667+0000","last_fullsized":"2024-09-14T10:58:19.816667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270140+0000","last_change":"2024-09-14T10:55:06.697810+0000","last_active":"2024-09-14T10:55:46.270140+0000","last_peered":"2024-09-14T10:55:46.270140+0000","last_clean":"2024-09-14T10:55:46.270140+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:55:46.270140+0000","last_undegraded":"2024-09-14T10:55:46.270140+0000","last_fullsized":"2024-09-14T10:55:46.270140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:09.071738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.562476+0000","last_change":"2024-09-14T10:55:04.697949+0000","last_active":"2024-09-14T10:57:12.562476+0000","last_peered":"2024-09-14T10:57:12.562476+0000","last_clean":"2024-09-14T10:57:12.562476+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:57:12.562476+0000","last_undegraded":"2024-09-14T10:57:12.562476+0000","last_fullsized":"2024-09-14T10:57:12.562476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:06.191131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.922943+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:58:19.922943+0000","last_peered":"2024-09-14T10:58:19.922943+0000","last_clean":"2024-09-14T10:58:19.922943+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:58:19.922943+0000","last_undegraded":"2024-09-14T10:58:19.922943+0000","last_fullsized":"2024-09-14T10:58:19.922943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071993+0000","last_change":"2024-09-14T10:55:06.700108+0000","last_active":"2024-09-14T10:58:13.071993+0000","last_peered":"2024-09-14T10:58:13.071993+0000","last_clean":"2024-09-14T10:58:13.071993+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:13.071993+0000","last_undegraded":"2024-09-14T10:58:13.071993+0000","last_fullsized":"2024-09-14T10:58:13.071993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:18.353830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751377+0000","last_change":"2024-09-14T10:55:04.703179+0000","last_active":"2024-09-14T10:55:41.751377+0000","last_peered":"2024-09-14T10:55:41.751377+0000","last_clean":"2024-09-14T10:55:41.751377+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:55:41.751377+0000","last_undegraded":"2024-09-14T10:55:41.751377+0000","last_fullsized":"2024-09-14T10:55:41.751377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:43.756195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743711+0000","last_change":"2024-09-14T10:55:08.703801+0000","last_active":"2024-09-14T10:55:41.743711+0000","last_peered":"2024-09-14T10:55:41.743711+0000","last_clean":"2024-09-14T10:55:41.743711+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:55:41.743711+0000","last_undegraded":"2024-09-14T10:55:41.743711+0000","last_fullsized":"2024-09-14T10:55:41.743711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:30.805117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'43","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.951036+0000","last_change":"2024-09-14T10:55:10.711150+0000","last_active":"2024-09-14T10:58:19.951036+0000","last_peered":"2024-09-14T10:58:19.951036+0000","last_clean":"2024-09-14T10:58:19.951036+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:19.951036+0000","last_undegraded":"2024-09-14T10:58:19.951036+0000","last_fullsized":"2024-09-14T10:58:19.951036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.611145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071856+0000","last_change":"2024-09-14T10:55:06.693096+0000","last_active":"2024-09-14T10:56:29.071856+0000","last_peered":"2024-09-14T10:56:29.071856+0000","last_clean":"2024-09-14T10:56:29.071856+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:56:29.071856+0000","last_undegraded":"2024-09-14T10:56:29.071856+0000","last_fullsized":"2024-09-14T10:56:29.071856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:46.491292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750779+0000","last_change":"2024-09-14T10:55:04.703485+0000","last_active":"2024-09-14T10:55:41.750779+0000","last_peered":"2024-09-14T10:55:41.750779+0000","last_clean":"2024-09-14T10:55:41.750779+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:55:41.750779+0000","last_undegraded":"2024-09-14T10:55:41.750779+0000","last_fullsized":"2024-09-14T10:55:41.750779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:22.991367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745415+0000","last_change":"2024-09-14T10:55:08.703463+0000","last_active":"2024-09-14T10:55:41.745415+0000","last_peered":"2024-09-14T10:55:41.745415+0000","last_clean":"2024-09-14T10:55:41.745415+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:55:41.745415+0000","last_undegraded":"2024-09-14T10:55:41.745415+0000","last_fullsized":"2024-09-14T10:55:41.745415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.948464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.877437+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:58:19.877437+0000","last_peered":"2024-09-14T10:58:19.877437+0000","last_clean":"2024-09-14T10:58:19.877437+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:58:19.877437+0000","last_undegraded":"2024-09-14T10:58:19.877437+0000","last_fullsized":"2024-09-14T10:58:19.877437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254953+0000","last_change":"2024-09-14T10:55:06.695110+0000","last_active":"2024-09-14T10:58:13.254953+0000","last_peered":"2024-09-14T10:58:13.254953+0000","last_clean":"2024-09-14T10:58:13.254953+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:13.254953+0000","last_undegraded":"2024-09-14T10:58:13.254953+0000","last_fullsized":"2024-09-14T10:58:13.254953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:34.398479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744632+0000","last_change":"2024-09-14T10:55:04.702159+0000","last_active":"2024-09-14T10:55:41.744632+0000","last_peered":"2024-09-14T10:55:41.744632+0000","last_clean":"2024-09-14T10:55:41.744632+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:55:41.744632+0000","last_undegraded":"2024-09-14T10:55:41.744632+0000","last_fullsized":"2024-09-14T10:55:41.744632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:32.478928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747579+0000","last_change":"2024-09-14T10:55:08.700971+0000","last_active":"2024-09-14T10:55:41.747579+0000","last_peered":"2024-09-14T10:55:41.747579+0000","last_clean":"2024-09-14T10:55:41.747579+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:55:41.747579+0000","last_undegraded":"2024-09-14T10:55:41.747579+0000","last_fullsized":"2024-09-14T10:55:41.747579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:53.973360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.956566+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:58:19.956566+0000","last_peered":"2024-09-14T10:58:19.956566+0000","last_clean":"2024-09-14T10:58:19.956566+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:58:19.956566+0000","last_undegraded":"2024-09-14T10:58:19.956566+0000","last_fullsized":"2024-09-14T10:58:19.956566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.883679+0000","last_change":"2024-09-14T10:55:06.687352+0000","last_active":"2024-09-14T10:56:28.883679+0000","last_peered":"2024-09-14T10:56:28.883679+0000","last_clean":"2024-09-14T10:56:28.883679+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:56:28.883679+0000","last_undegraded":"2024-09-14T10:56:28.883679+0000","last_fullsized":"2024-09-14T10:56:28.883679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:57.287920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.409908+0000","last_change":"2024-09-14T10:55:04.711138+0000","last_active":"2024-09-14T10:55:45.409908+0000","last_peered":"2024-09-14T10:55:45.409908+0000","last_clean":"2024-09-14T10:55:45.409908+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:55:45.409908+0000","last_undegraded":"2024-09-14T10:55:45.409908+0000","last_fullsized":"2024-09-14T10:55:45.409908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:30.041844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:42.082259+0000","last_change":"2024-09-14T10:55:41.752599+0000","last_active":"2024-09-14T10:55:42.082259+0000","last_peered":"2024-09-14T10:55:42.082259+0000","last_clean":"2024-09-14T10:55:42.082259+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:55:42.082259+0000","last_undegraded":"2024-09-14T10:55:42.082259+0000","last_fullsized":"2024-09-14T10:55:42.082259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.961897+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:58:19.961897+0000","last_peered":"2024-09-14T10:58:19.961897+0000","last_clean":"2024-09-14T10:58:19.961897+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:58:19.961897+0000","last_undegraded":"2024-09-14T10:58:19.961897+0000","last_fullsized":"2024-09-14T10:58:19.961897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744942+0000","last_change":"2024-09-14T10:55:06.703711+0000","last_active":"2024-09-14T10:55:41.744942+0000","last_peered":"2024-09-14T10:55:41.744942+0000","last_clean":"2024-09-14T10:55:41.744942+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:55:41.744942+0000","last_undegraded":"2024-09-14T10:55:41.744942+0000","last_fullsized":"2024-09-14T10:55:41.744942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:13.371367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746090+0000","last_change":"2024-09-14T10:55:04.691040+0000","last_active":"2024-09-14T10:55:41.746090+0000","last_peered":"2024-09-14T10:55:41.746090+0000","last_clean":"2024-09-14T10:55:41.746090+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:55:41.746090+0000","last_undegraded":"2024-09-14T10:55:41.746090+0000","last_fullsized":"2024-09-14T10:55:41.746090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:07.645325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747621+0000","last_change":"2024-09-14T10:55:08.699358+0000","last_active":"2024-09-14T10:55:41.747621+0000","last_peered":"2024-09-14T10:55:41.747621+0000","last_clean":"2024-09-14T10:55:41.747621+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:55:41.747621+0000","last_undegraded":"2024-09-14T10:55:41.747621+0000","last_fullsized":"2024-09-14T10:55:41.747621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.902372+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:19.902372+0000","last_peered":"2024-09-14T10:58:19.902372+0000","last_clean":"2024-09-14T10:58:19.902372+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:19.902372+0000","last_undegraded":"2024-09-14T10:58:19.902372+0000","last_fullsized":"2024-09-14T10:58:19.902372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270233+0000","last_change":"2024-09-14T10:55:06.701991+0000","last_active":"2024-09-14T10:55:46.270233+0000","last_peered":"2024-09-14T10:55:46.270233+0000","last_clean":"2024-09-14T10:55:46.270233+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:55:46.270233+0000","last_undegraded":"2024-09-14T10:55:46.270233+0000","last_fullsized":"2024-09-14T10:55:46.270233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:45.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743476+0000","last_change":"2024-09-14T10:55:04.700925+0000","last_active":"2024-09-14T10:55:41.743476+0000","last_peered":"2024-09-14T10:55:41.743476+0000","last_clean":"2024-09-14T10:55:41.743476+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:55:41.743476+0000","last_undegraded":"2024-09-14T10:55:41.743476+0000","last_fullsized":"2024-09-14T10:55:41.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:49.933927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746151+0000","last_change":"2024-09-14T10:55:08.703241+0000","last_active":"2024-09-14T10:55:41.746151+0000","last_peered":"2024-09-14T10:55:41.746151+0000","last_clean":"2024-09-14T10:55:41.746151+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:55:41.746151+0000","last_undegraded":"2024-09-14T10:55:41.746151+0000","last_fullsized":"2024-09-14T10:55:41.746151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.686570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'42","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.868210+0000","last_change":"2024-09-14T10:55:10.703424+0000","last_active":"2024-09-14T10:58:19.868210+0000","last_peered":"2024-09-14T10:58:19.868210+0000","last_clean":"2024-09-14T10:58:19.868210+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:58:19.868210+0000","last_undegraded":"2024-09-14T10:58:19.868210+0000","last_fullsized":"2024-09-14T10:58:19.868210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:42.700099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":406,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.817738+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:19.817738+0000","last_peered":"2024-09-14T10:58:19.817738+0000","last_clean":"2024-09-14T10:58:19.817738+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:19.817738+0000","last_undegraded":"2024-09-14T10:58:19.817738+0000","last_fullsized":"2024-09-14T10:58:19.817738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065459+0000","last_change":"2024-09-14T10:55:06.695542+0000","last_active":"2024-09-14T10:58:13.065459+0000","last_peered":"2024-09-14T10:58:13.065459+0000","last_clean":"2024-09-14T10:58:13.065459+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:13.065459+0000","last_undegraded":"2024-09-14T10:58:13.065459+0000","last_fullsized":"2024-09-14T10:58:13.065459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:21.739856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742547+0000","last_change":"2024-09-14T10:55:04.707433+0000","last_active":"2024-09-14T10:55:41.742547+0000","last_peered":"2024-09-14T10:55:41.742547+0000","last_clean":"2024-09-14T10:55:41.742547+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:55:41.742547+0000","last_undegraded":"2024-09-14T10:55:41.742547+0000","last_fullsized":"2024-09-14T10:55:41.742547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:25.332597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.798574+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:58:19.798574+0000","last_peered":"2024-09-14T10:58:19.798574+0000","last_clean":"2024-09-14T10:58:19.798574+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:58:19.798574+0000","last_undegraded":"2024-09-14T10:58:19.798574+0000","last_fullsized":"2024-09-14T10:58:19.798574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":462,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.819049+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:19.819049+0000","last_peered":"2024-09-14T10:58:19.819049+0000","last_clean":"2024-09-14T10:58:19.819049+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:19.819049+0000","last_undegraded":"2024-09-14T10:58:19.819049+0000","last_fullsized":"2024-09-14T10:58:19.819049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:22.097476+0000","last_change":"2024-09-14T10:55:06.706335+0000","last_active":"2024-09-14T10:57:22.097476+0000","last_peered":"2024-09-14T10:57:22.097476+0000","last_clean":"2024-09-14T10:57:22.097476+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:57:22.097476+0000","last_undegraded":"2024-09-14T10:57:22.097476+0000","last_fullsized":"2024-09-14T10:57:22.097476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.143962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.411031+0000","last_change":"2024-09-14T10:55:04.710463+0000","last_active":"2024-09-14T10:55:45.411031+0000","last_peered":"2024-09-14T10:55:45.411031+0000","last_clean":"2024-09-14T10:55:45.411031+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:55:45.411031+0000","last_undegraded":"2024-09-14T10:55:45.411031+0000","last_fullsized":"2024-09-14T10:55:45.411031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:37.366298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.941607+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:58:19.941607+0000","last_peered":"2024-09-14T10:58:19.941607+0000","last_clean":"2024-09-14T10:58:19.941607+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:58:19.941607+0000","last_undegraded":"2024-09-14T10:58:19.941607+0000","last_fullsized":"2024-09-14T10:58:19.941607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072341+0000","last_change":"2024-09-14T10:55:06.700492+0000","last_active":"2024-09-14T10:56:29.072341+0000","last_peered":"2024-09-14T10:56:29.072341+0000","last_clean":"2024-09-14T10:56:29.072341+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:56:29.072341+0000","last_undegraded":"2024-09-14T10:56:29.072341+0000","last_fullsized":"2024-09-14T10:56:29.072341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:08.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":148,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743002+0000","last_change":"2024-09-14T10:54:50.379542+0000","last_active":"2024-09-14T10:55:41.743002+0000","last_peered":"2024-09-14T10:55:41.743002+0000","last_clean":"2024-09-14T10:55:41.743002+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:55:41.743002+0000","last_undegraded":"2024-09-14T10:55:41.743002+0000","last_fullsized":"2024-09-14T10:55:41.743002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:48.792016+0000","last_clean_scrub_stamp":"2024-09-14T10:54:48.792016+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:47.847773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742229+0000","last_change":"2024-09-14T10:54:54.903343+0000","last_active":"2024-09-14T10:55:41.742229+0000","last_peered":"2024-09-14T10:55:41.742229+0000","last_clean":"2024-09-14T10:55:41.742229+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:55:41.742229+0000","last_undegraded":"2024-09-14T10:55:41.742229+0000","last_fullsized":"2024-09-14T10:55:41.742229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:41.397544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.277466+0000","last_change":"2024-09-14T10:55:04.711278+0000","last_active":"2024-09-14T10:58:13.277466+0000","last_peered":"2024-09-14T10:58:13.277466+0000","last_clean":"2024-09-14T10:58:13.277466+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:13.277466+0000","last_undegraded":"2024-09-14T10:58:13.277466+0000","last_fullsized":"2024-09-14T10:58:13.277466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:22.252465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746166+0000","last_change":"2024-09-14T10:55:08.700288+0000","last_active":"2024-09-14T10:55:41.746166+0000","last_peered":"2024-09-14T10:55:41.746166+0000","last_clean":"2024-09-14T10:55:41.746166+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:55:41.746166+0000","last_undegraded":"2024-09-14T10:55:41.746166+0000","last_fullsized":"2024-09-14T10:55:41.746166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:02.043861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.947965+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:58:19.947965+0000","last_peered":"2024-09-14T10:58:19.947965+0000","last_clean":"2024-09-14T10:58:19.947965+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:58:19.947965+0000","last_undegraded":"2024-09-14T10:58:19.947965+0000","last_fullsized":"2024-09-14T10:58:19.947965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971149+0000","last_change":"2024-09-14T10:55:06.692907+0000","last_active":"2024-09-14T10:58:12.971149+0000","last_peered":"2024-09-14T10:58:12.971149+0000","last_clean":"2024-09-14T10:58:12.971149+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:12.971149+0000","last_undegraded":"2024-09-14T10:58:12.971149+0000","last_fullsized":"2024-09-14T10:58:12.971149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:04.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741463+0000","last_change":"2024-09-14T10:54:54.903121+0000","last_active":"2024-09-14T10:55:41.741463+0000","last_peered":"2024-09-14T10:55:41.741463+0000","last_clean":"2024-09-14T10:55:41.741463+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:55:41.741463+0000","last_undegraded":"2024-09-14T10:55:41.741463+0000","last_fullsized":"2024-09-14T10:55:41.741463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.138800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745280+0000","last_change":"2024-09-14T10:55:04.692738+0000","last_active":"2024-09-14T10:55:41.745280+0000","last_peered":"2024-09-14T10:55:41.745280+0000","last_clean":"2024-09-14T10:55:41.745280+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:55:41.745280+0000","last_undegraded":"2024-09-14T10:55:41.745280+0000","last_fullsized":"2024-09-14T10:55:41.745280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:14.808200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'284","reported_seq":500,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.945814+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:19.945814+0000","last_peered":"2024-09-14T10:58:19.945814+0000","last_clean":"2024-09-14T10:58:19.945814+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:19.945814+0000","last_undegraded":"2024-09-14T10:58:19.945814+0000","last_fullsized":"2024-09-14T10:58:19.945814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971995+0000","last_change":"2024-09-14T10:55:06.697381+0000","last_active":"2024-09-14T10:58:12.971995+0000","last_peered":"2024-09-14T10:58:12.971995+0000","last_clean":"2024-09-14T10:58:12.971995+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:12.971995+0000","last_undegraded":"2024-09-14T10:58:12.971995+0000","last_fullsized":"2024-09-14T10:58:12.971995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:17.404755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746730+0000","last_change":"2024-09-14T10:54:54.900817+0000","last_active":"2024-09-14T10:55:41.746730+0000","last_peered":"2024-09-14T10:55:41.746730+0000","last_clean":"2024-09-14T10:55:41.746730+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:55:41.746730+0000","last_undegraded":"2024-09-14T10:55:41.746730+0000","last_fullsized":"2024-09-14T10:55:41.746730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:57.953705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.883807+0000","last_change":"2024-09-14T10:55:04.703428+0000","last_active":"2024-09-14T10:58:12.883807+0000","last_peered":"2024-09-14T10:58:12.883807+0000","last_clean":"2024-09-14T10:58:12.883807+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:12.883807+0000","last_undegraded":"2024-09-14T10:58:12.883807+0000","last_fullsized":"2024-09-14T10:58:12.883807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:53.536029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750615+0000","last_change":"2024-09-14T10:55:08.699744+0000","last_active":"2024-09-14T10:55:41.750615+0000","last_peered":"2024-09-14T10:55:41.750615+0000","last_clean":"2024-09-14T10:55:41.750615+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:55:41.750615+0000","last_undegraded":"2024-09-14T10:55:41.750615+0000","last_fullsized":"2024-09-14T10:55:41.750615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:26.469946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787613+0000","last_change":"2024-09-14T10:55:10.711152+0000","last_active":"2024-09-14T10:58:08.787613+0000","last_peered":"2024-09-14T10:58:08.787613+0000","last_clean":"2024-09-14T10:58:08.787613+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:08.787613+0000","last_undegraded":"2024-09-14T10:58:08.787613+0000","last_fullsized":"2024-09-14T10:58:08.787613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:00.848960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254782+0000","last_change":"2024-09-14T10:55:06.696400+0000","last_active":"2024-09-14T10:58:13.254782+0000","last_peered":"2024-09-14T10:58:13.254782+0000","last_clean":"2024-09-14T10:58:13.254782+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:13.254782+0000","last_undegraded":"2024-09-14T10:58:13.254782+0000","last_fullsized":"2024-09-14T10:58:13.254782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:27.637523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742327+0000","last_change":"2024-09-14T10:54:54.903726+0000","last_active":"2024-09-14T10:55:41.742327+0000","last_peered":"2024-09-14T10:55:41.742327+0000","last_clean":"2024-09-14T10:55:41.742327+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:55:41.742327+0000","last_undegraded":"2024-09-14T10:55:41.742327+0000","last_fullsized":"2024-09-14T10:55:41.742327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:25.791354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746853+0000","last_change":"2024-09-14T10:55:04.701485+0000","last_active":"2024-09-14T10:55:41.746853+0000","last_peered":"2024-09-14T10:55:41.746853+0000","last_clean":"2024-09-14T10:55:41.746853+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:55:41.746853+0000","last_undegraded":"2024-09-14T10:55:41.746853+0000","last_fullsized":"2024-09-14T10:55:41.746853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:55.465771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747177+0000","last_change":"2024-09-14T10:55:08.697214+0000","last_active":"2024-09-14T10:55:41.747177+0000","last_peered":"2024-09-14T10:55:41.747177+0000","last_clean":"2024-09-14T10:55:41.747177+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:55:41.747177+0000","last_undegraded":"2024-09-14T10:55:41.747177+0000","last_fullsized":"2024-09-14T10:55:41.747177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:19.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.216318+0000","last_change":"2024-09-14T10:55:06.706535+0000","last_active":"2024-09-14T10:58:13.216318+0000","last_peered":"2024-09-14T10:58:13.216318+0000","last_clean":"2024-09-14T10:58:13.216318+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:13.216318+0000","last_undegraded":"2024-09-14T10:58:13.216318+0000","last_fullsized":"2024-09-14T10:58:13.216318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:55.794763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745720+0000","last_change":"2024-09-14T10:55:04.700577+0000","last_active":"2024-09-14T10:55:41.745720+0000","last_peered":"2024-09-14T10:55:41.745720+0000","last_clean":"2024-09-14T10:55:41.745720+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:55:41.745720+0000","last_undegraded":"2024-09-14T10:55:41.745720+0000","last_fullsized":"2024-09-14T10:55:41.745720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:41.681611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746368+0000","last_change":"2024-09-14T10:54:54.905697+0000","last_active":"2024-09-14T10:55:41.746368+0000","last_peered":"2024-09-14T10:55:41.746368+0000","last_clean":"2024-09-14T10:55:41.746368+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:55:41.746368+0000","last_undegraded":"2024-09-14T10:55:41.746368+0000","last_fullsized":"2024-09-14T10:55:41.746368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.400872+0000","last_change":"2024-09-14T10:55:08.697596+0000","last_active":"2024-09-14T10:58:13.400872+0000","last_peered":"2024-09-14T10:58:13.400872+0000","last_clean":"2024-09-14T10:58:13.400872+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:13.400872+0000","last_undegraded":"2024-09-14T10:58:13.400872+0000","last_fullsized":"2024-09-14T10:58:13.400872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:19.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288374+0000","last_change":"2024-09-14T10:55:06.706584+0000","last_active":"2024-09-14T10:58:13.288374+0000","last_peered":"2024-09-14T10:58:13.288374+0000","last_clean":"2024-09-14T10:58:13.288374+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:13.288374+0000","last_undegraded":"2024-09-14T10:58:13.288374+0000","last_fullsized":"2024-09-14T10:58:13.288374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:27.341911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.872057+0000","last_change":"2024-09-14T10:55:04.693803+0000","last_active":"2024-09-14T10:58:12.872057+0000","last_peered":"2024-09-14T10:58:12.872057+0000","last_clean":"2024-09-14T10:58:12.872057+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:12.872057+0000","last_undegraded":"2024-09-14T10:58:12.872057+0000","last_fullsized":"2024-09-14T10:58:12.872057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:11.098713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744220+0000","last_change":"2024-09-14T10:54:54.903688+0000","last_active":"2024-09-14T10:55:41.744220+0000","last_peered":"2024-09-14T10:55:41.744220+0000","last_clean":"2024-09-14T10:55:41.744220+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:55:41.744220+0000","last_undegraded":"2024-09-14T10:55:41.744220+0000","last_fullsized":"2024-09-14T10:55:41.744220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:36.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.815435+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:19.815435+0000","last_peered":"2024-09-14T10:58:19.815435+0000","last_clean":"2024-09-14T10:58:19.815435+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:19.815435+0000","last_undegraded":"2024-09-14T10:58:19.815435+0000","last_fullsized":"2024-09-14T10:58:19.815435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.576048+0000","last_change":"2024-09-14T10:55:06.700418+0000","last_active":"2024-09-14T10:57:12.576048+0000","last_peered":"2024-09-14T10:57:12.576048+0000","last_clean":"2024-09-14T10:57:12.576048+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:57:12.576048+0000","last_undegraded":"2024-09-14T10:57:12.576048+0000","last_fullsized":"2024-09-14T10:57:12.576048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.529891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747368+0000","last_change":"2024-09-14T10:55:04.701334+0000","last_active":"2024-09-14T10:55:41.747368+0000","last_peered":"2024-09-14T10:55:41.747368+0000","last_clean":"2024-09-14T10:55:41.747368+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:55:41.747368+0000","last_undegraded":"2024-09-14T10:55:41.747368+0000","last_fullsized":"2024-09-14T10:55:41.747368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:44.481979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747311+0000","last_change":"2024-09-14T10:54:54.905650+0000","last_active":"2024-09-14T10:55:41.747311+0000","last_peered":"2024-09-14T10:55:41.747311+0000","last_clean":"2024-09-14T10:55:41.747311+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:55:41.747311+0000","last_undegraded":"2024-09-14T10:55:41.747311+0000","last_fullsized":"2024-09-14T10:55:41.747311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:05.333581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206572+0000","last_change":"2024-09-14T10:55:06.696240+0000","last_active":"2024-09-14T10:58:13.206572+0000","last_peered":"2024-09-14T10:58:13.206572+0000","last_clean":"2024-09-14T10:58:13.206572+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:13.206572+0000","last_undegraded":"2024-09-14T10:58:13.206572+0000","last_fullsized":"2024-09-14T10:58:13.206572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:55.340683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747296+0000","last_change":"2024-09-14T10:55:04.711259+0000","last_active":"2024-09-14T10:55:41.747296+0000","last_peered":"2024-09-14T10:55:41.747296+0000","last_clean":"2024-09-14T10:55:41.747296+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:55:41.747296+0000","last_undegraded":"2024-09-14T10:55:41.747296+0000","last_fullsized":"2024-09-14T10:55:41.747296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:39.310566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746456+0000","last_change":"2024-09-14T10:54:54.903986+0000","last_active":"2024-09-14T10:55:41.746456+0000","last_peered":"2024-09-14T10:55:41.746456+0000","last_clean":"2024-09-14T10:55:41.746456+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:55:41.746456+0000","last_undegraded":"2024-09-14T10:55:41.746456+0000","last_fullsized":"2024-09-14T10:55:41.746456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:54:51.883435+0000","last_clean_scrub_stamp":"2024-09-14T10:54:51.883435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.268712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.788559+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:58:19.788559+0000","last_peered":"2024-09-14T10:58:19.788559+0000","last_clean":"2024-09-14T10:58:19.788559+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:58:19.788559+0000","last_undegraded":"2024-09-14T10:58:19.788559+0000","last_fullsized":"2024-09-14T10:58:19.788559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'93","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.935872+0000","last_change":"2024-09-14T10:55:10.706862+0000","last_active":"2024-09-14T10:58:19.935872+0000","last_peered":"2024-09-14T10:58:19.935872+0000","last_clean":"2024-09-14T10:58:19.935872+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:19.935872+0000","last_undegraded":"2024-09-14T10:58:19.935872+0000","last_fullsized":"2024-09-14T10:58:19.935872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:12.621258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584503+0000","last_change":"2024-09-14T10:55:06.704098+0000","last_active":"2024-09-14T10:57:12.584503+0000","last_peered":"2024-09-14T10:57:12.584503+0000","last_clean":"2024-09-14T10:57:12.584503+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:57:12.584503+0000","last_undegraded":"2024-09-14T10:57:12.584503+0000","last_fullsized":"2024-09-14T10:57:12.584503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:55.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743912+0000","last_change":"2024-09-14T10:55:04.711613+0000","last_active":"2024-09-14T10:55:41.743912+0000","last_peered":"2024-09-14T10:55:41.743912+0000","last_clean":"2024-09-14T10:55:41.743912+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:55:41.743912+0000","last_undegraded":"2024-09-14T10:55:41.743912+0000","last_fullsized":"2024-09-14T10:55:41.743912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:11.362054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.755110+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:55:41.755110+0000","last_peered":"2024-09-14T10:55:41.755110+0000","last_clean":"2024-09-14T10:55:41.755110+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:55:41.755110+0000","last_undegraded":"2024-09-14T10:55:41.755110+0000","last_fullsized":"2024-09-14T10:55:41.755110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:31.114647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.953860+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:58:19.953860+0000","last_peered":"2024-09-14T10:58:19.953860+0000","last_clean":"2024-09-14T10:58:19.953860+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:58:19.953860+0000","last_undegraded":"2024-09-14T10:58:19.953860+0000","last_fullsized":"2024-09-14T10:58:19.953860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072086+0000","last_change":"2024-09-14T10:55:06.706869+0000","last_active":"2024-09-14T10:56:29.072086+0000","last_peered":"2024-09-14T10:56:29.072086+0000","last_clean":"2024-09-14T10:56:29.072086+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:56:29.072086+0000","last_undegraded":"2024-09-14T10:56:29.072086+0000","last_fullsized":"2024-09-14T10:56:29.072086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:29.765849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.528232+0000","last_change":"2024-09-14T10:55:04.701437+0000","last_active":"2024-09-14T10:55:46.528232+0000","last_peered":"2024-09-14T10:55:46.528232+0000","last_clean":"2024-09-14T10:55:46.528232+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:55:46.528232+0000","last_undegraded":"2024-09-14T10:55:46.528232+0000","last_fullsized":"2024-09-14T10:55:46.528232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:36.414518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255000+0000","last_change":"2024-09-14T10:55:06.693983+0000","last_active":"2024-09-14T10:58:13.255000+0000","last_peered":"2024-09-14T10:58:13.255000+0000","last_clean":"2024-09-14T10:58:13.255000+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:13.255000+0000","last_undegraded":"2024-09-14T10:58:13.255000+0000","last_fullsized":"2024-09-14T10:58:13.255000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.880458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750801+0000","last_change":"2024-09-14T10:55:04.698396+0000","last_active":"2024-09-14T10:55:41.750801+0000","last_peered":"2024-09-14T10:55:41.750801+0000","last_clean":"2024-09-14T10:55:41.750801+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:55:41.750801+0000","last_undegraded":"2024-09-14T10:55:41.750801+0000","last_fullsized":"2024-09-14T10:55:41.750801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:53.522489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749782+0000","last_change":"2024-09-14T10:55:08.706267+0000","last_active":"2024-09-14T10:55:41.749782+0000","last_peered":"2024-09-14T10:55:41.749782+0000","last_clean":"2024-09-14T10:55:41.749782+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:55:41.749782+0000","last_undegraded":"2024-09-14T10:55:41.749782+0000","last_fullsized":"2024-09-14T10:55:41.749782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:55.090960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:27.098679+0000","last_change":"2024-09-14T10:55:06.700291+0000","last_active":"2024-09-14T10:57:27.098679+0000","last_peered":"2024-09-14T10:57:27.098679+0000","last_clean":"2024-09-14T10:57:27.098679+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:57:27.098679+0000","last_undegraded":"2024-09-14T10:57:27.098679+0000","last_fullsized":"2024-09-14T10:57:27.098679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:17.660782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748263+0000","last_change":"2024-09-14T10:55:04.699426+0000","last_active":"2024-09-14T10:55:41.748263+0000","last_peered":"2024-09-14T10:55:41.748263+0000","last_clean":"2024-09-14T10:55:41.748263+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:55:41.748263+0000","last_undegraded":"2024-09-14T10:55:41.748263+0000","last_fullsized":"2024-09-14T10:55:41.748263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:02.506578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.910268+0000","last_change":"2024-09-14T10:55:10.702656+0000","last_active":"2024-09-14T10:58:19.910268+0000","last_peered":"2024-09-14T10:58:19.910268+0000","last_clean":"2024-09-14T10:58:19.910268+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:58:19.910268+0000","last_undegraded":"2024-09-14T10:58:19.910268+0000","last_fullsized":"2024-09-14T10:58:19.910268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:11.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741582+0000","last_change":"2024-09-14T10:55:04.710135+0000","last_active":"2024-09-14T10:55:41.741582+0000","last_peered":"2024-09-14T10:55:41.741582+0000","last_clean":"2024-09-14T10:55:41.741582+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:55:41.741582+0000","last_undegraded":"2024-09-14T10:55:41.741582+0000","last_fullsized":"2024-09-14T10:55:41.741582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:45.412903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065142+0000","last_change":"2024-09-14T10:55:06.697498+0000","last_active":"2024-09-14T10:58:13.065142+0000","last_peered":"2024-09-14T10:58:13.065142+0000","last_clean":"2024-09-14T10:58:13.065142+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:13.065142+0000","last_undegraded":"2024-09-14T10:58:13.065142+0000","last_fullsized":"2024-09-14T10:58:13.065142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:39.956062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.516347+0000","last_change":"2024-09-14T10:55:04.709771+0000","last_active":"2024-09-14T10:55:46.516347+0000","last_peered":"2024-09-14T10:55:46.516347+0000","last_clean":"2024-09-14T10:55:46.516347+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:55:46.516347+0000","last_undegraded":"2024-09-14T10:55:46.516347+0000","last_fullsized":"2024-09-14T10:55:46.516347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:06.645182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751169+0000","last_change":"2024-09-14T10:55:08.699650+0000","last_active":"2024-09-14T10:55:41.751169+0000","last_peered":"2024-09-14T10:55:41.751169+0000","last_clean":"2024-09-14T10:55:41.751169+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:55:41.751169+0000","last_undegraded":"2024-09-14T10:55:41.751169+0000","last_fullsized":"2024-09-14T10:55:41.751169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:29.469388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.913746+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:58:19.913746+0000","last_peered":"2024-09-14T10:58:19.913746+0000","last_clean":"2024-09-14T10:58:19.913746+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:58:19.913746+0000","last_undegraded":"2024-09-14T10:58:19.913746+0000","last_fullsized":"2024-09-14T10:58:19.913746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744988+0000","last_change":"2024-09-14T10:55:04.711540+0000","last_active":"2024-09-14T10:55:41.744988+0000","last_peered":"2024-09-14T10:55:41.744988+0000","last_clean":"2024-09-14T10:55:41.744988+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:55:41.744988+0000","last_undegraded":"2024-09-14T10:55:41.744988+0000","last_fullsized":"2024-09-14T10:55:41.744988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:34.258135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746905+0000","last_change":"2024-09-14T10:55:08.696759+0000","last_active":"2024-09-14T10:55:41.746905+0000","last_peered":"2024-09-14T10:55:41.746905+0000","last_clean":"2024-09-14T10:55:41.746905+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:55:41.746905+0000","last_undegraded":"2024-09-14T10:55:41.746905+0000","last_fullsized":"2024-09-14T10:55:41.746905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.250751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.213430+0000","last_change":"2024-09-14T10:55:06.687522+0000","last_active":"2024-09-14T10:58:13.213430+0000","last_peered":"2024-09-14T10:58:13.213430+0000","last_clean":"2024-09-14T10:58:13.213430+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:13.213430+0000","last_undegraded":"2024-09-14T10:58:13.213430+0000","last_fullsized":"2024-09-14T10:58:13.213430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.424148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742424+0000","last_change":"2024-09-14T10:55:04.707600+0000","last_active":"2024-09-14T10:55:41.742424+0000","last_peered":"2024-09-14T10:55:41.742424+0000","last_clean":"2024-09-14T10:55:41.742424+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:55:41.742424+0000","last_undegraded":"2024-09-14T10:55:41.742424+0000","last_fullsized":"2024-09-14T10:55:41.742424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:35.430004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":373,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.813753+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:19.813753+0000","last_peered":"2024-09-14T10:58:19.813753+0000","last_clean":"2024-09-14T10:58:19.813753+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:19.813753+0000","last_undegraded":"2024-09-14T10:58:19.813753+0000","last_fullsized":"2024-09-14T10:58:19.813753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099899+0000","last_change":"2024-09-14T10:55:06.687803+0000","last_active":"2024-09-14T10:57:37.099899+0000","last_peered":"2024-09-14T10:57:37.099899+0000","last_clean":"2024-09-14T10:57:37.099899+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:57:37.099899+0000","last_undegraded":"2024-09-14T10:57:37.099899+0000","last_fullsized":"2024-09-14T10:57:37.099899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:19.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.863577+0000","last_change":"2024-09-14T10:55:04.697878+0000","last_active":"2024-09-14T10:58:12.863577+0000","last_peered":"2024-09-14T10:58:12.863577+0000","last_clean":"2024-09-14T10:58:12.863577+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:12.863577+0000","last_undegraded":"2024-09-14T10:58:12.863577+0000","last_fullsized":"2024-09-14T10:58:12.863577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:46.271120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.871260+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:58:19.871260+0000","last_peered":"2024-09-14T10:58:19.871260+0000","last_clean":"2024-09-14T10:58:19.871260+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:58:19.871260+0000","last_undegraded":"2024-09-14T10:58:19.871260+0000","last_fullsized":"2024-09-14T10:58:19.871260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282026+0000","last_change":"2024-09-14T10:55:06.687347+0000","last_active":"2024-09-14T10:58:13.282026+0000","last_peered":"2024-09-14T10:58:13.282026+0000","last_clean":"2024-09-14T10:58:13.282026+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:13.282026+0000","last_undegraded":"2024-09-14T10:58:13.282026+0000","last_fullsized":"2024-09-14T10:58:13.282026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:08.040457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744386+0000","last_change":"2024-09-14T10:55:04.711139+0000","last_active":"2024-09-14T10:55:41.744386+0000","last_peered":"2024-09-14T10:55:41.744386+0000","last_clean":"2024-09-14T10:55:41.744386+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:55:41.744386+0000","last_undegraded":"2024-09-14T10:55:41.744386+0000","last_fullsized":"2024-09-14T10:55:41.744386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.640526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750062+0000","last_change":"2024-09-14T10:55:08.697330+0000","last_active":"2024-09-14T10:55:41.750062+0000","last_peered":"2024-09-14T10:55:41.750062+0000","last_clean":"2024-09-14T10:55:41.750062+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:55:41.750062+0000","last_undegraded":"2024-09-14T10:55:41.750062+0000","last_fullsized":"2024-09-14T10:55:41.750062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.585707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.261968+0000","last_change":"2024-09-14T10:55:06.701898+0000","last_active":"2024-09-14T10:58:13.261968+0000","last_peered":"2024-09-14T10:58:13.261968+0000","last_clean":"2024-09-14T10:58:13.261968+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:58:13.261968+0000","last_undegraded":"2024-09-14T10:58:13.261968+0000","last_fullsized":"2024-09-14T10:58:13.261968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:01.158624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747660+0000","last_change":"2024-09-14T10:55:04.693915+0000","last_active":"2024-09-14T10:55:41.747660+0000","last_peered":"2024-09-14T10:55:41.747660+0000","last_clean":"2024-09-14T10:55:41.747660+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:55:41.747660+0000","last_undegraded":"2024-09-14T10:55:41.747660+0000","last_fullsized":"2024-09-14T10:55:41.747660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:42.364449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749018+0000","last_change":"2024-09-14T10:55:08.705127+0000","last_active":"2024-09-14T10:55:41.749018+0000","last_peered":"2024-09-14T10:55:41.749018+0000","last_clean":"2024-09-14T10:55:41.749018+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:55:41.749018+0000","last_undegraded":"2024-09-14T10:55:41.749018+0000","last_fullsized":"2024-09-14T10:55:41.749018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:13.732662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.959227+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:58:19.959227+0000","last_peered":"2024-09-14T10:58:19.959227+0000","last_clean":"2024-09-14T10:58:19.959227+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:58:19.959227+0000","last_undegraded":"2024-09-14T10:58:19.959227+0000","last_fullsized":"2024-09-14T10:58:19.959227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206948+0000","last_change":"2024-09-14T10:55:06.685023+0000","last_active":"2024-09-14T10:58:13.206948+0000","last_peered":"2024-09-14T10:58:13.206948+0000","last_clean":"2024-09-14T10:58:13.206948+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:13.206948+0000","last_undegraded":"2024-09-14T10:58:13.206948+0000","last_fullsized":"2024-09-14T10:58:13.206948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.730948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.891711+0000","last_change":"2024-09-14T10:55:04.699747+0000","last_active":"2024-09-14T10:58:12.891711+0000","last_peered":"2024-09-14T10:58:12.891711+0000","last_clean":"2024-09-14T10:58:12.891711+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:12.891711+0000","last_undegraded":"2024-09-14T10:58:12.891711+0000","last_fullsized":"2024-09-14T10:58:12.891711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:31.195740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":223,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.789194+0000","last_change":"2024-09-14T10:55:08.704615+0000","last_active":"2024-09-14T10:58:19.789194+0000","last_peered":"2024-09-14T10:58:19.789194+0000","last_clean":"2024-09-14T10:58:19.789194+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:58:19.789194+0000","last_undegraded":"2024-09-14T10:58:19.789194+0000","last_fullsized":"2024-09-14T10:58:19.789194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:58.840952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'35","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.968171+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:19.968171+0000","last_peered":"2024-09-14T10:58:19.968171+0000","last_clean":"2024-09-14T10:58:19.968171+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:19.968171+0000","last_undegraded":"2024-09-14T10:58:19.968171+0000","last_fullsized":"2024-09-14T10:58:19.968171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970449+0000","last_change":"2024-09-14T10:55:06.706262+0000","last_active":"2024-09-14T10:58:12.970449+0000","last_peered":"2024-09-14T10:58:12.970449+0000","last_clean":"2024-09-14T10:58:12.970449+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:12.970449+0000","last_undegraded":"2024-09-14T10:58:12.970449+0000","last_fullsized":"2024-09-14T10:58:12.970449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:47.079971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745287+0000","last_change":"2024-09-14T10:55:04.692001+0000","last_active":"2024-09-14T10:55:41.745287+0000","last_peered":"2024-09-14T10:55:41.745287+0000","last_clean":"2024-09-14T10:55:41.745287+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:55:41.745287+0000","last_undegraded":"2024-09-14T10:55:41.745287+0000","last_fullsized":"2024-09-14T10:55:41.745287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:53.842302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071299+0000","last_change":"2024-09-14T10:55:06.687507+0000","last_active":"2024-09-14T10:58:13.071299+0000","last_peered":"2024-09-14T10:58:13.071299+0000","last_clean":"2024-09-14T10:58:13.071299+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:13.071299+0000","last_undegraded":"2024-09-14T10:58:13.071299+0000","last_fullsized":"2024-09-14T10:58:13.071299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:25.386577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745168+0000","last_change":"2024-09-14T10:55:04.688069+0000","last_active":"2024-09-14T10:55:41.745168+0000","last_peered":"2024-09-14T10:55:41.745168+0000","last_clean":"2024-09-14T10:55:41.745168+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:55:41.745168+0000","last_undegraded":"2024-09-14T10:55:41.745168+0000","last_fullsized":"2024-09-14T10:55:41.745168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:46.177526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.906651+0000","last_change":"2024-09-14T10:55:04.710926+0000","last_active":"2024-09-14T10:55:45.906651+0000","last_peered":"2024-09-14T10:55:45.906651+0000","last_clean":"2024-09-14T10:55:45.906651+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:55:45.906651+0000","last_undegraded":"2024-09-14T10:55:45.906651+0000","last_fullsized":"2024-09-14T10:55:45.906651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:49.684958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288727+0000","last_change":"2024-09-14T10:55:06.696409+0000","last_active":"2024-09-14T10:58:13.288727+0000","last_peered":"2024-09-14T10:58:13.288727+0000","last_clean":"2024-09-14T10:58:13.288727+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:13.288727+0000","last_undegraded":"2024-09-14T10:58:13.288727+0000","last_fullsized":"2024-09-14T10:58:13.288727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:21.339716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.853982+0000","last_change":"2024-09-14T10:55:04.692725+0000","last_active":"2024-09-14T10:58:12.853982+0000","last_peered":"2024-09-14T10:58:12.853982+0000","last_clean":"2024-09-14T10:58:12.853982+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:12.853982+0000","last_undegraded":"2024-09-14T10:58:12.853982+0000","last_fullsized":"2024-09-14T10:58:12.853982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:11.121584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584098+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:57:12.584098+0000","last_peered":"2024-09-14T10:57:12.584098+0000","last_clean":"2024-09-14T10:57:12.584098+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:57:12.584098+0000","last_undegraded":"2024-09-14T10:57:12.584098+0000","last_fullsized":"2024-09-14T10:57:12.584098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:07.392085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747193+0000","last_change":"2024-09-14T10:55:04.688186+0000","last_active":"2024-09-14T10:55:41.747193+0000","last_peered":"2024-09-14T10:55:41.747193+0000","last_clean":"2024-09-14T10:55:41.747193+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:55:41.747193+0000","last_undegraded":"2024-09-14T10:55:41.747193+0000","last_fullsized":"2024-09-14T10:55:41.747193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:00.846319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747700+0000","last_change":"2024-09-14T10:55:06.706855+0000","last_active":"2024-09-14T10:55:41.747700+0000","last_peered":"2024-09-14T10:55:41.747700+0000","last_clean":"2024-09-14T10:55:41.747700+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:55:41.747700+0000","last_undegraded":"2024-09-14T10:55:41.747700+0000","last_fullsized":"2024-09-14T10:55:41.747700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:37.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745885+0000","last_change":"2024-09-14T10:55:04.713422+0000","last_active":"2024-09-14T10:55:41.745885+0000","last_peered":"2024-09-14T10:55:41.745885+0000","last_clean":"2024-09-14T10:55:41.745885+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:55:41.745885+0000","last_undegraded":"2024-09-14T10:55:41.745885+0000","last_fullsized":"2024-09-14T10:55:41.745885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:03.810507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254690+0000","last_change":"2024-09-14T10:55:06.693603+0000","last_active":"2024-09-14T10:58:13.254690+0000","last_peered":"2024-09-14T10:58:13.254690+0000","last_clean":"2024-09-14T10:58:13.254690+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:13.254690+0000","last_undegraded":"2024-09-14T10:58:13.254690+0000","last_fullsized":"2024-09-14T10:58:13.254690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.667603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750884+0000","last_change":"2024-09-14T10:55:04.703452+0000","last_active":"2024-09-14T10:55:41.750884+0000","last_peered":"2024-09-14T10:55:41.750884+0000","last_clean":"2024-09-14T10:55:41.750884+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:55:41.750884+0000","last_undegraded":"2024-09-14T10:55:41.750884+0000","last_fullsized":"2024-09-14T10:55:41.750884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:00.261748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.269807+0000","last_change":"2024-09-14T10:55:06.695095+0000","last_active":"2024-09-14T10:55:46.269807+0000","last_peered":"2024-09-14T10:55:46.269807+0000","last_clean":"2024-09-14T10:55:46.269807+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:55:46.269807+0000","last_undegraded":"2024-09-14T10:55:46.269807+0000","last_fullsized":"2024-09-14T10:55:46.269807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:34.488242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747648+0000","last_change":"2024-09-14T10:55:04.692552+0000","last_active":"2024-09-14T10:55:41.747648+0000","last_peered":"2024-09-14T10:55:41.747648+0000","last_clean":"2024-09-14T10:55:41.747648+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:55:41.747648+0000","last_undegraded":"2024-09-14T10:55:41.747648+0000","last_fullsized":"2024-09-14T10:55:41.747648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:21.177487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.063117+0000","last_change":"2024-09-14T10:55:06.701407+0000","last_active":"2024-09-14T10:58:13.063117+0000","last_peered":"2024-09-14T10:58:13.063117+0000","last_clean":"2024-09-14T10:58:13.063117+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:13.063117+0000","last_undegraded":"2024-09-14T10:58:13.063117+0000","last_fullsized":"2024-09-14T10:58:13.063117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:37.860704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741718+0000","last_change":"2024-09-14T10:55:04.710334+0000","last_active":"2024-09-14T10:55:41.741718+0000","last_peered":"2024-09-14T10:55:41.741718+0000","last_clean":"2024-09-14T10:55:41.741718+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:55:41.741718+0000","last_undegraded":"2024-09-14T10:55:41.741718+0000","last_fullsized":"2024-09-14T10:55:41.741718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.591594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.933306+0000","last_change":"2024-09-14T10:55:04.708511+0000","last_active":"2024-09-14T10:58:12.933306+0000","last_peered":"2024-09-14T10:58:12.933306+0000","last_clean":"2024-09-14T10:58:12.933306+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:12.933306+0000","last_undegraded":"2024-09-14T10:58:12.933306+0000","last_fullsized":"2024-09-14T10:58:12.933306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:30.156640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'5","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:25.087198+0000","last_change":"2024-09-14T10:55:41.752889+0000","last_active":"2024-09-14T10:57:25.087198+0000","last_peered":"2024-09-14T10:57:25.087198+0000","last_clean":"2024-09-14T10:57:25.087198+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:57:25.087198+0000","last_undegraded":"2024-09-14T10:57:25.087198+0000","last_fullsized":"2024-09-14T10:57:25.087198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:42.730360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745601+0000","last_change":"2024-09-14T10:55:04.711861+0000","last_active":"2024-09-14T10:55:41.745601+0000","last_peered":"2024-09-14T10:55:41.745601+0000","last_clean":"2024-09-14T10:55:41.745601+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:55:41.745601+0000","last_undegraded":"2024-09-14T10:55:41.745601+0000","last_fullsized":"2024-09-14T10:55:41.745601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:53.636737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.585870+0000","last_change":"2024-09-14T10:55:06.693977+0000","last_active":"2024-09-14T10:57:12.585870+0000","last_peered":"2024-09-14T10:57:12.585870+0000","last_clean":"2024-09-14T10:57:12.585870+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:57:12.585870+0000","last_undegraded":"2024-09-14T10:57:12.585870+0000","last_fullsized":"2024-09-14T10:57:12.585870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:37.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745837+0000","last_change":"2024-09-14T10:55:04.709726+0000","last_active":"2024-09-14T10:55:41.745837+0000","last_peered":"2024-09-14T10:55:41.745837+0000","last_clean":"2024-09-14T10:55:41.745837+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:55:41.745837+0000","last_undegraded":"2024-09-14T10:55:41.745837+0000","last_fullsized":"2024-09-14T10:55:41.745837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:48.224901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206534+0000","last_change":"2024-09-14T10:55:06.706605+0000","last_active":"2024-09-14T10:58:13.206534+0000","last_peered":"2024-09-14T10:58:13.206534+0000","last_clean":"2024-09-14T10:58:13.206534+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:13.206534+0000","last_undegraded":"2024-09-14T10:58:13.206534+0000","last_fullsized":"2024-09-14T10:58:13.206534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:52.689688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743268+0000","last_change":"2024-09-14T10:55:04.699774+0000","last_active":"2024-09-14T10:55:41.743268+0000","last_peered":"2024-09-14T10:55:41.743268+0000","last_clean":"2024-09-14T10:55:41.743268+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:55:41.743268+0000","last_undegraded":"2024-09-14T10:55:41.743268+0000","last_fullsized":"2024-09-14T10:55:41.743268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:35.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288869+0000","last_change":"2024-09-14T10:55:06.699736+0000","last_active":"2024-09-14T10:58:13.288869+0000","last_peered":"2024-09-14T10:58:13.288869+0000","last_clean":"2024-09-14T10:58:13.288869+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:13.288869+0000","last_undegraded":"2024-09-14T10:58:13.288869+0000","last_fullsized":"2024-09-14T10:58:13.288869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.763519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744546+0000","last_change":"2024-09-14T10:55:04.709992+0000","last_active":"2024-09-14T10:55:41.744546+0000","last_peered":"2024-09-14T10:55:41.744546+0000","last_clean":"2024-09-14T10:55:41.744546+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:55:41.744546+0000","last_undegraded":"2024-09-14T10:55:41.744546+0000","last_fullsized":"2024-09-14T10:55:41.744546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:50.555115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.185204+0000","last_change":"2024-09-14T10:55:04.699259+0000","last_active":"2024-09-14T10:58:13.185204+0000","last_peered":"2024-09-14T10:58:13.185204+0000","last_clean":"2024-09-14T10:58:13.185204+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:13.185204+0000","last_undegraded":"2024-09-14T10:58:13.185204+0000","last_fullsized":"2024-09-14T10:58:13.185204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:40.790660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254366+0000","last_change":"2024-09-14T10:55:06.695857+0000","last_active":"2024-09-14T10:58:13.254366+0000","last_peered":"2024-09-14T10:58:13.254366+0000","last_clean":"2024-09-14T10:58:13.254366+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:13.254366+0000","last_undegraded":"2024-09-14T10:58:13.254366+0000","last_fullsized":"2024-09-14T10:58:13.254366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.647597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747002+0000","last_change":"2024-09-14T10:55:04.708597+0000","last_active":"2024-09-14T10:55:41.747002+0000","last_peered":"2024-09-14T10:55:41.747002+0000","last_clean":"2024-09-14T10:55:41.747002+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:55:41.747002+0000","last_undegraded":"2024-09-14T10:55:41.747002+0000","last_fullsized":"2024-09-14T10:55:41.747002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:23.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742085+0000","last_change":"2024-09-14T10:55:04.710032+0000","last_active":"2024-09-14T10:55:41.742085+0000","last_peered":"2024-09-14T10:55:41.742085+0000","last_clean":"2024-09-14T10:55:41.742085+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:55:41.742085+0000","last_undegraded":"2024-09-14T10:55:41.742085+0000","last_fullsized":"2024-09-14T10:55:41.742085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:53.935014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970776+0000","last_change":"2024-09-14T10:55:06.697653+0000","last_active":"2024-09-14T10:58:12.970776+0000","last_peered":"2024-09-14T10:58:12.970776+0000","last_clean":"2024-09-14T10:58:12.970776+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:12.970776+0000","last_undegraded":"2024-09-14T10:58:12.970776+0000","last_fullsized":"2024-09-14T10:58:12.970776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:19.133663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.907988+0000","last_change":"2024-09-14T10:55:04.708709+0000","last_active":"2024-09-14T10:58:12.907988+0000","last_peered":"2024-09-14T10:58:12.907988+0000","last_clean":"2024-09-14T10:58:12.907988+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:12.907988+0000","last_undegraded":"2024-09-14T10:58:12.907988+0000","last_fullsized":"2024-09-14T10:58:12.907988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.909709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.289007+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:58:13.289007+0000","last_peered":"2024-09-14T10:58:13.289007+0000","last_clean":"2024-09-14T10:58:13.289007+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:13.289007+0000","last_undegraded":"2024-09-14T10:58:13.289007+0000","last_fullsized":"2024-09-14T10:58:13.289007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:19.903453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52260,"kb_used_data":12756,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319580,"statfs":{"total":96636764160,"available":96583249920,"internally_reserved":0,"allocated":13062144,"data_stored":12744757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:58:24.420 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.420 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.421 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.422 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.423 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.424 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.425 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.426 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.427 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.428 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.429 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.434 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.434 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.434 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.435 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.436 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T10:54:48.792016+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.437 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.438 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.439 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.440 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.441 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.442 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.443 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:54:51.883435+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=54, tm_sec=51, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.444 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.445 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.446 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.447 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.448 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.449 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.450 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.451 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.452 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.453 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.454 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.455 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.456 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.457 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.458 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:24.458 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:58:44.459 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e1bcb8640 1 Processor -- start 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e1bcb8640 1 -- start start 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e1bcb8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8e1406dfb0 0x7f8e1406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e1bcb8640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e14071660 con 0x7f8e1406e8d0 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e1bcb8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f8e14072550 con 0x7f8e1406dfb0 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e19a54640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8e1406dfb0 0x7f8e1406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e19253640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8e1406e8d0 0x7f8e14097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:53136/0 (socket says 172.21.15.116:53136) 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.570+0000 7f8e19a54640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8e1406dfb0 0x7f8e1406e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:32944/0 (socket says 172.21.15.116:32944) 2024-09-14T10:58:44.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.571+0000 7f8e19253640 1 -- 172.21.15.116:0/1234550857 learned_addr learned my addr 172.21.15.116:0/1234550857 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:58:44.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.571+0000 7f8e19a54640 1 -- 172.21.15.116:0/1234550857 >> v1:172.21.15.116:6789/0 conn(0x7f8e1406e8d0 legacy=0x7f8e14097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:44.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.571+0000 7f8e18a52640 1 -- 172.21.15.116:0/1234550857 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444440771 0 0) 0x7f8e14071660 con 0x7f8e1406e8d0 2024-09-14T10:58:44.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.571+0000 7f8e19a54640 1 -- 172.21.15.116:0/1234550857 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e14099e20 con 0x7f8e1406dfb0 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.571+0000 7f8e19a54640 1 --2- 172.21.15.116:0/1234550857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e1406e390 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009720 tx=0x7f8e1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1481bdca51ca646 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e18a52640 1 -- 172.21.15.116:0/1234550857 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e10037070 con 0x7f8e1406dfb0 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e18a52640 1 -- 172.21.15.116:0/1234550857 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1002ae20 con 0x7f8e1406dfb0 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e18a52640 1 -- 172.21.15.116:0/1234550857 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e10032590 con 0x7f8e1406dfb0 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/1234550857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 msgr2=0x7f8e1406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/1234550857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e1406e390 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009720 tx=0x7f8e1002a1a0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/1234550857 shutdown_connections 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/1234550857 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e1406e390 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/1234550857 >> 172.21.15.116:0/1234550857 conn(0x7f8e1409abc0 msgr2=0x7f8e14098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/1234550857 shutdown_connections 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.572+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/1234550857 wait complete. 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.573+0000 7f8e1bcb8640 1 Processor -- start 2024-09-14T10:58:44.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.573+0000 7f8e1bcb8640 1 -- start start 2024-09-14T10:58:44.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e1bcb8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:44.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e1bcb8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1406ece0 con 0x7f8e1406dfb0 2024-09-14T10:58:44.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e19a54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:44.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e19a54640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:32954/0 (socket says 172.21.15.116:32954) 2024-09-14T10:58:44.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e19a54640 1 -- 172.21.15.116:0/3871533831 learned_addr learned my addr 172.21.15.116:0/3871533831 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e19a54640 1 -- 172.21.15.116:0/3871533831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e14074110 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e19a54640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8e1002a1e0 tx=0x7f8e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e10042070 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1003e590 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e14070450 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e10037040 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.574+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e14129770 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.575+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8e10045070 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.575+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1406e390 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.575+0000 7f8e0a7fc640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 0x7f8df8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.575+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8e10074160 con 0x7f8e1406dfb0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.576+0000 7f8e19253640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 0x7f8df8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:58:44.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.576+0000 7f8e19253640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 0x7f8df8040a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8e04000c00 tx=0x7f8e040078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:58:44.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.580+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f8e1003c430 con 0x7f8e1406dfb0 2024-09-14T10:58:44.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.751+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e1406fcb0 con 0x7f8df803e570 2024-09-14T10:58:44.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.762+0000 7f8e0a7fc640 1 -- 172.21.15.116:0/3871533831 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665721 (secure 0 0 0) 0x7f8e1406fcb0 con 0x7f8df803e570 2024-09-14T10:58:44.773 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:58:44.779 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.766+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 msgr2=0x7f8df8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.766+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 0x7f8df8040a30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8e04000c00 tx=0x7f8e040078f0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.766+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 msgr2=0x7f8e14129230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.766+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8e1002a1e0 tx=0x7f8e100046c0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 shutdown_connections 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8df803e570 0x7f8df8040a30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 --2- 172.21.15.116:0/3871533831 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8e1406dfb0 0x7f8e14129230 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 >> 172.21.15.116:0/3871533831 conn(0x7f8e1409abc0 msgr2=0x7f8e1412d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 shutdown_connections 2024-09-14T10:58:44.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:58:44.767+0000 7f8e1bcb8640 1 -- 172.21.15.116:0/3871533831 wait complete. 2024-09-14T10:58:44.783 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-14T10:58:44.127788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4568,"ondisk_log_size":4568,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152704,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334656,"statfs":{"total":386547056640,"available":386390687744,"internally_reserved":0,"allocated":3080192,"data_stored":1819780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003952"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.768923+0000","last_change":"2024-09-14T10:58:37.768923+0000","last_active":"2024-09-14T10:58:37.768923+0000","last_peered":"2024-09-14T10:58:37.768923+0000","last_clean":"2024-09-14T10:58:37.768923+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:58:37.768923+0000","last_undegraded":"2024-09-14T10:58:37.768923+0000","last_fullsized":"2024-09-14T10:58:37.768923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.768838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:59.090598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099828+0000","last_change":"2024-09-14T10:55:06.701780+0000","last_active":"2024-09-14T10:57:37.099828+0000","last_peered":"2024-09-14T10:57:37.099828+0000","last_clean":"2024-09-14T10:57:37.099828+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:57:37.099828+0000","last_undegraded":"2024-09-14T10:57:37.099828+0000","last_fullsized":"2024-09-14T10:57:37.099828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:25.537025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.549485+0000","last_change":"2024-09-14T10:58:38.549485+0000","last_active":"2024-09-14T10:58:38.549485+0000","last_peered":"2024-09-14T10:58:38.549485+0000","last_clean":"2024-09-14T10:58:38.549485+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:58:38.549485+0000","last_undegraded":"2024-09-14T10:58:38.549485+0000","last_fullsized":"2024-09-14T10:58:38.549485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.549386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.035874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.044322+0000","last_change":"2024-09-14T10:55:41.755184+0000","last_active":"2024-09-14T10:55:47.044322+0000","last_peered":"2024-09-14T10:55:47.044322+0000","last_clean":"2024-09-14T10:55:47.044322+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:55:47.044322+0000","last_undegraded":"2024-09-14T10:55:47.044322+0000","last_fullsized":"2024-09-14T10:55:47.044322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:40.243416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.486444+0000","last_change":"2024-09-14T10:55:04.710321+0000","last_active":"2024-09-14T10:57:12.486444+0000","last_peered":"2024-09-14T10:57:12.486444+0000","last_clean":"2024-09-14T10:57:12.486444+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:57:12.486444+0000","last_undegraded":"2024-09-14T10:57:12.486444+0000","last_fullsized":"2024-09-14T10:57:12.486444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:23.527711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.746554+0000","last_change":"2024-09-14T10:58:36.746554+0000","last_active":"2024-09-14T10:58:36.746554+0000","last_peered":"2024-09-14T10:58:36.746554+0000","last_clean":"2024-09-14T10:58:36.746554+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:58:36.746554+0000","last_undegraded":"2024-09-14T10:58:36.746554+0000","last_fullsized":"2024-09-14T10:58:36.746554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.746473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:56.987213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065448+0000","last_change":"2024-09-14T10:55:41.752605+0000","last_active":"2024-09-14T10:58:13.065448+0000","last_peered":"2024-09-14T10:58:13.065448+0000","last_clean":"2024-09-14T10:58:13.065448+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:13.065448+0000","last_undegraded":"2024-09-14T10:58:13.065448+0000","last_fullsized":"2024-09-14T10:58:13.065448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.626179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.952023+0000","last_change":"2024-09-14T10:55:04.693896+0000","last_active":"2024-09-14T10:58:12.952023+0000","last_peered":"2024-09-14T10:58:12.952023+0000","last_clean":"2024-09-14T10:58:12.952023+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:12.952023+0000","last_undegraded":"2024-09-14T10:58:12.952023+0000","last_fullsized":"2024-09-14T10:58:12.952023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:25.363300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282107+0000","last_change":"2024-09-14T10:55:06.694032+0000","last_active":"2024-09-14T10:58:13.282107+0000","last_peered":"2024-09-14T10:58:13.282107+0000","last_clean":"2024-09-14T10:58:13.282107+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:13.282107+0000","last_undegraded":"2024-09-14T10:58:13.282107+0000","last_fullsized":"2024-09-14T10:58:13.282107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:52.564428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.781933+0000","last_change":"2024-09-14T10:58:35.781933+0000","last_active":"2024-09-14T10:58:35.781933+0000","last_peered":"2024-09-14T10:58:35.781933+0000","last_clean":"2024-09-14T10:58:35.781933+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:58:35.781933+0000","last_undegraded":"2024-09-14T10:58:35.781933+0000","last_fullsized":"2024-09-14T10:58:35.781933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.781832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.948433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.194738+0000","last_change":"2024-09-14T10:55:04.699709+0000","last_active":"2024-09-14T10:58:13.194738+0000","last_peered":"2024-09-14T10:58:13.194738+0000","last_clean":"2024-09-14T10:58:13.194738+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:13.194738+0000","last_undegraded":"2024-09-14T10:58:13.194738+0000","last_fullsized":"2024-09-14T10:58:13.194738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:53.785449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751899+0000","last_change":"2024-09-14T10:55:06.698420+0000","last_active":"2024-09-14T10:55:41.751899+0000","last_peered":"2024-09-14T10:55:41.751899+0000","last_clean":"2024-09-14T10:55:41.751899+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:55:41.751899+0000","last_undegraded":"2024-09-14T10:55:41.751899+0000","last_fullsized":"2024-09-14T10:55:41.751899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:37.492907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.557545+0000","last_change":"2024-09-14T10:58:36.557545+0000","last_active":"2024-09-14T10:58:36.557545+0000","last_peered":"2024-09-14T10:58:36.557545+0000","last_clean":"2024-09-14T10:58:36.557545+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:58:36.557545+0000","last_undegraded":"2024-09-14T10:58:36.557545+0000","last_fullsized":"2024-09-14T10:58:36.557545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:19.674856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071556+0000","last_change":"2024-09-14T10:55:06.695226+0000","last_active":"2024-09-14T10:56:29.071556+0000","last_peered":"2024-09-14T10:56:29.071556+0000","last_clean":"2024-09-14T10:56:29.071556+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:56:29.071556+0000","last_undegraded":"2024-09-14T10:56:29.071556+0000","last_fullsized":"2024-09-14T10:56:29.071556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:25.288530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.116444+0000","last_change":"2024-09-14T10:58:41.116444+0000","last_active":"2024-09-14T10:58:41.116444+0000","last_peered":"2024-09-14T10:58:41.116444+0000","last_clean":"2024-09-14T10:58:41.116444+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:41.116444+0000","last_undegraded":"2024-09-14T10:58:41.116444+0000","last_fullsized":"2024-09-14T10:58:41.116444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.116320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.336574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.281969+0000","last_change":"2024-09-14T10:55:06.699438+0000","last_active":"2024-09-14T10:58:13.281969+0000","last_peered":"2024-09-14T10:58:13.281969+0000","last_clean":"2024-09-14T10:58:13.281969+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:13.281969+0000","last_undegraded":"2024-09-14T10:58:13.281969+0000","last_fullsized":"2024-09-14T10:58:13.281969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.481249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.762283+0000","last_change":"2024-09-14T10:58:34.762283+0000","last_active":"2024-09-14T10:58:34.762283+0000","last_peered":"2024-09-14T10:58:34.762283+0000","last_clean":"2024-09-14T10:58:34.762283+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:58:34.762283+0000","last_undegraded":"2024-09-14T10:58:34.762283+0000","last_fullsized":"2024-09-14T10:58:34.762283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.762201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:32.819316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584049+0000","last_change":"2024-09-14T10:55:06.699540+0000","last_active":"2024-09-14T10:57:12.584049+0000","last_peered":"2024-09-14T10:57:12.584049+0000","last_clean":"2024-09-14T10:57:12.584049+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:57:12.584049+0000","last_undegraded":"2024-09-14T10:57:12.584049+0000","last_fullsized":"2024-09-14T10:57:12.584049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:32.051158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.125124+0000","last_change":"2024-09-14T10:58:36.125124+0000","last_active":"2024-09-14T10:58:36.125124+0000","last_peered":"2024-09-14T10:58:36.125124+0000","last_clean":"2024-09-14T10:58:36.125124+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:58:36.125124+0000","last_undegraded":"2024-09-14T10:58:36.125124+0000","last_fullsized":"2024-09-14T10:58:36.125124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.125007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:02.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254829+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:58:13.254829+0000","last_peered":"2024-09-14T10:58:13.254829+0000","last_clean":"2024-09-14T10:58:13.254829+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:13.254829+0000","last_undegraded":"2024-09-14T10:58:13.254829+0000","last_fullsized":"2024-09-14T10:58:13.254829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:14.222515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.151676+0000","last_change":"2024-09-14T10:58:34.151676+0000","last_active":"2024-09-14T10:58:34.151676+0000","last_peered":"2024-09-14T10:58:34.151676+0000","last_clean":"2024-09-14T10:58:34.151676+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:58:34.151676+0000","last_undegraded":"2024-09-14T10:58:34.151676+0000","last_fullsized":"2024-09-14T10:58:34.151676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.151591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.433519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747047+0000","last_change":"2024-09-14T10:55:06.695487+0000","last_active":"2024-09-14T10:55:41.747047+0000","last_peered":"2024-09-14T10:55:41.747047+0000","last_clean":"2024-09-14T10:55:41.747047+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:55:41.747047+0000","last_undegraded":"2024-09-14T10:55:41.747047+0000","last_fullsized":"2024-09-14T10:55:41.747047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:37.971520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.579906+0000","last_change":"2024-09-14T10:58:37.579906+0000","last_active":"2024-09-14T10:58:37.579906+0000","last_peered":"2024-09-14T10:58:37.579906+0000","last_clean":"2024-09-14T10:58:37.579906+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:58:37.579906+0000","last_undegraded":"2024-09-14T10:58:37.579906+0000","last_fullsized":"2024-09-14T10:58:37.579906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.579809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:06.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.071829+0000","last_change":"2024-09-14T10:55:06.697009+0000","last_active":"2024-09-14T10:56:29.071829+0000","last_peered":"2024-09-14T10:56:29.071829+0000","last_clean":"2024-09-14T10:56:29.071829+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:56:29.071829+0000","last_undegraded":"2024-09-14T10:56:29.071829+0000","last_fullsized":"2024-09-14T10:56:29.071829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.649839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.200303+0000","last_change":"2024-09-14T10:55:04.701290+0000","last_active":"2024-09-14T10:58:13.200303+0000","last_peered":"2024-09-14T10:58:13.200303+0000","last_clean":"2024-09-14T10:58:13.200303+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:13.200303+0000","last_undegraded":"2024-09-14T10:58:13.200303+0000","last_fullsized":"2024-09-14T10:58:13.200303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.180072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.929907+0000","last_change":"2024-09-14T10:55:06.689207+0000","last_active":"2024-09-14T10:55:45.929907+0000","last_peered":"2024-09-14T10:55:45.929907+0000","last_clean":"2024-09-14T10:55:45.929907+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:55:45.929907+0000","last_undegraded":"2024-09-14T10:55:45.929907+0000","last_fullsized":"2024-09-14T10:55:45.929907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:51.007328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.122467+0000","last_change":"2024-09-14T10:58:38.122467+0000","last_active":"2024-09-14T10:58:38.122467+0000","last_peered":"2024-09-14T10:58:38.122467+0000","last_clean":"2024-09-14T10:58:38.122467+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:58:38.122467+0000","last_undegraded":"2024-09-14T10:58:38.122467+0000","last_fullsized":"2024-09-14T10:58:38.122467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.122377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.370779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.938635+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:58:19.938635+0000","last_peered":"2024-09-14T10:58:19.938635+0000","last_clean":"2024-09-14T10:58:19.938635+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:58:19.938635+0000","last_undegraded":"2024-09-14T10:58:19.938635+0000","last_fullsized":"2024-09-14T10:58:19.938635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'17","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.982652+0000","last_change":"2024-09-14T10:55:06.692424+0000","last_active":"2024-09-14T10:58:12.982652+0000","last_peered":"2024-09-14T10:58:12.982652+0000","last_clean":"2024-09-14T10:58:12.982652+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:58:12.982652+0000","last_undegraded":"2024-09-14T10:58:12.982652+0000","last_fullsized":"2024-09-14T10:58:12.982652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:34.169033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.833117+0000","last_change":"2024-09-14T10:58:28.833117+0000","last_active":"2024-09-14T10:58:28.833117+0000","last_peered":"2024-09-14T10:58:28.833117+0000","last_clean":"2024-09-14T10:58:28.833117+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:58:28.833117+0000","last_undegraded":"2024-09-14T10:58:28.833117+0000","last_fullsized":"2024-09-14T10:58:28.833117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.833024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.803836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746096+0000","last_change":"2024-09-14T10:55:08.697901+0000","last_active":"2024-09-14T10:55:41.746096+0000","last_peered":"2024-09-14T10:55:41.746096+0000","last_clean":"2024-09-14T10:55:41.746096+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:55:41.746096+0000","last_undegraded":"2024-09-14T10:55:41.746096+0000","last_fullsized":"2024-09-14T10:55:41.746096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:51.107343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.134905+0000","last_change":"2024-09-14T10:58:37.134905+0000","last_active":"2024-09-14T10:58:37.134905+0000","last_peered":"2024-09-14T10:58:37.134905+0000","last_clean":"2024-09-14T10:58:37.134905+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:58:37.134905+0000","last_undegraded":"2024-09-14T10:58:37.134905+0000","last_fullsized":"2024-09-14T10:58:37.134905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.134801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:19.758122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747967+0000","last_change":"2024-09-14T10:55:08.703383+0000","last_active":"2024-09-14T10:55:41.747967+0000","last_peered":"2024-09-14T10:55:41.747967+0000","last_clean":"2024-09-14T10:55:41.747967+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:55:41.747967+0000","last_undegraded":"2024-09-14T10:55:41.747967+0000","last_fullsized":"2024-09-14T10:55:41.747967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:03.440350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":407,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.816667+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:19.816667+0000","last_peered":"2024-09-14T10:58:19.816667+0000","last_clean":"2024-09-14T10:58:19.816667+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:19.816667+0000","last_undegraded":"2024-09-14T10:58:19.816667+0000","last_fullsized":"2024-09-14T10:58:19.816667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270140+0000","last_change":"2024-09-14T10:55:06.697810+0000","last_active":"2024-09-14T10:55:46.270140+0000","last_peered":"2024-09-14T10:55:46.270140+0000","last_clean":"2024-09-14T10:55:46.270140+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:55:46.270140+0000","last_undegraded":"2024-09-14T10:55:46.270140+0000","last_fullsized":"2024-09-14T10:55:46.270140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:09.071738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.293841+0000","last_change":"2024-09-14T10:58:25.293841+0000","last_active":"2024-09-14T10:58:25.293841+0000","last_peered":"2024-09-14T10:58:25.293841+0000","last_clean":"2024-09-14T10:58:25.293841+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:58:25.293841+0000","last_undegraded":"2024-09-14T10:58:25.293841+0000","last_fullsized":"2024-09-14T10:58:25.293841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.293744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:40.765776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.922943+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:58:19.922943+0000","last_peered":"2024-09-14T10:58:19.922943+0000","last_clean":"2024-09-14T10:58:19.922943+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:58:19.922943+0000","last_undegraded":"2024-09-14T10:58:19.922943+0000","last_fullsized":"2024-09-14T10:58:19.922943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071993+0000","last_change":"2024-09-14T10:55:06.700108+0000","last_active":"2024-09-14T10:58:13.071993+0000","last_peered":"2024-09-14T10:58:13.071993+0000","last_clean":"2024-09-14T10:58:13.071993+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:13.071993+0000","last_undegraded":"2024-09-14T10:58:13.071993+0000","last_fullsized":"2024-09-14T10:58:13.071993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:18.353830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.849928+0000","last_change":"2024-09-14T10:58:27.849928+0000","last_active":"2024-09-14T10:58:27.849928+0000","last_peered":"2024-09-14T10:58:27.849928+0000","last_clean":"2024-09-14T10:58:27.849928+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:58:27.849928+0000","last_undegraded":"2024-09-14T10:58:27.849928+0000","last_fullsized":"2024-09-14T10:58:27.849928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.849846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:39.863957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743711+0000","last_change":"2024-09-14T10:55:08.703801+0000","last_active":"2024-09-14T10:55:41.743711+0000","last_peered":"2024-09-14T10:55:41.743711+0000","last_clean":"2024-09-14T10:55:41.743711+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:55:41.743711+0000","last_undegraded":"2024-09-14T10:55:41.743711+0000","last_fullsized":"2024-09-14T10:55:41.743711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:30.805117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'43","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.951036+0000","last_change":"2024-09-14T10:55:10.711150+0000","last_active":"2024-09-14T10:58:19.951036+0000","last_peered":"2024-09-14T10:58:19.951036+0000","last_clean":"2024-09-14T10:58:19.951036+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:19.951036+0000","last_undegraded":"2024-09-14T10:58:19.951036+0000","last_fullsized":"2024-09-14T10:58:19.951036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.611145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.142295+0000","last_change":"2024-09-14T10:58:38.142295+0000","last_active":"2024-09-14T10:58:38.142295+0000","last_peered":"2024-09-14T10:58:38.142295+0000","last_clean":"2024-09-14T10:58:38.142295+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:58:38.142295+0000","last_undegraded":"2024-09-14T10:58:38.142295+0000","last_fullsized":"2024-09-14T10:58:38.142295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.142187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:18.412057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.853379+0000","last_change":"2024-09-14T10:58:25.853379+0000","last_active":"2024-09-14T10:58:25.853379+0000","last_peered":"2024-09-14T10:58:25.853379+0000","last_clean":"2024-09-14T10:58:25.853379+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:58:25.853379+0000","last_undegraded":"2024-09-14T10:58:25.853379+0000","last_fullsized":"2024-09-14T10:58:25.853379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.853290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.774127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745415+0000","last_change":"2024-09-14T10:55:08.703463+0000","last_active":"2024-09-14T10:55:41.745415+0000","last_peered":"2024-09-14T10:55:41.745415+0000","last_clean":"2024-09-14T10:55:41.745415+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:55:41.745415+0000","last_undegraded":"2024-09-14T10:55:41.745415+0000","last_fullsized":"2024-09-14T10:55:41.745415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:11.948464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.877437+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:58:19.877437+0000","last_peered":"2024-09-14T10:58:19.877437+0000","last_clean":"2024-09-14T10:58:19.877437+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:58:19.877437+0000","last_undegraded":"2024-09-14T10:58:19.877437+0000","last_fullsized":"2024-09-14T10:58:19.877437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.751967+0000","last_change":"2024-09-14T10:58:39.751967+0000","last_active":"2024-09-14T10:58:39.751967+0000","last_peered":"2024-09-14T10:58:39.751967+0000","last_clean":"2024-09-14T10:58:39.751967+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:39.751967+0000","last_undegraded":"2024-09-14T10:58:39.751967+0000","last_fullsized":"2024-09-14T10:58:39.751967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.751871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:01.585910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.126916+0000","last_change":"2024-09-14T10:58:36.126916+0000","last_active":"2024-09-14T10:58:36.126916+0000","last_peered":"2024-09-14T10:58:36.126916+0000","last_clean":"2024-09-14T10:58:36.126916+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:58:36.126916+0000","last_undegraded":"2024-09-14T10:58:36.126916+0000","last_fullsized":"2024-09-14T10:58:36.126916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.126801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.157003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747579+0000","last_change":"2024-09-14T10:55:08.700971+0000","last_active":"2024-09-14T10:55:41.747579+0000","last_peered":"2024-09-14T10:55:41.747579+0000","last_clean":"2024-09-14T10:55:41.747579+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:55:41.747579+0000","last_undegraded":"2024-09-14T10:55:41.747579+0000","last_fullsized":"2024-09-14T10:55:41.747579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:53.973360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.956566+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:58:19.956566+0000","last_peered":"2024-09-14T10:58:19.956566+0000","last_clean":"2024-09-14T10:58:19.956566+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:58:19.956566+0000","last_undegraded":"2024-09-14T10:58:19.956566+0000","last_fullsized":"2024-09-14T10:58:19.956566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.762964+0000","last_change":"2024-09-14T10:58:41.762964+0000","last_active":"2024-09-14T10:58:41.762964+0000","last_peered":"2024-09-14T10:58:41.762964+0000","last_clean":"2024-09-14T10:58:41.762964+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:58:41.762964+0000","last_undegraded":"2024-09-14T10:58:41.762964+0000","last_fullsized":"2024-09-14T10:58:41.762964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.762874+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:35.049658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.164518+0000","last_change":"2024-09-14T10:58:35.164518+0000","last_active":"2024-09-14T10:58:35.164518+0000","last_peered":"2024-09-14T10:58:35.164518+0000","last_clean":"2024-09-14T10:58:35.164518+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:58:35.164518+0000","last_undegraded":"2024-09-14T10:58:35.164518+0000","last_fullsized":"2024-09-14T10:58:35.164518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.164436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:54.849680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:42.082259+0000","last_change":"2024-09-14T10:55:41.752599+0000","last_active":"2024-09-14T10:55:42.082259+0000","last_peered":"2024-09-14T10:55:42.082259+0000","last_clean":"2024-09-14T10:55:42.082259+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:55:42.082259+0000","last_undegraded":"2024-09-14T10:55:42.082259+0000","last_fullsized":"2024-09-14T10:55:42.082259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.961897+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:58:19.961897+0000","last_peered":"2024-09-14T10:58:19.961897+0000","last_clean":"2024-09-14T10:58:19.961897+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:58:19.961897+0000","last_undegraded":"2024-09-14T10:58:19.961897+0000","last_fullsized":"2024-09-14T10:58:19.961897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.145252+0000","last_change":"2024-09-14T10:58:40.145252+0000","last_active":"2024-09-14T10:58:40.145252+0000","last_peered":"2024-09-14T10:58:40.145252+0000","last_clean":"2024-09-14T10:58:40.145252+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:58:40.145252+0000","last_undegraded":"2024-09-14T10:58:40.145252+0000","last_fullsized":"2024-09-14T10:58:40.145252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.145160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:03.438344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.623781+0000","last_change":"2024-09-14T10:58:29.623781+0000","last_active":"2024-09-14T10:58:29.623781+0000","last_peered":"2024-09-14T10:58:29.623781+0000","last_clean":"2024-09-14T10:58:29.623781+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:58:29.623781+0000","last_undegraded":"2024-09-14T10:58:29.623781+0000","last_fullsized":"2024-09-14T10:58:29.623781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.623676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:28.939281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747621+0000","last_change":"2024-09-14T10:55:08.699358+0000","last_active":"2024-09-14T10:55:41.747621+0000","last_peered":"2024-09-14T10:55:41.747621+0000","last_clean":"2024-09-14T10:55:41.747621+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:55:41.747621+0000","last_undegraded":"2024-09-14T10:55:41.747621+0000","last_fullsized":"2024-09-14T10:55:41.747621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:49.250579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.902372+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:19.902372+0000","last_peered":"2024-09-14T10:58:19.902372+0000","last_clean":"2024-09-14T10:58:19.902372+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:19.902372+0000","last_undegraded":"2024-09-14T10:58:19.902372+0000","last_fullsized":"2024-09-14T10:58:19.902372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.270233+0000","last_change":"2024-09-14T10:55:06.701991+0000","last_active":"2024-09-14T10:55:46.270233+0000","last_peered":"2024-09-14T10:55:46.270233+0000","last_clean":"2024-09-14T10:55:46.270233+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:55:46.270233+0000","last_undegraded":"2024-09-14T10:55:46.270233+0000","last_fullsized":"2024-09-14T10:55:46.270233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:45.315445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.141947+0000","last_change":"2024-09-14T10:58:34.141947+0000","last_active":"2024-09-14T10:58:34.141947+0000","last_peered":"2024-09-14T10:58:34.141947+0000","last_clean":"2024-09-14T10:58:34.141947+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:58:34.141947+0000","last_undegraded":"2024-09-14T10:58:34.141947+0000","last_fullsized":"2024-09-14T10:58:34.141947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.141859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:14.978632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746151+0000","last_change":"2024-09-14T10:55:08.703241+0000","last_active":"2024-09-14T10:55:41.746151+0000","last_peered":"2024-09-14T10:55:41.746151+0000","last_clean":"2024-09-14T10:55:41.746151+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:55:41.746151+0000","last_undegraded":"2024-09-14T10:55:41.746151+0000","last_fullsized":"2024-09-14T10:55:41.746151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.686570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'42","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.868210+0000","last_change":"2024-09-14T10:55:10.703424+0000","last_active":"2024-09-14T10:58:19.868210+0000","last_peered":"2024-09-14T10:58:19.868210+0000","last_clean":"2024-09-14T10:58:19.868210+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:58:19.868210+0000","last_undegraded":"2024-09-14T10:58:19.868210+0000","last_fullsized":"2024-09-14T10:58:19.868210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:42.700099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":406,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.817738+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:19.817738+0000","last_peered":"2024-09-14T10:58:19.817738+0000","last_clean":"2024-09-14T10:58:19.817738+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:19.817738+0000","last_undegraded":"2024-09-14T10:58:19.817738+0000","last_fullsized":"2024-09-14T10:58:19.817738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.764524+0000","last_change":"2024-09-14T10:58:40.764524+0000","last_active":"2024-09-14T10:58:40.764524+0000","last_peered":"2024-09-14T10:58:40.764524+0000","last_clean":"2024-09-14T10:58:40.764524+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:40.764524+0000","last_undegraded":"2024-09-14T10:58:40.764524+0000","last_fullsized":"2024-09-14T10:58:40.764524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.764431+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:57.754237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.139853+0000","last_change":"2024-09-14T10:58:33.139853+0000","last_active":"2024-09-14T10:58:33.139853+0000","last_peered":"2024-09-14T10:58:33.139853+0000","last_clean":"2024-09-14T10:58:33.139853+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:58:33.139853+0000","last_undegraded":"2024-09-14T10:58:33.139853+0000","last_fullsized":"2024-09-14T10:58:33.139853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.139755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.454102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.798574+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:58:19.798574+0000","last_peered":"2024-09-14T10:58:19.798574+0000","last_clean":"2024-09-14T10:58:19.798574+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:58:19.798574+0000","last_undegraded":"2024-09-14T10:58:19.798574+0000","last_fullsized":"2024-09-14T10:58:19.798574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":462,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.819049+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:19.819049+0000","last_peered":"2024-09-14T10:58:19.819049+0000","last_clean":"2024-09-14T10:58:19.819049+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:19.819049+0000","last_undegraded":"2024-09-14T10:58:19.819049+0000","last_fullsized":"2024-09-14T10:58:19.819049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:22.097476+0000","last_change":"2024-09-14T10:55:06.706335+0000","last_active":"2024-09-14T10:57:22.097476+0000","last_peered":"2024-09-14T10:57:22.097476+0000","last_clean":"2024-09-14T10:57:22.097476+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:57:22.097476+0000","last_undegraded":"2024-09-14T10:57:22.097476+0000","last_fullsized":"2024-09-14T10:57:22.097476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.143962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.154586+0000","last_change":"2024-09-14T10:58:32.154586+0000","last_active":"2024-09-14T10:58:32.154586+0000","last_peered":"2024-09-14T10:58:32.154586+0000","last_clean":"2024-09-14T10:58:32.154586+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:58:32.154586+0000","last_undegraded":"2024-09-14T10:58:32.154586+0000","last_fullsized":"2024-09-14T10:58:32.154586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.154493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.858878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.941607+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:58:19.941607+0000","last_peered":"2024-09-14T10:58:19.941607+0000","last_clean":"2024-09-14T10:58:19.941607+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:58:19.941607+0000","last_undegraded":"2024-09-14T10:58:19.941607+0000","last_fullsized":"2024-09-14T10:58:19.941607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072341+0000","last_change":"2024-09-14T10:55:06.700492+0000","last_active":"2024-09-14T10:56:29.072341+0000","last_peered":"2024-09-14T10:56:29.072341+0000","last_clean":"2024-09-14T10:56:29.072341+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:56:29.072341+0000","last_undegraded":"2024-09-14T10:56:29.072341+0000","last_fullsized":"2024-09-14T10:56:29.072341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:08.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":158,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.259197+0000","last_change":"2024-09-14T10:58:24.259197+0000","last_active":"2024-09-14T10:58:24.259197+0000","last_peered":"2024-09-14T10:58:24.259197+0000","last_clean":"2024-09-14T10:58:24.259197+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:58:24.259197+0000","last_undegraded":"2024-09-14T10:58:24.259197+0000","last_fullsized":"2024-09-14T10:58:24.259197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.259102+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:48.731970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.055953+0000","last_change":"2024-09-14T10:58:28.055953+0000","last_active":"2024-09-14T10:58:28.055953+0000","last_peered":"2024-09-14T10:58:28.055953+0000","last_clean":"2024-09-14T10:58:28.055953+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:58:28.055953+0000","last_undegraded":"2024-09-14T10:58:28.055953+0000","last_fullsized":"2024-09-14T10:58:28.055953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.055847+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:09.084414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.127641+0000","last_change":"2024-09-14T10:58:30.127641+0000","last_active":"2024-09-14T10:58:30.127641+0000","last_peered":"2024-09-14T10:58:30.127641+0000","last_clean":"2024-09-14T10:58:30.127641+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:30.127641+0000","last_undegraded":"2024-09-14T10:58:30.127641+0000","last_fullsized":"2024-09-14T10:58:30.127641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.127553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.604808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746166+0000","last_change":"2024-09-14T10:55:08.700288+0000","last_active":"2024-09-14T10:55:41.746166+0000","last_peered":"2024-09-14T10:55:41.746166+0000","last_clean":"2024-09-14T10:55:41.746166+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:55:41.746166+0000","last_undegraded":"2024-09-14T10:55:41.746166+0000","last_fullsized":"2024-09-14T10:55:41.746166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:02.043861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.947965+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:58:19.947965+0000","last_peered":"2024-09-14T10:58:19.947965+0000","last_clean":"2024-09-14T10:58:19.947965+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:58:19.947965+0000","last_undegraded":"2024-09-14T10:58:19.947965+0000","last_fullsized":"2024-09-14T10:58:19.947965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971149+0000","last_change":"2024-09-14T10:55:06.692907+0000","last_active":"2024-09-14T10:58:12.971149+0000","last_peered":"2024-09-14T10:58:12.971149+0000","last_clean":"2024-09-14T10:58:12.971149+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:12.971149+0000","last_undegraded":"2024-09-14T10:58:12.971149+0000","last_fullsized":"2024-09-14T10:58:12.971149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:04.228117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.089983+0000","last_change":"2024-09-14T10:58:25.089983+0000","last_active":"2024-09-14T10:58:25.089983+0000","last_peered":"2024-09-14T10:58:25.089983+0000","last_clean":"2024-09-14T10:58:25.089983+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:58:25.089983+0000","last_undegraded":"2024-09-14T10:58:25.089983+0000","last_fullsized":"2024-09-14T10:58:25.089983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:47.106405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.587548+0000","last_change":"2024-09-14T10:58:26.587548+0000","last_active":"2024-09-14T10:58:26.587548+0000","last_peered":"2024-09-14T10:58:26.587548+0000","last_clean":"2024-09-14T10:58:26.587548+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:58:26.587548+0000","last_undegraded":"2024-09-14T10:58:26.587548+0000","last_fullsized":"2024-09-14T10:58:26.587548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.587449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:17.118474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'284","reported_seq":500,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.945814+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:19.945814+0000","last_peered":"2024-09-14T10:58:19.945814+0000","last_clean":"2024-09-14T10:58:19.945814+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:19.945814+0000","last_undegraded":"2024-09-14T10:58:19.945814+0000","last_fullsized":"2024-09-14T10:58:19.945814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.971995+0000","last_change":"2024-09-14T10:55:06.697381+0000","last_active":"2024-09-14T10:58:12.971995+0000","last_peered":"2024-09-14T10:58:12.971995+0000","last_clean":"2024-09-14T10:58:12.971995+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:12.971995+0000","last_undegraded":"2024-09-14T10:58:12.971995+0000","last_fullsized":"2024-09-14T10:58:12.971995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:17.404755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.791275+0000","last_change":"2024-09-14T10:58:23.791275+0000","last_active":"2024-09-14T10:58:23.791275+0000","last_peered":"2024-09-14T10:58:23.791275+0000","last_clean":"2024-09-14T10:58:23.791275+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:58:23.791275+0000","last_undegraded":"2024-09-14T10:58:23.791275+0000","last_fullsized":"2024-09-14T10:58:23.791275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.791189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:54.211244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.586908+0000","last_change":"2024-09-14T10:58:25.586908+0000","last_active":"2024-09-14T10:58:25.586908+0000","last_peered":"2024-09-14T10:58:25.586908+0000","last_clean":"2024-09-14T10:58:25.586908+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:25.586908+0000","last_undegraded":"2024-09-14T10:58:25.586908+0000","last_fullsized":"2024-09-14T10:58:25.586908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.586807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:59.791741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750615+0000","last_change":"2024-09-14T10:55:08.699744+0000","last_active":"2024-09-14T10:55:41.750615+0000","last_peered":"2024-09-14T10:55:41.750615+0000","last_clean":"2024-09-14T10:55:41.750615+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:55:41.750615+0000","last_undegraded":"2024-09-14T10:55:41.750615+0000","last_fullsized":"2024-09-14T10:55:41.750615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:26.469946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:08.787613+0000","last_change":"2024-09-14T10:55:10.711152+0000","last_active":"2024-09-14T10:58:08.787613+0000","last_peered":"2024-09-14T10:58:08.787613+0000","last_clean":"2024-09-14T10:58:08.787613+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:08.787613+0000","last_undegraded":"2024-09-14T10:58:08.787613+0000","last_fullsized":"2024-09-14T10:58:08.787613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:00.848960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.572915+0000","last_change":"2024-09-14T10:58:39.572915+0000","last_active":"2024-09-14T10:58:39.572915+0000","last_peered":"2024-09-14T10:58:39.572915+0000","last_clean":"2024-09-14T10:58:39.572915+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:39.572915+0000","last_undegraded":"2024-09-14T10:58:39.572915+0000","last_fullsized":"2024-09-14T10:58:39.572915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.572821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.045575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.106994+0000","last_change":"2024-09-14T10:58:26.106994+0000","last_active":"2024-09-14T10:58:26.106994+0000","last_peered":"2024-09-14T10:58:26.106994+0000","last_clean":"2024-09-14T10:58:26.106994+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:58:26.106994+0000","last_undegraded":"2024-09-14T10:58:26.106994+0000","last_fullsized":"2024-09-14T10:58:26.106994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.106908+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:54.967192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.820612+0000","last_change":"2024-09-14T10:58:24.820612+0000","last_active":"2024-09-14T10:58:24.820612+0000","last_peered":"2024-09-14T10:58:24.820612+0000","last_clean":"2024-09-14T10:58:24.820612+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:58:24.820612+0000","last_undegraded":"2024-09-14T10:58:24.820612+0000","last_fullsized":"2024-09-14T10:58:24.820612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.820510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:45.492993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747177+0000","last_change":"2024-09-14T10:55:08.697214+0000","last_active":"2024-09-14T10:55:41.747177+0000","last_peered":"2024-09-14T10:55:41.747177+0000","last_clean":"2024-09-14T10:55:41.747177+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:55:41.747177+0000","last_undegraded":"2024-09-14T10:55:41.747177+0000","last_fullsized":"2024-09-14T10:55:41.747177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:19.664634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.173058+0000","last_change":"2024-09-14T10:58:37.173058+0000","last_active":"2024-09-14T10:58:37.173058+0000","last_peered":"2024-09-14T10:58:37.173058+0000","last_clean":"2024-09-14T10:58:37.173058+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:37.173058+0000","last_undegraded":"2024-09-14T10:58:37.173058+0000","last_fullsized":"2024-09-14T10:58:37.173058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.172972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:17.508002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.859668+0000","last_change":"2024-09-14T10:58:26.859668+0000","last_active":"2024-09-14T10:58:26.859668+0000","last_peered":"2024-09-14T10:58:26.859668+0000","last_clean":"2024-09-14T10:58:26.859668+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:58:26.859668+0000","last_undegraded":"2024-09-14T10:58:26.859668+0000","last_fullsized":"2024-09-14T10:58:26.859668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.859576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:53.447405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.568609+0000","last_change":"2024-09-14T10:58:23.568609+0000","last_active":"2024-09-14T10:58:23.568609+0000","last_peered":"2024-09-14T10:58:23.568609+0000","last_clean":"2024-09-14T10:58:23.568609+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:58:23.568609+0000","last_undegraded":"2024-09-14T10:58:23.568609+0000","last_fullsized":"2024-09-14T10:58:23.568609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.568525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:01.283682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.400872+0000","last_change":"2024-09-14T10:55:08.697596+0000","last_active":"2024-09-14T10:58:13.400872+0000","last_peered":"2024-09-14T10:58:13.400872+0000","last_clean":"2024-09-14T10:58:13.400872+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:13.400872+0000","last_undegraded":"2024-09-14T10:58:13.400872+0000","last_fullsized":"2024-09-14T10:58:13.400872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:19.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.116558+0000","last_change":"2024-09-14T10:58:39.116558+0000","last_active":"2024-09-14T10:58:39.116558+0000","last_peered":"2024-09-14T10:58:39.116558+0000","last_clean":"2024-09-14T10:58:39.116558+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:39.116558+0000","last_undegraded":"2024-09-14T10:58:39.116558+0000","last_fullsized":"2024-09-14T10:58:39.116558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.116455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:06.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.594149+0000","last_change":"2024-09-14T10:58:27.594149+0000","last_active":"2024-09-14T10:58:27.594149+0000","last_peered":"2024-09-14T10:58:27.594149+0000","last_clean":"2024-09-14T10:58:27.594149+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:27.594149+0000","last_undegraded":"2024-09-14T10:58:27.594149+0000","last_fullsized":"2024-09-14T10:58:27.594149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.594048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:09.026037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.081564+0000","last_change":"2024-09-14T10:58:27.081564+0000","last_active":"2024-09-14T10:58:27.081564+0000","last_peered":"2024-09-14T10:58:27.081564+0000","last_clean":"2024-09-14T10:58:27.081564+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:58:27.081564+0000","last_undegraded":"2024-09-14T10:58:27.081564+0000","last_fullsized":"2024-09-14T10:58:27.081564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.081459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.815435+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:19.815435+0000","last_peered":"2024-09-14T10:58:19.815435+0000","last_clean":"2024-09-14T10:58:19.815435+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:19.815435+0000","last_undegraded":"2024-09-14T10:58:19.815435+0000","last_fullsized":"2024-09-14T10:58:19.815435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.576048+0000","last_change":"2024-09-14T10:55:06.700418+0000","last_active":"2024-09-14T10:57:12.576048+0000","last_peered":"2024-09-14T10:57:12.576048+0000","last_clean":"2024-09-14T10:57:12.576048+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:57:12.576048+0000","last_undegraded":"2024-09-14T10:57:12.576048+0000","last_fullsized":"2024-09-14T10:57:12.576048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:37.529891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.116581+0000","last_change":"2024-09-14T10:58:31.116581+0000","last_active":"2024-09-14T10:58:31.116581+0000","last_peered":"2024-09-14T10:58:31.116581+0000","last_clean":"2024-09-14T10:58:31.116581+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:58:31.116581+0000","last_undegraded":"2024-09-14T10:58:31.116581+0000","last_fullsized":"2024-09-14T10:58:31.116581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.116494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.643323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.589271+0000","last_change":"2024-09-14T10:58:24.589271+0000","last_active":"2024-09-14T10:58:24.589271+0000","last_peered":"2024-09-14T10:58:24.589271+0000","last_clean":"2024-09-14T10:58:24.589271+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:58:24.589271+0000","last_undegraded":"2024-09-14T10:58:24.589271+0000","last_fullsized":"2024-09-14T10:58:24.589271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.589189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:10.074498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.745965+0000","last_change":"2024-09-14T10:58:38.745965+0000","last_active":"2024-09-14T10:58:38.745965+0000","last_peered":"2024-09-14T10:58:38.745965+0000","last_clean":"2024-09-14T10:58:38.745965+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:38.745965+0000","last_undegraded":"2024-09-14T10:58:38.745965+0000","last_fullsized":"2024-09-14T10:58:38.745965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.745855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.592315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.289652+0000","last_change":"2024-09-14T10:58:26.289652+0000","last_active":"2024-09-14T10:58:26.289652+0000","last_peered":"2024-09-14T10:58:26.289652+0000","last_clean":"2024-09-14T10:58:26.289652+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:58:26.289652+0000","last_undegraded":"2024-09-14T10:58:26.289652+0000","last_fullsized":"2024-09-14T10:58:26.289652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.289566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.279373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.103701+0000","last_change":"2024-09-14T10:58:29.103701+0000","last_active":"2024-09-14T10:58:29.103701+0000","last_peered":"2024-09-14T10:58:29.103701+0000","last_clean":"2024-09-14T10:58:29.103701+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:58:29.103701+0000","last_undegraded":"2024-09-14T10:58:29.103701+0000","last_fullsized":"2024-09-14T10:58:29.103701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.103624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:04.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.788559+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:58:19.788559+0000","last_peered":"2024-09-14T10:58:19.788559+0000","last_clean":"2024-09-14T10:58:19.788559+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:58:19.788559+0000","last_undegraded":"2024-09-14T10:58:19.788559+0000","last_fullsized":"2024-09-14T10:58:19.788559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'93","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.935872+0000","last_change":"2024-09-14T10:55:10.706862+0000","last_active":"2024-09-14T10:58:19.935872+0000","last_peered":"2024-09-14T10:58:19.935872+0000","last_clean":"2024-09-14T10:58:19.935872+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:19.935872+0000","last_undegraded":"2024-09-14T10:58:19.935872+0000","last_fullsized":"2024-09-14T10:58:19.935872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:12.621258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584503+0000","last_change":"2024-09-14T10:55:06.704098+0000","last_active":"2024-09-14T10:57:12.584503+0000","last_peered":"2024-09-14T10:57:12.584503+0000","last_clean":"2024-09-14T10:57:12.584503+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:57:12.584503+0000","last_undegraded":"2024-09-14T10:57:12.584503+0000","last_fullsized":"2024-09-14T10:57:12.584503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:55.761074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.177563+0000","last_change":"2024-09-14T10:58:41.177563+0000","last_active":"2024-09-14T10:58:41.177563+0000","last_peered":"2024-09-14T10:58:41.177563+0000","last_clean":"2024-09-14T10:58:41.177563+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:58:41.177563+0000","last_undegraded":"2024-09-14T10:58:41.177563+0000","last_fullsized":"2024-09-14T10:58:41.177563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.177454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:25.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.755110+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:55:41.755110+0000","last_peered":"2024-09-14T10:55:41.755110+0000","last_clean":"2024-09-14T10:55:41.755110+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:55:41.755110+0000","last_undegraded":"2024-09-14T10:55:41.755110+0000","last_fullsized":"2024-09-14T10:55:41.755110+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:31.114647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.953860+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:58:19.953860+0000","last_peered":"2024-09-14T10:58:19.953860+0000","last_clean":"2024-09-14T10:58:19.953860+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:58:19.953860+0000","last_undegraded":"2024-09-14T10:58:19.953860+0000","last_fullsized":"2024-09-14T10:58:19.953860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:29.072086+0000","last_change":"2024-09-14T10:55:06.706869+0000","last_active":"2024-09-14T10:56:29.072086+0000","last_peered":"2024-09-14T10:56:29.072086+0000","last_clean":"2024-09-14T10:56:29.072086+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:56:29.072086+0000","last_undegraded":"2024-09-14T10:56:29.072086+0000","last_fullsized":"2024-09-14T10:56:29.072086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:29.765849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.775299+0000","last_change":"2024-09-14T10:58:30.775299+0000","last_active":"2024-09-14T10:58:30.775299+0000","last_peered":"2024-09-14T10:58:30.775299+0000","last_clean":"2024-09-14T10:58:30.775299+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:58:30.775299+0000","last_undegraded":"2024-09-14T10:58:30.775299+0000","last_fullsized":"2024-09-14T10:58:30.775299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.775211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:47.614898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255000+0000","last_change":"2024-09-14T10:55:06.693983+0000","last_active":"2024-09-14T10:58:13.255000+0000","last_peered":"2024-09-14T10:58:13.255000+0000","last_clean":"2024-09-14T10:58:13.255000+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:13.255000+0000","last_undegraded":"2024-09-14T10:58:13.255000+0000","last_fullsized":"2024-09-14T10:58:13.255000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:45.880458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.788388+0000","last_change":"2024-09-14T10:58:29.788388+0000","last_active":"2024-09-14T10:58:29.788388+0000","last_peered":"2024-09-14T10:58:29.788388+0000","last_clean":"2024-09-14T10:58:29.788388+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:58:29.788388+0000","last_undegraded":"2024-09-14T10:58:29.788388+0000","last_fullsized":"2024-09-14T10:58:29.788388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.788303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:32.833510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749782+0000","last_change":"2024-09-14T10:55:08.706267+0000","last_active":"2024-09-14T10:55:41.749782+0000","last_peered":"2024-09-14T10:55:41.749782+0000","last_clean":"2024-09-14T10:55:41.749782+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:55:41.749782+0000","last_undegraded":"2024-09-14T10:55:41.749782+0000","last_fullsized":"2024-09-14T10:55:41.749782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:55.090960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:27.098679+0000","last_change":"2024-09-14T10:55:06.700291+0000","last_active":"2024-09-14T10:57:27.098679+0000","last_peered":"2024-09-14T10:57:27.098679+0000","last_clean":"2024-09-14T10:57:27.098679+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:57:27.098679+0000","last_undegraded":"2024-09-14T10:57:27.098679+0000","last_fullsized":"2024-09-14T10:57:27.098679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:17.660782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.206920+0000","last_change":"2024-09-14T10:58:29.206920+0000","last_active":"2024-09-14T10:58:29.206920+0000","last_peered":"2024-09-14T10:58:29.206920+0000","last_clean":"2024-09-14T10:58:29.206920+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:58:29.206920+0000","last_undegraded":"2024-09-14T10:58:29.206920+0000","last_fullsized":"2024-09-14T10:58:29.206920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.206835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:53.545366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.910268+0000","last_change":"2024-09-14T10:55:10.702656+0000","last_active":"2024-09-14T10:58:19.910268+0000","last_peered":"2024-09-14T10:58:19.910268+0000","last_clean":"2024-09-14T10:58:19.910268+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:58:19.910268+0000","last_undegraded":"2024-09-14T10:58:19.910268+0000","last_fullsized":"2024-09-14T10:58:19.910268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:11.852218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.107566+0000","last_change":"2024-09-14T10:58:39.107566+0000","last_active":"2024-09-14T10:58:39.107566+0000","last_peered":"2024-09-14T10:58:39.107566+0000","last_clean":"2024-09-14T10:58:39.107566+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:58:39.107566+0000","last_undegraded":"2024-09-14T10:58:39.107566+0000","last_fullsized":"2024-09-14T10:58:39.107566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.107454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:43.832399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065142+0000","last_change":"2024-09-14T10:55:06.697498+0000","last_active":"2024-09-14T10:58:13.065142+0000","last_peered":"2024-09-14T10:58:13.065142+0000","last_clean":"2024-09-14T10:58:13.065142+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:13.065142+0000","last_undegraded":"2024-09-14T10:58:13.065142+0000","last_fullsized":"2024-09-14T10:58:13.065142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:39.956062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.217001+0000","last_change":"2024-09-14T10:58:28.217001+0000","last_active":"2024-09-14T10:58:28.217001+0000","last_peered":"2024-09-14T10:58:28.217001+0000","last_clean":"2024-09-14T10:58:28.217001+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:58:28.217001+0000","last_undegraded":"2024-09-14T10:58:28.217001+0000","last_fullsized":"2024-09-14T10:58:28.217001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.216899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:59.951004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.751169+0000","last_change":"2024-09-14T10:55:08.699650+0000","last_active":"2024-09-14T10:55:41.751169+0000","last_peered":"2024-09-14T10:55:41.751169+0000","last_clean":"2024-09-14T10:55:41.751169+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:55:41.751169+0000","last_undegraded":"2024-09-14T10:55:41.751169+0000","last_fullsized":"2024-09-14T10:55:41.751169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:29.469388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.913746+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:58:19.913746+0000","last_peered":"2024-09-14T10:58:19.913746+0000","last_clean":"2024-09-14T10:58:19.913746+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:58:19.913746+0000","last_undegraded":"2024-09-14T10:58:19.913746+0000","last_fullsized":"2024-09-14T10:58:19.913746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.239940+0000","last_change":"2024-09-14T10:58:27.239940+0000","last_active":"2024-09-14T10:58:27.239940+0000","last_peered":"2024-09-14T10:58:27.239940+0000","last_clean":"2024-09-14T10:58:27.239940+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:58:27.239940+0000","last_undegraded":"2024-09-14T10:58:27.239940+0000","last_fullsized":"2024-09-14T10:58:27.239940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.239835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:20.526619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746905+0000","last_change":"2024-09-14T10:55:08.696759+0000","last_active":"2024-09-14T10:55:41.746905+0000","last_peered":"2024-09-14T10:55:41.746905+0000","last_clean":"2024-09-14T10:55:41.746905+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:55:41.746905+0000","last_undegraded":"2024-09-14T10:55:41.746905+0000","last_fullsized":"2024-09-14T10:55:41.746905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.250751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'7","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.213430+0000","last_change":"2024-09-14T10:55:06.687522+0000","last_active":"2024-09-14T10:58:13.213430+0000","last_peered":"2024-09-14T10:58:13.213430+0000","last_clean":"2024-09-14T10:58:13.213430+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:13.213430+0000","last_undegraded":"2024-09-14T10:58:13.213430+0000","last_fullsized":"2024-09-14T10:58:13.213430+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:41.424148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.153933+0000","last_change":"2024-09-14T10:58:40.153933+0000","last_active":"2024-09-14T10:58:40.153933+0000","last_peered":"2024-09-14T10:58:40.153933+0000","last_clean":"2024-09-14T10:58:40.153933+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:58:40.153933+0000","last_undegraded":"2024-09-14T10:58:40.153933+0000","last_fullsized":"2024-09-14T10:58:40.153933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.153809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":373,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.813753+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:19.813753+0000","last_peered":"2024-09-14T10:58:19.813753+0000","last_clean":"2024-09-14T10:58:19.813753+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:19.813753+0000","last_undegraded":"2024-09-14T10:58:19.813753+0000","last_fullsized":"2024-09-14T10:58:19.813753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:37.099899+0000","last_change":"2024-09-14T10:55:06.687803+0000","last_active":"2024-09-14T10:57:37.099899+0000","last_peered":"2024-09-14T10:57:37.099899+0000","last_clean":"2024-09-14T10:57:37.099899+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:57:37.099899+0000","last_undegraded":"2024-09-14T10:57:37.099899+0000","last_fullsized":"2024-09-14T10:57:37.099899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:19.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.227452+0000","last_change":"2024-09-14T10:58:30.227452+0000","last_active":"2024-09-14T10:58:30.227452+0000","last_peered":"2024-09-14T10:58:30.227452+0000","last_clean":"2024-09-14T10:58:30.227452+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:30.227452+0000","last_undegraded":"2024-09-14T10:58:30.227452+0000","last_fullsized":"2024-09-14T10:58:30.227452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.227364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:25.413050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.871260+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:58:19.871260+0000","last_peered":"2024-09-14T10:58:19.871260+0000","last_clean":"2024-09-14T10:58:19.871260+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:58:19.871260+0000","last_undegraded":"2024-09-14T10:58:19.871260+0000","last_fullsized":"2024-09-14T10:58:19.871260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.282026+0000","last_change":"2024-09-14T10:55:06.687347+0000","last_active":"2024-09-14T10:58:13.282026+0000","last_peered":"2024-09-14T10:58:13.282026+0000","last_clean":"2024-09-14T10:58:13.282026+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:13.282026+0000","last_undegraded":"2024-09-14T10:58:13.282026+0000","last_fullsized":"2024-09-14T10:58:13.282026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:08.040457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744386+0000","last_change":"2024-09-14T10:55:04.711139+0000","last_active":"2024-09-14T10:55:41.744386+0000","last_peered":"2024-09-14T10:55:41.744386+0000","last_clean":"2024-09-14T10:55:41.744386+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:55:41.744386+0000","last_undegraded":"2024-09-14T10:55:41.744386+0000","last_fullsized":"2024-09-14T10:55:41.744386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.640526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.750062+0000","last_change":"2024-09-14T10:55:08.697330+0000","last_active":"2024-09-14T10:55:41.750062+0000","last_peered":"2024-09-14T10:55:41.750062+0000","last_clean":"2024-09-14T10:55:41.750062+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:55:41.750062+0000","last_undegraded":"2024-09-14T10:55:41.750062+0000","last_fullsized":"2024-09-14T10:55:41.750062+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:21.585707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.261968+0000","last_change":"2024-09-14T10:55:06.701898+0000","last_active":"2024-09-14T10:58:13.261968+0000","last_peered":"2024-09-14T10:58:13.261968+0000","last_clean":"2024-09-14T10:58:13.261968+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:58:13.261968+0000","last_undegraded":"2024-09-14T10:58:13.261968+0000","last_fullsized":"2024-09-14T10:58:13.261968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:01.158624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.633837+0000","last_change":"2024-09-14T10:58:28.633837+0000","last_active":"2024-09-14T10:58:28.633837+0000","last_peered":"2024-09-14T10:58:28.633837+0000","last_clean":"2024-09-14T10:58:28.633837+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:58:28.633837+0000","last_undegraded":"2024-09-14T10:58:28.633837+0000","last_fullsized":"2024-09-14T10:58:28.633837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.633728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:50.487848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749018+0000","last_change":"2024-09-14T10:55:08.705127+0000","last_active":"2024-09-14T10:55:41.749018+0000","last_peered":"2024-09-14T10:55:41.749018+0000","last_clean":"2024-09-14T10:55:41.749018+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:55:41.749018+0000","last_undegraded":"2024-09-14T10:55:41.749018+0000","last_fullsized":"2024-09-14T10:55:41.749018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:13.732662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.959227+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:58:19.959227+0000","last_peered":"2024-09-14T10:58:19.959227+0000","last_clean":"2024-09-14T10:58:19.959227+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:58:19.959227+0000","last_undegraded":"2024-09-14T10:58:19.959227+0000","last_fullsized":"2024-09-14T10:58:19.959227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206948+0000","last_change":"2024-09-14T10:55:06.685023+0000","last_active":"2024-09-14T10:58:13.206948+0000","last_peered":"2024-09-14T10:58:13.206948+0000","last_clean":"2024-09-14T10:58:13.206948+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:13.206948+0000","last_undegraded":"2024-09-14T10:58:13.206948+0000","last_fullsized":"2024-09-14T10:58:13.206948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:34.730948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.187976+0000","last_change":"2024-09-14T10:58:31.187976+0000","last_active":"2024-09-14T10:58:31.187976+0000","last_peered":"2024-09-14T10:58:31.187976+0000","last_clean":"2024-09-14T10:58:31.187976+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:31.187976+0000","last_undegraded":"2024-09-14T10:58:31.187976+0000","last_fullsized":"2024-09-14T10:58:31.187976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.187893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:06.988528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":223,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.789194+0000","last_change":"2024-09-14T10:55:08.704615+0000","last_active":"2024-09-14T10:58:19.789194+0000","last_peered":"2024-09-14T10:58:19.789194+0000","last_clean":"2024-09-14T10:58:19.789194+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:58:19.789194+0000","last_undegraded":"2024-09-14T10:58:19.789194+0000","last_fullsized":"2024-09-14T10:58:19.789194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:58.840952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'35","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.968171+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:19.968171+0000","last_peered":"2024-09-14T10:58:19.968171+0000","last_clean":"2024-09-14T10:58:19.968171+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:19.968171+0000","last_undegraded":"2024-09-14T10:58:19.968171+0000","last_fullsized":"2024-09-14T10:58:19.968171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970449+0000","last_change":"2024-09-14T10:55:06.706262+0000","last_active":"2024-09-14T10:58:12.970449+0000","last_peered":"2024-09-14T10:58:12.970449+0000","last_clean":"2024-09-14T10:58:12.970449+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:12.970449+0000","last_undegraded":"2024-09-14T10:58:12.970449+0000","last_fullsized":"2024-09-14T10:58:12.970449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:47.079971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.769098+0000","last_change":"2024-09-14T10:58:32.769098+0000","last_active":"2024-09-14T10:58:32.769098+0000","last_peered":"2024-09-14T10:58:32.769098+0000","last_clean":"2024-09-14T10:58:32.769098+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:58:32.769098+0000","last_undegraded":"2024-09-14T10:58:32.769098+0000","last_fullsized":"2024-09-14T10:58:32.769098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.768987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:20.659652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.071299+0000","last_change":"2024-09-14T10:55:06.687507+0000","last_active":"2024-09-14T10:58:13.071299+0000","last_peered":"2024-09-14T10:58:13.071299+0000","last_clean":"2024-09-14T10:58:13.071299+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:13.071299+0000","last_undegraded":"2024-09-14T10:58:13.071299+0000","last_fullsized":"2024-09-14T10:58:13.071299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:25.386577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.646671+0000","last_change":"2024-09-14T10:58:30.646671+0000","last_active":"2024-09-14T10:58:30.646671+0000","last_peered":"2024-09-14T10:58:30.646671+0000","last_clean":"2024-09-14T10:58:30.646671+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:58:30.646671+0000","last_undegraded":"2024-09-14T10:58:30.646671+0000","last_fullsized":"2024-09-14T10:58:30.646671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.646582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:28.625565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:45.906651+0000","last_change":"2024-09-14T10:55:04.710926+0000","last_active":"2024-09-14T10:55:45.906651+0000","last_peered":"2024-09-14T10:55:45.906651+0000","last_clean":"2024-09-14T10:55:45.906651+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:55:45.906651+0000","last_undegraded":"2024-09-14T10:55:45.906651+0000","last_fullsized":"2024-09-14T10:55:45.906651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:49.684958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288727+0000","last_change":"2024-09-14T10:55:06.696409+0000","last_active":"2024-09-14T10:58:13.288727+0000","last_peered":"2024-09-14T10:58:13.288727+0000","last_clean":"2024-09-14T10:58:13.288727+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:13.288727+0000","last_undegraded":"2024-09-14T10:58:13.288727+0000","last_fullsized":"2024-09-14T10:58:13.288727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:21.339716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.620545+0000","last_change":"2024-09-14T10:58:31.620545+0000","last_active":"2024-09-14T10:58:31.620545+0000","last_peered":"2024-09-14T10:58:31.620545+0000","last_clean":"2024-09-14T10:58:31.620545+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:31.620545+0000","last_undegraded":"2024-09-14T10:58:31.620545+0000","last_fullsized":"2024-09-14T10:58:31.620545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.620459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.184499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.584098+0000","last_change":"2024-09-14T10:55:06.704099+0000","last_active":"2024-09-14T10:57:12.584098+0000","last_peered":"2024-09-14T10:57:12.584098+0000","last_clean":"2024-09-14T10:57:12.584098+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:57:12.584098+0000","last_undegraded":"2024-09-14T10:57:12.584098+0000","last_fullsized":"2024-09-14T10:57:12.584098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:01:07.392085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.632337+0000","last_change":"2024-09-14T10:58:32.632337+0000","last_active":"2024-09-14T10:58:32.632337+0000","last_peered":"2024-09-14T10:58:32.632337+0000","last_clean":"2024-09-14T10:58:32.632337+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:58:32.632337+0000","last_undegraded":"2024-09-14T10:58:32.632337+0000","last_fullsized":"2024-09-14T10:58:32.632337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.632202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:15.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747700+0000","last_change":"2024-09-14T10:55:06.706855+0000","last_active":"2024-09-14T10:55:41.747700+0000","last_peered":"2024-09-14T10:55:41.747700+0000","last_clean":"2024-09-14T10:55:41.747700+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:55:41.747700+0000","last_undegraded":"2024-09-14T10:55:41.747700+0000","last_fullsized":"2024-09-14T10:55:41.747700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:37.333706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.181486+0000","last_change":"2024-09-14T10:58:33.181486+0000","last_active":"2024-09-14T10:58:33.181486+0000","last_peered":"2024-09-14T10:58:33.181486+0000","last_clean":"2024-09-14T10:58:33.181486+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:58:33.181486+0000","last_undegraded":"2024-09-14T10:58:33.181486+0000","last_fullsized":"2024-09-14T10:58:33.181486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.181378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:00.642621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254690+0000","last_change":"2024-09-14T10:55:06.693603+0000","last_active":"2024-09-14T10:58:13.254690+0000","last_peered":"2024-09-14T10:58:13.254690+0000","last_clean":"2024-09-14T10:58:13.254690+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:13.254690+0000","last_undegraded":"2024-09-14T10:58:13.254690+0000","last_fullsized":"2024-09-14T10:58:13.254690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.667603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.729483+0000","last_change":"2024-09-14T10:58:31.729483+0000","last_active":"2024-09-14T10:58:31.729483+0000","last_peered":"2024-09-14T10:58:31.729483+0000","last_clean":"2024-09-14T10:58:31.729483+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:58:31.729483+0000","last_undegraded":"2024-09-14T10:58:31.729483+0000","last_fullsized":"2024-09-14T10:58:31.729483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.729382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:17.181102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.269807+0000","last_change":"2024-09-14T10:55:06.695095+0000","last_active":"2024-09-14T10:55:46.269807+0000","last_peered":"2024-09-14T10:55:46.269807+0000","last_clean":"2024-09-14T10:55:46.269807+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:55:46.269807+0000","last_undegraded":"2024-09-14T10:55:46.269807+0000","last_fullsized":"2024-09-14T10:55:46.269807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:34.488242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.607227+0000","last_change":"2024-09-14T10:58:33.607227+0000","last_active":"2024-09-14T10:58:33.607227+0000","last_peered":"2024-09-14T10:58:33.607227+0000","last_clean":"2024-09-14T10:58:33.607227+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:58:33.607227+0000","last_undegraded":"2024-09-14T10:58:33.607227+0000","last_fullsized":"2024-09-14T10:58:33.607227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.607100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:52.664954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.063117+0000","last_change":"2024-09-14T10:55:06.701407+0000","last_active":"2024-09-14T10:58:13.063117+0000","last_peered":"2024-09-14T10:58:13.063117+0000","last_clean":"2024-09-14T10:58:13.063117+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:13.063117+0000","last_undegraded":"2024-09-14T10:58:13.063117+0000","last_fullsized":"2024-09-14T10:58:13.063117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:37.860704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741718+0000","last_change":"2024-09-14T10:55:04.710334+0000","last_active":"2024-09-14T10:55:41.741718+0000","last_peered":"2024-09-14T10:55:41.741718+0000","last_clean":"2024-09-14T10:55:41.741718+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:55:41.741718+0000","last_undegraded":"2024-09-14T10:55:41.741718+0000","last_fullsized":"2024-09-14T10:55:41.741718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:10.591594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.649901+0000","last_change":"2024-09-14T10:58:34.649901+0000","last_active":"2024-09-14T10:58:34.649901+0000","last_peered":"2024-09-14T10:58:34.649901+0000","last_clean":"2024-09-14T10:58:34.649901+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:34.649901+0000","last_undegraded":"2024-09-14T10:58:34.649901+0000","last_fullsized":"2024-09-14T10:58:34.649901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.649810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:05.982892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'5","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:25.087198+0000","last_change":"2024-09-14T10:55:41.752889+0000","last_active":"2024-09-14T10:57:25.087198+0000","last_peered":"2024-09-14T10:57:25.087198+0000","last_clean":"2024-09-14T10:57:25.087198+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:57:25.087198+0000","last_undegraded":"2024-09-14T10:57:25.087198+0000","last_fullsized":"2024-09-14T10:57:25.087198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:42.730360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.215888+0000","last_change":"2024-09-14T10:58:32.215888+0000","last_active":"2024-09-14T10:58:32.215888+0000","last_peered":"2024-09-14T10:58:32.215888+0000","last_clean":"2024-09-14T10:58:32.215888+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:58:32.215888+0000","last_undegraded":"2024-09-14T10:58:32.215888+0000","last_fullsized":"2024-09-14T10:58:32.215888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.215791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.585870+0000","last_change":"2024-09-14T10:55:06.693977+0000","last_active":"2024-09-14T10:57:12.585870+0000","last_peered":"2024-09-14T10:57:12.585870+0000","last_clean":"2024-09-14T10:57:12.585870+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:57:12.585870+0000","last_undegraded":"2024-09-14T10:57:12.585870+0000","last_fullsized":"2024-09-14T10:57:12.585870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:37.139323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.123439+0000","last_change":"2024-09-14T10:58:35.123439+0000","last_active":"2024-09-14T10:58:35.123439+0000","last_peered":"2024-09-14T10:58:35.123439+0000","last_clean":"2024-09-14T10:58:35.123439+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:58:35.123439+0000","last_undegraded":"2024-09-14T10:58:35.123439+0000","last_fullsized":"2024-09-14T10:58:35.123439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.123338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:26.005173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.206534+0000","last_change":"2024-09-14T10:55:06.706605+0000","last_active":"2024-09-14T10:58:13.206534+0000","last_peered":"2024-09-14T10:58:13.206534+0000","last_clean":"2024-09-14T10:58:13.206534+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:13.206534+0000","last_undegraded":"2024-09-14T10:58:13.206534+0000","last_fullsized":"2024-09-14T10:58:13.206534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:52.689688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743268+0000","last_change":"2024-09-14T10:55:04.699774+0000","last_active":"2024-09-14T10:55:41.743268+0000","last_peered":"2024-09-14T10:55:41.743268+0000","last_clean":"2024-09-14T10:55:41.743268+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:55:41.743268+0000","last_undegraded":"2024-09-14T10:55:41.743268+0000","last_fullsized":"2024-09-14T10:55:41.743268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:35.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'5","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.288869+0000","last_change":"2024-09-14T10:55:06.699736+0000","last_active":"2024-09-14T10:58:13.288869+0000","last_peered":"2024-09-14T10:58:13.288869+0000","last_clean":"2024-09-14T10:58:13.288869+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:13.288869+0000","last_undegraded":"2024-09-14T10:58:13.288869+0000","last_fullsized":"2024-09-14T10:58:13.288869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.763519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744546+0000","last_change":"2024-09-14T10:55:04.709992+0000","last_active":"2024-09-14T10:55:41.744546+0000","last_peered":"2024-09-14T10:55:41.744546+0000","last_clean":"2024-09-14T10:55:41.744546+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:55:41.744546+0000","last_undegraded":"2024-09-14T10:55:41.744546+0000","last_fullsized":"2024-09-14T10:55:41.744546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:50.555115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.750129+0000","last_change":"2024-09-14T10:58:33.750129+0000","last_active":"2024-09-14T10:58:33.750129+0000","last_peered":"2024-09-14T10:58:33.750129+0000","last_clean":"2024-09-14T10:58:33.750129+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:33.750129+0000","last_undegraded":"2024-09-14T10:58:33.750129+0000","last_fullsized":"2024-09-14T10:58:33.750129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.750046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:41.673497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.254366+0000","last_change":"2024-09-14T10:55:06.695857+0000","last_active":"2024-09-14T10:58:13.254366+0000","last_peered":"2024-09-14T10:58:13.254366+0000","last_clean":"2024-09-14T10:58:13.254366+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:13.254366+0000","last_undegraded":"2024-09-14T10:58:13.254366+0000","last_fullsized":"2024-09-14T10:58:13.254366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.647597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747002+0000","last_change":"2024-09-14T10:55:04.708597+0000","last_active":"2024-09-14T10:55:41.747002+0000","last_peered":"2024-09-14T10:55:41.747002+0000","last_clean":"2024-09-14T10:55:41.747002+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:55:41.747002+0000","last_undegraded":"2024-09-14T10:55:41.747002+0000","last_fullsized":"2024-09-14T10:55:41.747002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:23.371928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742085+0000","last_change":"2024-09-14T10:55:04.710032+0000","last_active":"2024-09-14T10:55:41.742085+0000","last_peered":"2024-09-14T10:55:41.742085+0000","last_clean":"2024-09-14T10:55:41.742085+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:55:41.742085+0000","last_undegraded":"2024-09-14T10:55:41.742085+0000","last_fullsized":"2024-09-14T10:55:41.742085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:03.659190+0000","last_clean_scrub_stamp":"2024-09-14T10:55:03.659190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:53.935014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.970776+0000","last_change":"2024-09-14T10:55:06.697653+0000","last_active":"2024-09-14T10:58:12.970776+0000","last_peered":"2024-09-14T10:58:12.970776+0000","last_clean":"2024-09-14T10:58:12.970776+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:12.970776+0000","last_undegraded":"2024-09-14T10:58:12.970776+0000","last_fullsized":"2024-09-14T10:58:12.970776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:19.133663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.601919+0000","last_change":"2024-09-14T10:58:35.601919+0000","last_active":"2024-09-14T10:58:35.601919+0000","last_peered":"2024-09-14T10:58:35.601919+0000","last_clean":"2024-09-14T10:58:35.601919+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:35.601919+0000","last_undegraded":"2024-09-14T10:58:35.601919+0000","last_fullsized":"2024-09-14T10:58:35.601919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.601827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:44.673365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.289007+0000","last_change":"2024-09-14T10:55:41.753842+0000","last_active":"2024-09-14T10:58:13.289007+0000","last_peered":"2024-09-14T10:58:13.289007+0000","last_clean":"2024-09-14T10:58:13.289007+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:13.289007+0000","last_undegraded":"2024-09-14T10:58:13.289007+0000","last_fullsized":"2024-09-14T10:58:13.289007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:19.903453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640306,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640307,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:58:44.795 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.795 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.795 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.795 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.796 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.797 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.798 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.799 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.800 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.801 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.802 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.803 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.804 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.804 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.804 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.804 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.805 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.806 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.807 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.808 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.809 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.810 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.811 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.812 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.813 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.814 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.815 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.816 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.817 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.818 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:55:03.659190+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.819 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.820 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:58:44.820 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:59:04.821 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf2e60640 1 Processor -- start 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf2e60640 1 -- start start 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf2e60640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cec06fab0 0x7f8cec134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf2e60640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cec070330 con 0x7f8cec06efc0 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf2e60640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f8cec09f310 con 0x7f8cec06fab0 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cebfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cec06fab0 0x7f8cec134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf0bfc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f8cec06efc0 0x7f8cec06f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48592/0 (socket says 172.21.15.116:48592) 2024-09-14T10:59:04.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.935+0000 7f8cf0bfc640 1 -- 172.21.15.116:0/4038383008 learned_addr learned my addr 172.21.15.116:0/4038383008 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:59:04.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.936+0000 7f8cebfff640 1 -- 172.21.15.116:0/4038383008 >> v1:172.21.15.116:6789/0 conn(0x7f8cec06efc0 legacy=0x7f8cec06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:04.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.936+0000 7f8cebfff640 1 -- 172.21.15.116:0/4038383008 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec070640 con 0x7f8cec06fab0 2024-09-14T10:59:04.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.936+0000 7f8cebfff640 1 --2- 172.21.15.116:0/4038383008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06fab0 0x7f8cec134820 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009720 tx=0x7f8cd802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabee6090ae8dc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:04.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8ceb7fe640 1 -- 172.21.15.116:0/4038383008 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd8037070 con 0x7f8cec06fab0 2024-09-14T10:59:04.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8ceb7fe640 1 -- 172.21.15.116:0/4038383008 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd802ad90 con 0x7f8cec06fab0 2024-09-14T10:59:04.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8ceb7fe640 1 -- 172.21.15.116:0/4038383008 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd8032590 con 0x7f8cec06fab0 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 -- 172.21.15.116:0/4038383008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06fab0 msgr2=0x7f8cec134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/4038383008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06fab0 0x7f8cec134820 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009720 tx=0x7f8cd802a110 comp rx=0 tx=0).stop 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 -- 172.21.15.116:0/4038383008 shutdown_connections 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/4038383008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06fab0 0x7f8cec134820 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 -- 172.21.15.116:0/4038383008 >> 172.21.15.116:0/4038383008 conn(0x7f8cec0a2460 msgr2=0x7f8cec09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 -- 172.21.15.116:0/4038383008 shutdown_connections 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.937+0000 7f8cf2e60640 1 -- 172.21.15.116:0/4038383008 wait complete. 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.938+0000 7f8cf2e60640 1 Processor -- start 2024-09-14T10:59:04.937 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.938+0000 7f8cf2e60640 1 -- start start 2024-09-14T10:59:04.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf2e60640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:04.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf2e60640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec134ee0 con 0x7f8cec06efc0 2024-09-14T10:59:04.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf0bfc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf0bfc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60774/0 (socket says 172.21.15.116:60774) 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf0bfc640 1 -- 172.21.15.116:0/1899161868 learned_addr learned my addr 172.21.15.116:0/1899161868 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf0bfc640 1 -- 172.21.15.116:0/1899161868 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec1298f0 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf0bfc640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c480 tx=0x7f8ce000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce0017070 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce0005c10 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ce0007070 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec12b5d0 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.939+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec12c090 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.940+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f8ce001a070 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.940+0000 7f8ce97fa640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 0x7f8cd0040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.940+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f8ce00528f0 con 0x7f8cec06efc0 2024-09-14T10:59:04.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.940+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cec06f3a0 con 0x7f8cec06efc0 2024-09-14T10:59:04.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.941+0000 7f8cebfff640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 0x7f8cd0040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:04.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.941+0000 7f8cebfff640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 0x7f8cd0040a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8034000 tx=0x7f8cd802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:04.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:04.945+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f8ce001ac60 con 0x7f8cec06efc0 2024-09-14T10:59:05.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.116+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cec12a980 con 0x7f8cd003e570 2024-09-14T10:59:05.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.126+0000 7f8ce97fa640 1 -- 172.21.15.116:0/1899161868 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665875 (secure 0 0 0) 0x7f8cd8038040 con 0x7f8cd003e570 2024-09-14T10:59:05.132 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:59:05.137 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:59:05.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 msgr2=0x7f8cd0040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:05.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 0x7f8cd0040a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8034000 tx=0x7f8cd802e000 comp rx=0 tx=0).stop 2024-09-14T10:59:05.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 msgr2=0x7f8cec12bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c480 tx=0x7f8ce000c940 comp rx=0 tx=0).stop 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 shutdown_connections 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f8cd003e570 0x7f8cd0040a30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 --2- 172.21.15.116:0/1899161868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cec06efc0 0x7f8cec12bb50 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 >> 172.21.15.116:0/1899161868 conn(0x7f8cec0a2460 msgr2=0x7f8cec12f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 shutdown_connections 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:05.131+0000 7f8cf2e60640 1 -- 172.21.15.116:0/1899161868 wait complete. 2024-09-14T10:59:05.141 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-14T10:59:04.134954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4615,"ondisk_log_size":4615,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156864,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330496,"statfs":{"total":386547056640,"available":386386427904,"internally_reserved":0,"allocated":3080192,"data_stored":1819780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004546"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.768923+0000","last_change":"2024-09-14T10:58:37.768923+0000","last_active":"2024-09-14T10:58:37.768923+0000","last_peered":"2024-09-14T10:58:37.768923+0000","last_clean":"2024-09-14T10:58:37.768923+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:58:37.768923+0000","last_undegraded":"2024-09-14T10:58:37.768923+0000","last_fullsized":"2024-09-14T10:58:37.768923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.768838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:59.090598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.199300+0000","last_change":"2024-09-14T10:58:55.199300+0000","last_active":"2024-09-14T10:58:55.199300+0000","last_peered":"2024-09-14T10:58:55.199300+0000","last_clean":"2024-09-14T10:58:55.199300+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:58:55.199300+0000","last_undegraded":"2024-09-14T10:58:55.199300+0000","last_fullsized":"2024-09-14T10:58:55.199300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.199194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.549485+0000","last_change":"2024-09-14T10:58:38.549485+0000","last_active":"2024-09-14T10:58:38.549485+0000","last_peered":"2024-09-14T10:58:38.549485+0000","last_clean":"2024-09-14T10:58:38.549485+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:58:38.549485+0000","last_undegraded":"2024-09-14T10:58:38.549485+0000","last_fullsized":"2024-09-14T10:58:38.549485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.549386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.035874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.450785+0000","last_change":"2024-09-14T10:58:52.450785+0000","last_active":"2024-09-14T10:58:52.450785+0000","last_peered":"2024-09-14T10:58:52.450785+0000","last_clean":"2024-09-14T10:58:52.450785+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:58:52.450785+0000","last_undegraded":"2024-09-14T10:58:52.450785+0000","last_fullsized":"2024-09-14T10:58:52.450785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.450685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:49.376289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.232804+0000","last_change":"2024-09-14T10:58:52.232804+0000","last_active":"2024-09-14T10:58:52.232804+0000","last_peered":"2024-09-14T10:58:52.232804+0000","last_clean":"2024-09-14T10:58:52.232804+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:58:52.232804+0000","last_undegraded":"2024-09-14T10:58:52.232804+0000","last_fullsized":"2024-09-14T10:58:52.232804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.232718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:22.618318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743719+0000","last_change":"2024-09-14T10:55:06.702221+0000","last_active":"2024-09-14T10:55:41.743719+0000","last_peered":"2024-09-14T10:55:41.743719+0000","last_clean":"2024-09-14T10:55:41.743719+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:55:41.743719+0000","last_undegraded":"2024-09-14T10:55:41.743719+0000","last_fullsized":"2024-09-14T10:55:41.743719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:42.752848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.746554+0000","last_change":"2024-09-14T10:58:36.746554+0000","last_active":"2024-09-14T10:58:36.746554+0000","last_peered":"2024-09-14T10:58:36.746554+0000","last_clean":"2024-09-14T10:58:36.746554+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:58:36.746554+0000","last_undegraded":"2024-09-14T10:58:36.746554+0000","last_fullsized":"2024-09-14T10:58:36.746554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.746473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:56.987213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.647611+0000","last_change":"2024-09-14T10:58:46.647611+0000","last_active":"2024-09-14T10:58:46.647611+0000","last_peered":"2024-09-14T10:58:46.647611+0000","last_clean":"2024-09-14T10:58:46.647611+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:46.647611+0000","last_undegraded":"2024-09-14T10:58:46.647611+0000","last_fullsized":"2024-09-14T10:58:46.647611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.647534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.998212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.210331+0000","last_change":"2024-09-14T10:58:51.210331+0000","last_active":"2024-09-14T10:58:51.210331+0000","last_peered":"2024-09-14T10:58:51.210331+0000","last_clean":"2024-09-14T10:58:51.210331+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:51.210331+0000","last_undegraded":"2024-09-14T10:58:51.210331+0000","last_fullsized":"2024-09-14T10:58:51.210331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.210239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:23.207843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.157322+0000","last_change":"2024-09-14T10:58:56.157322+0000","last_active":"2024-09-14T10:58:56.157322+0000","last_peered":"2024-09-14T10:58:56.157322+0000","last_clean":"2024-09-14T10:58:56.157322+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:56.157322+0000","last_undegraded":"2024-09-14T10:58:56.157322+0000","last_fullsized":"2024-09-14T10:58:56.157322+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.157235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:11.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.781933+0000","last_change":"2024-09-14T10:58:35.781933+0000","last_active":"2024-09-14T10:58:35.781933+0000","last_peered":"2024-09-14T10:58:35.781933+0000","last_clean":"2024-09-14T10:58:35.781933+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:58:35.781933+0000","last_undegraded":"2024-09-14T10:58:35.781933+0000","last_fullsized":"2024-09-14T10:58:35.781933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.781832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.948433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.578195+0000","last_change":"2024-09-14T10:55:06.700809+0000","last_active":"2024-09-14T10:57:12.578195+0000","last_peered":"2024-09-14T10:57:12.578195+0000","last_clean":"2024-09-14T10:57:12.578195+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:57:12.578195+0000","last_undegraded":"2024-09-14T10:57:12.578195+0000","last_fullsized":"2024-09-14T10:57:12.578195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:31.087026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.229232+0000","last_change":"2024-09-14T10:58:50.229232+0000","last_active":"2024-09-14T10:58:50.229232+0000","last_peered":"2024-09-14T10:58:50.229232+0000","last_clean":"2024-09-14T10:58:50.229232+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:50.229232+0000","last_undegraded":"2024-09-14T10:58:50.229232+0000","last_fullsized":"2024-09-14T10:58:50.229232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.229092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:49.980838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.696483+0000","last_change":"2024-09-14T10:58:49.696483+0000","last_active":"2024-09-14T10:58:49.696483+0000","last_peered":"2024-09-14T10:58:49.696483+0000","last_clean":"2024-09-14T10:58:49.696483+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:58:49.696483+0000","last_undegraded":"2024-09-14T10:58:49.696483+0000","last_fullsized":"2024-09-14T10:58:49.696483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.696365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:27.219012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.557545+0000","last_change":"2024-09-14T10:58:36.557545+0000","last_active":"2024-09-14T10:58:36.557545+0000","last_peered":"2024-09-14T10:58:36.557545+0000","last_clean":"2024-09-14T10:58:36.557545+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:58:36.557545+0000","last_undegraded":"2024-09-14T10:58:36.557545+0000","last_fullsized":"2024-09-14T10:58:36.557545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:19.674856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.655853+0000","last_change":"2024-09-14T10:58:48.655853+0000","last_active":"2024-09-14T10:58:48.655853+0000","last_peered":"2024-09-14T10:58:48.655853+0000","last_clean":"2024-09-14T10:58:48.655853+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:58:48.655853+0000","last_undegraded":"2024-09-14T10:58:48.655853+0000","last_fullsized":"2024-09-14T10:58:48.655853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.655753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:09.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.065537+0000","last_change":"2024-09-14T10:55:06.703713+0000","last_active":"2024-09-14T10:58:13.065537+0000","last_peered":"2024-09-14T10:58:13.065537+0000","last_clean":"2024-09-14T10:58:13.065537+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:58:13.065537+0000","last_undegraded":"2024-09-14T10:58:13.065537+0000","last_fullsized":"2024-09-14T10:58:13.065537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:52.590388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.116444+0000","last_change":"2024-09-14T10:58:41.116444+0000","last_active":"2024-09-14T10:58:41.116444+0000","last_peered":"2024-09-14T10:58:41.116444+0000","last_clean":"2024-09-14T10:58:41.116444+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:41.116444+0000","last_undegraded":"2024-09-14T10:58:41.116444+0000","last_fullsized":"2024-09-14T10:58:41.116444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.116320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.336574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.131032+0000","last_change":"2024-09-14T10:58:52.131032+0000","last_active":"2024-09-14T10:58:52.131032+0000","last_peered":"2024-09-14T10:58:52.131032+0000","last_clean":"2024-09-14T10:58:52.131032+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:52.131032+0000","last_undegraded":"2024-09-14T10:58:52.131032+0000","last_fullsized":"2024-09-14T10:58:52.131032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.130944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:47.420179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.762283+0000","last_change":"2024-09-14T10:58:34.762283+0000","last_active":"2024-09-14T10:58:34.762283+0000","last_peered":"2024-09-14T10:58:34.762283+0000","last_clean":"2024-09-14T10:58:34.762283+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:58:34.762283+0000","last_undegraded":"2024-09-14T10:58:34.762283+0000","last_fullsized":"2024-09-14T10:58:34.762283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.762201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:32.819316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.205330+0000","last_change":"2024-09-14T10:58:54.205330+0000","last_active":"2024-09-14T10:58:54.205330+0000","last_peered":"2024-09-14T10:58:54.205330+0000","last_clean":"2024-09-14T10:58:54.205330+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:58:54.205330+0000","last_undegraded":"2024-09-14T10:58:54.205330+0000","last_fullsized":"2024-09-14T10:58:54.205330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.205219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:44.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.125124+0000","last_change":"2024-09-14T10:58:36.125124+0000","last_active":"2024-09-14T10:58:36.125124+0000","last_peered":"2024-09-14T10:58:36.125124+0000","last_clean":"2024-09-14T10:58:36.125124+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:58:36.125124+0000","last_undegraded":"2024-09-14T10:58:36.125124+0000","last_fullsized":"2024-09-14T10:58:36.125124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.125007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:02.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.433757+0000","last_change":"2024-09-14T10:58:50.433757+0000","last_active":"2024-09-14T10:58:50.433757+0000","last_peered":"2024-09-14T10:58:50.433757+0000","last_clean":"2024-09-14T10:58:50.433757+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:50.433757+0000","last_undegraded":"2024-09-14T10:58:50.433757+0000","last_fullsized":"2024-09-14T10:58:50.433757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.433642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:12.306523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.151676+0000","last_change":"2024-09-14T10:58:34.151676+0000","last_active":"2024-09-14T10:58:34.151676+0000","last_peered":"2024-09-14T10:58:34.151676+0000","last_clean":"2024-09-14T10:58:34.151676+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:58:34.151676+0000","last_undegraded":"2024-09-14T10:58:34.151676+0000","last_fullsized":"2024-09-14T10:58:34.151676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.151591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.433519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.688675+0000","last_change":"2024-09-14T10:58:45.688675+0000","last_active":"2024-09-14T10:58:45.688675+0000","last_peered":"2024-09-14T10:58:45.688675+0000","last_clean":"2024-09-14T10:58:45.688675+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:58:45.688675+0000","last_undegraded":"2024-09-14T10:58:45.688675+0000","last_fullsized":"2024-09-14T10:58:45.688675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.688582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:29.115809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.579906+0000","last_change":"2024-09-14T10:58:37.579906+0000","last_active":"2024-09-14T10:58:37.579906+0000","last_peered":"2024-09-14T10:58:37.579906+0000","last_clean":"2024-09-14T10:58:37.579906+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:58:37.579906+0000","last_undegraded":"2024-09-14T10:58:37.579906+0000","last_fullsized":"2024-09-14T10:58:37.579906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.579809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:06.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.168366+0000","last_change":"2024-09-14T10:58:53.168366+0000","last_active":"2024-09-14T10:58:53.168366+0000","last_peered":"2024-09-14T10:58:53.168366+0000","last_clean":"2024-09-14T10:58:53.168366+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:58:53.168366+0000","last_undegraded":"2024-09-14T10:58:53.168366+0000","last_fullsized":"2024-09-14T10:58:53.168366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.168255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:30.421815+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.259070+0000","last_change":"2024-09-14T10:58:49.259070+0000","last_active":"2024-09-14T10:58:49.259070+0000","last_peered":"2024-09-14T10:58:49.259070+0000","last_clean":"2024-09-14T10:58:49.259070+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:49.259070+0000","last_undegraded":"2024-09-14T10:58:49.259070+0000","last_fullsized":"2024-09-14T10:58:49.259070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.258968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.093328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.304557+0000","last_change":"2024-09-14T10:58:59.304557+0000","last_active":"2024-09-14T10:58:59.304557+0000","last_peered":"2024-09-14T10:58:59.304557+0000","last_clean":"2024-09-14T10:58:59.304557+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:58:59.304557+0000","last_undegraded":"2024-09-14T10:58:59.304557+0000","last_fullsized":"2024-09-14T10:58:59.304557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.304438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.011910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.122467+0000","last_change":"2024-09-14T10:58:38.122467+0000","last_active":"2024-09-14T10:58:38.122467+0000","last_peered":"2024-09-14T10:58:38.122467+0000","last_clean":"2024-09-14T10:58:38.122467+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:58:38.122467+0000","last_undegraded":"2024-09-14T10:58:38.122467+0000","last_fullsized":"2024-09-14T10:58:38.122467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.122377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.370779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743839+0000","last_change":"2024-09-14T10:55:08.703718+0000","last_active":"2024-09-14T10:55:41.743839+0000","last_peered":"2024-09-14T10:55:41.743839+0000","last_clean":"2024-09-14T10:55:41.743839+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:55:41.743839+0000","last_undegraded":"2024-09-14T10:55:41.743839+0000","last_fullsized":"2024-09-14T10:55:41.743839+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:32.258042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.938635+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:58:19.938635+0000","last_peered":"2024-09-14T10:58:19.938635+0000","last_clean":"2024-09-14T10:58:19.938635+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:58:19.938635+0000","last_undegraded":"2024-09-14T10:58:19.938635+0000","last_fullsized":"2024-09-14T10:58:19.938635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748376+0000","last_change":"2024-09-14T10:55:12.714035+0000","last_active":"2024-09-14T10:55:41.748376+0000","last_peered":"2024-09-14T10:55:41.748376+0000","last_clean":"2024-09-14T10:55:41.748376+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:55:41.748376+0000","last_undegraded":"2024-09-14T10:55:41.748376+0000","last_fullsized":"2024-09-14T10:55:41.748376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:17.874035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.341862+0000","last_change":"2024-09-14T10:59:00.341862+0000","last_active":"2024-09-14T10:59:00.341862+0000","last_peered":"2024-09-14T10:59:00.341862+0000","last_clean":"2024-09-14T10:59:00.341862+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:59:00.341862+0000","last_undegraded":"2024-09-14T10:59:00.341862+0000","last_fullsized":"2024-09-14T10:59:00.341862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.341770+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:16.361583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.833117+0000","last_change":"2024-09-14T10:58:28.833117+0000","last_active":"2024-09-14T10:58:28.833117+0000","last_peered":"2024-09-14T10:58:28.833117+0000","last_clean":"2024-09-14T10:58:28.833117+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:58:28.833117+0000","last_undegraded":"2024-09-14T10:58:28.833117+0000","last_fullsized":"2024-09-14T10:58:28.833117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.833024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.803836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.423501+0000","last_change":"2024-09-14T10:58:58.423501+0000","last_active":"2024-09-14T10:58:58.423501+0000","last_peered":"2024-09-14T10:58:58.423501+0000","last_clean":"2024-09-14T10:58:58.423501+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:58:58.423501+0000","last_undegraded":"2024-09-14T10:58:58.423501+0000","last_fullsized":"2024-09-14T10:58:58.423501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.423413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:14.071911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747901+0000","last_change":"2024-09-14T10:55:10.709064+0000","last_active":"2024-09-14T10:55:41.747901+0000","last_peered":"2024-09-14T10:55:41.747901+0000","last_clean":"2024-09-14T10:55:41.747901+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:55:41.747901+0000","last_undegraded":"2024-09-14T10:55:41.747901+0000","last_fullsized":"2024-09-14T10:55:41.747901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:43.820569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745627+0000","last_change":"2024-09-14T10:55:12.718002+0000","last_active":"2024-09-14T10:55:41.745627+0000","last_peered":"2024-09-14T10:55:41.745627+0000","last_clean":"2024-09-14T10:55:41.745627+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:55:41.745627+0000","last_undegraded":"2024-09-14T10:55:41.745627+0000","last_fullsized":"2024-09-14T10:55:41.745627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:46.593275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'7","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:32.099726+0000","last_change":"2024-09-14T10:55:06.700974+0000","last_active":"2024-09-14T10:57:32.099726+0000","last_peered":"2024-09-14T10:57:32.099726+0000","last_clean":"2024-09-14T10:57:32.099726+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:57:32.099726+0000","last_undegraded":"2024-09-14T10:57:32.099726+0000","last_fullsized":"2024-09-14T10:57:32.099726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:48.807562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.134905+0000","last_change":"2024-09-14T10:58:37.134905+0000","last_active":"2024-09-14T10:58:37.134905+0000","last_peered":"2024-09-14T10:58:37.134905+0000","last_clean":"2024-09-14T10:58:37.134905+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:58:37.134905+0000","last_undegraded":"2024-09-14T10:58:37.134905+0000","last_fullsized":"2024-09-14T10:58:37.134905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.134801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:19.758122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.426312+0000","last_change":"2024-09-14T10:58:59.426312+0000","last_active":"2024-09-14T10:58:59.426312+0000","last_peered":"2024-09-14T10:58:59.426312+0000","last_clean":"2024-09-14T10:58:59.426312+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:58:59.426312+0000","last_undegraded":"2024-09-14T10:58:59.426312+0000","last_fullsized":"2024-09-14T10:58:59.426312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.426181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749561+0000","last_change":"2024-09-14T10:55:10.704788+0000","last_active":"2024-09-14T10:55:41.749561+0000","last_peered":"2024-09-14T10:55:41.749561+0000","last_clean":"2024-09-14T10:55:41.749561+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:55:41.749561+0000","last_undegraded":"2024-09-14T10:55:41.749561+0000","last_fullsized":"2024-09-14T10:55:41.749561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:32.813125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":407,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.816667+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:19.816667+0000","last_peered":"2024-09-14T10:58:19.816667+0000","last_clean":"2024-09-14T10:58:19.816667+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:19.816667+0000","last_undegraded":"2024-09-14T10:58:19.816667+0000","last_fullsized":"2024-09-14T10:58:19.816667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.581423+0000","last_change":"2024-09-14T10:55:14.724054+0000","last_active":"2024-09-14T10:57:12.581423+0000","last_peered":"2024-09-14T10:57:12.581423+0000","last_clean":"2024-09-14T10:57:12.581423+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:57:12.581423+0000","last_undegraded":"2024-09-14T10:57:12.581423+0000","last_fullsized":"2024-09-14T10:57:12.581423+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:38.672252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.509476+0000","last_change":"2024-09-14T10:58:42.509476+0000","last_active":"2024-09-14T10:58:42.509476+0000","last_peered":"2024-09-14T10:58:42.509476+0000","last_clean":"2024-09-14T10:58:42.509476+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:58:42.509476+0000","last_undegraded":"2024-09-14T10:58:42.509476+0000","last_fullsized":"2024-09-14T10:58:42.509476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.509389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:30.236260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.293841+0000","last_change":"2024-09-14T10:58:25.293841+0000","last_active":"2024-09-14T10:58:25.293841+0000","last_peered":"2024-09-14T10:58:25.293841+0000","last_clean":"2024-09-14T10:58:25.293841+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:58:25.293841+0000","last_undegraded":"2024-09-14T10:58:25.293841+0000","last_fullsized":"2024-09-14T10:58:25.293841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.293744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:40.765776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744994+0000","last_change":"2024-09-14T10:55:08.702191+0000","last_active":"2024-09-14T10:55:41.744994+0000","last_peered":"2024-09-14T10:55:41.744994+0000","last_clean":"2024-09-14T10:55:41.744994+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:55:41.744994+0000","last_undegraded":"2024-09-14T10:55:41.744994+0000","last_fullsized":"2024-09-14T10:55:41.744994+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:37.673913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.922943+0000","last_change":"2024-09-14T10:55:10.706450+0000","last_active":"2024-09-14T10:58:19.922943+0000","last_peered":"2024-09-14T10:58:19.922943+0000","last_clean":"2024-09-14T10:58:19.922943+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:58:19.922943+0000","last_undegraded":"2024-09-14T10:58:19.922943+0000","last_fullsized":"2024-09-14T10:58:19.922943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:15.740669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":438,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.821509+0000","last_change":"2024-09-14T10:55:12.719737+0000","last_active":"2024-09-14T10:58:19.821509+0000","last_peered":"2024-09-14T10:58:19.821509+0000","last_clean":"2024-09-14T10:58:19.821509+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:58:19.821509+0000","last_undegraded":"2024-09-14T10:58:19.821509+0000","last_fullsized":"2024-09-14T10:58:19.821509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:12.808772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.265017+0000","last_change":"2024-09-14T10:58:57.265017+0000","last_active":"2024-09-14T10:58:57.265017+0000","last_peered":"2024-09-14T10:58:57.265017+0000","last_clean":"2024-09-14T10:58:57.265017+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:57.265017+0000","last_undegraded":"2024-09-14T10:58:57.265017+0000","last_fullsized":"2024-09-14T10:58:57.265017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.264932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.108926+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.849928+0000","last_change":"2024-09-14T10:58:27.849928+0000","last_active":"2024-09-14T10:58:27.849928+0000","last_peered":"2024-09-14T10:58:27.849928+0000","last_clean":"2024-09-14T10:58:27.849928+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:58:27.849928+0000","last_undegraded":"2024-09-14T10:58:27.849928+0000","last_fullsized":"2024-09-14T10:58:27.849928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.849846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:39.863957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.114524+0000","last_change":"2024-09-14T10:58:59.114524+0000","last_active":"2024-09-14T10:58:59.114524+0000","last_peered":"2024-09-14T10:58:59.114524+0000","last_clean":"2024-09-14T10:58:59.114524+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:58:59.114524+0000","last_undegraded":"2024-09-14T10:58:59.114524+0000","last_fullsized":"2024-09-14T10:58:59.114524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.114437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:51.358552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.680885+0000","last_change":"2024-09-14T10:58:59.680885+0000","last_active":"2024-09-14T10:58:59.680885+0000","last_peered":"2024-09-14T10:58:59.680885+0000","last_clean":"2024-09-14T10:58:59.680885+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:59.680885+0000","last_undegraded":"2024-09-14T10:58:59.680885+0000","last_fullsized":"2024-09-14T10:58:59.680885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.680755+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:54.152021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746228+0000","last_change":"2024-09-14T10:55:12.719185+0000","last_active":"2024-09-14T10:55:41.746228+0000","last_peered":"2024-09-14T10:55:41.746228+0000","last_clean":"2024-09-14T10:55:41.746228+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:55:41.746228+0000","last_undegraded":"2024-09-14T10:55:41.746228+0000","last_fullsized":"2024-09-14T10:55:41.746228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:27.555599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.892012+0000","last_change":"2024-09-14T10:55:14.727598+0000","last_active":"2024-09-14T10:56:28.892012+0000","last_peered":"2024-09-14T10:56:28.892012+0000","last_clean":"2024-09-14T10:56:28.892012+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:56:28.892012+0000","last_undegraded":"2024-09-14T10:56:28.892012+0000","last_fullsized":"2024-09-14T10:56:28.892012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:24.011076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.142295+0000","last_change":"2024-09-14T10:58:38.142295+0000","last_active":"2024-09-14T10:58:38.142295+0000","last_peered":"2024-09-14T10:58:38.142295+0000","last_clean":"2024-09-14T10:58:38.142295+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:58:38.142295+0000","last_undegraded":"2024-09-14T10:58:38.142295+0000","last_fullsized":"2024-09-14T10:58:38.142295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.142187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:18.412057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.853379+0000","last_change":"2024-09-14T10:58:25.853379+0000","last_active":"2024-09-14T10:58:25.853379+0000","last_peered":"2024-09-14T10:58:25.853379+0000","last_clean":"2024-09-14T10:58:25.853379+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:58:25.853379+0000","last_undegraded":"2024-09-14T10:58:25.853379+0000","last_fullsized":"2024-09-14T10:58:25.853379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.853290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.774127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.503539+0000","last_change":"2024-09-14T10:58:55.503539+0000","last_active":"2024-09-14T10:58:55.503539+0000","last_peered":"2024-09-14T10:58:55.503539+0000","last_clean":"2024-09-14T10:58:55.503539+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:58:55.503539+0000","last_undegraded":"2024-09-14T10:58:55.503539+0000","last_fullsized":"2024-09-14T10:58:55.503539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.503455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.311229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.877437+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:58:19.877437+0000","last_peered":"2024-09-14T10:58:19.877437+0000","last_clean":"2024-09-14T10:58:19.877437+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:58:19.877437+0000","last_undegraded":"2024-09-14T10:58:19.877437+0000","last_fullsized":"2024-09-14T10:58:19.877437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745110+0000","last_change":"2024-09-14T10:55:12.714335+0000","last_active":"2024-09-14T10:55:41.745110+0000","last_peered":"2024-09-14T10:55:41.745110+0000","last_clean":"2024-09-14T10:55:41.745110+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:55:41.745110+0000","last_undegraded":"2024-09-14T10:55:41.745110+0000","last_fullsized":"2024-09-14T10:55:41.745110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:07.041214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'3","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:23.313124+0000","last_change":"2024-09-14T10:55:14.726675+0000","last_active":"2024-09-14T10:56:23.313124+0000","last_peered":"2024-09-14T10:56:23.313124+0000","last_clean":"2024-09-14T10:56:23.313124+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:56:23.313124+0000","last_undegraded":"2024-09-14T10:56:23.313124+0000","last_fullsized":"2024-09-14T10:56:23.313124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:35.096722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.751967+0000","last_change":"2024-09-14T10:58:39.751967+0000","last_active":"2024-09-14T10:58:39.751967+0000","last_peered":"2024-09-14T10:58:39.751967+0000","last_clean":"2024-09-14T10:58:39.751967+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:39.751967+0000","last_undegraded":"2024-09-14T10:58:39.751967+0000","last_fullsized":"2024-09-14T10:58:39.751967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.751871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:01.585910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.126916+0000","last_change":"2024-09-14T10:58:36.126916+0000","last_active":"2024-09-14T10:58:36.126916+0000","last_peered":"2024-09-14T10:58:36.126916+0000","last_clean":"2024-09-14T10:58:36.126916+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:58:36.126916+0000","last_undegraded":"2024-09-14T10:58:36.126916+0000","last_fullsized":"2024-09-14T10:58:36.126916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.126801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.157003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.468948+0000","last_change":"2024-09-14T10:58:56.468948+0000","last_active":"2024-09-14T10:58:56.468948+0000","last_peered":"2024-09-14T10:58:56.468948+0000","last_clean":"2024-09-14T10:58:56.468948+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:58:56.468948+0000","last_undegraded":"2024-09-14T10:58:56.468948+0000","last_fullsized":"2024-09-14T10:58:56.468948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.468851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:39.048237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.956566+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:58:19.956566+0000","last_peered":"2024-09-14T10:58:19.956566+0000","last_clean":"2024-09-14T10:58:19.956566+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:58:19.956566+0000","last_undegraded":"2024-09-14T10:58:19.956566+0000","last_fullsized":"2024-09-14T10:58:19.956566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.822615+0000","last_change":"2024-09-14T10:55:12.714033+0000","last_active":"2024-09-14T10:58:19.822615+0000","last_peered":"2024-09-14T10:58:19.822615+0000","last_clean":"2024-09-14T10:58:19.822615+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:58:19.822615+0000","last_undegraded":"2024-09-14T10:58:19.822615+0000","last_fullsized":"2024-09-14T10:58:19.822615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:56.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.762964+0000","last_change":"2024-09-14T10:58:41.762964+0000","last_active":"2024-09-14T10:58:41.762964+0000","last_peered":"2024-09-14T10:58:41.762964+0000","last_clean":"2024-09-14T10:58:41.762964+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:58:41.762964+0000","last_undegraded":"2024-09-14T10:58:41.762964+0000","last_fullsized":"2024-09-14T10:58:41.762964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.762874+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:35.049658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.164518+0000","last_change":"2024-09-14T10:58:35.164518+0000","last_active":"2024-09-14T10:58:35.164518+0000","last_peered":"2024-09-14T10:58:35.164518+0000","last_clean":"2024-09-14T10:58:35.164518+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:58:35.164518+0000","last_undegraded":"2024-09-14T10:58:35.164518+0000","last_fullsized":"2024-09-14T10:58:35.164518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.164436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:54.849680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.647837+0000","last_change":"2024-09-14T10:58:50.647837+0000","last_active":"2024-09-14T10:58:50.647837+0000","last_peered":"2024-09-14T10:58:50.647837+0000","last_clean":"2024-09-14T10:58:50.647837+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:58:50.647837+0000","last_undegraded":"2024-09-14T10:58:50.647837+0000","last_fullsized":"2024-09-14T10:58:50.647837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.647749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.851323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.961897+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:58:19.961897+0000","last_peered":"2024-09-14T10:58:19.961897+0000","last_clean":"2024-09-14T10:58:19.961897+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:58:19.961897+0000","last_undegraded":"2024-09-14T10:58:19.961897+0000","last_fullsized":"2024-09-14T10:58:19.961897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745056+0000","last_change":"2024-09-14T10:55:12.717911+0000","last_active":"2024-09-14T10:55:41.745056+0000","last_peered":"2024-09-14T10:55:41.745056+0000","last_clean":"2024-09-14T10:55:41.745056+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:55:41.745056+0000","last_undegraded":"2024-09-14T10:55:41.745056+0000","last_fullsized":"2024-09-14T10:55:41.745056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:09.629081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.145252+0000","last_change":"2024-09-14T10:58:40.145252+0000","last_active":"2024-09-14T10:58:40.145252+0000","last_peered":"2024-09-14T10:58:40.145252+0000","last_clean":"2024-09-14T10:58:40.145252+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:58:40.145252+0000","last_undegraded":"2024-09-14T10:58:40.145252+0000","last_fullsized":"2024-09-14T10:58:40.145252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.145160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:03.438344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.623781+0000","last_change":"2024-09-14T10:58:29.623781+0000","last_active":"2024-09-14T10:58:29.623781+0000","last_peered":"2024-09-14T10:58:29.623781+0000","last_clean":"2024-09-14T10:58:29.623781+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:58:29.623781+0000","last_undegraded":"2024-09-14T10:58:29.623781+0000","last_fullsized":"2024-09-14T10:58:29.623781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.623676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:28.939281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.719508+0000","last_change":"2024-09-14T10:58:57.719508+0000","last_active":"2024-09-14T10:58:57.719508+0000","last_peered":"2024-09-14T10:58:57.719508+0000","last_clean":"2024-09-14T10:58:57.719508+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:58:57.719508+0000","last_undegraded":"2024-09-14T10:58:57.719508+0000","last_fullsized":"2024-09-14T10:58:57.719508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.719407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:05.463897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'38","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.902372+0000","last_change":"2024-09-14T10:55:10.706136+0000","last_active":"2024-09-14T10:58:19.902372+0000","last_peered":"2024-09-14T10:58:19.902372+0000","last_clean":"2024-09-14T10:58:19.902372+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:58:19.902372+0000","last_undegraded":"2024-09-14T10:58:19.902372+0000","last_fullsized":"2024-09-14T10:58:19.902372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:39.452512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.096918+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:57:17.096918+0000","last_peered":"2024-09-14T10:57:17.096918+0000","last_clean":"2024-09-14T10:57:17.096918+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:57:17.096918+0000","last_undegraded":"2024-09-14T10:57:17.096918+0000","last_fullsized":"2024-09-14T10:57:17.096918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:51.223220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.260882+0000","last_change":"2024-09-14T10:58:56.260882+0000","last_active":"2024-09-14T10:58:56.260882+0000","last_peered":"2024-09-14T10:58:56.260882+0000","last_clean":"2024-09-14T10:58:56.260882+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:58:56.260882+0000","last_undegraded":"2024-09-14T10:58:56.260882+0000","last_fullsized":"2024-09-14T10:58:56.260882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.260781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.141947+0000","last_change":"2024-09-14T10:58:34.141947+0000","last_active":"2024-09-14T10:58:34.141947+0000","last_peered":"2024-09-14T10:58:34.141947+0000","last_clean":"2024-09-14T10:58:34.141947+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:58:34.141947+0000","last_undegraded":"2024-09-14T10:58:34.141947+0000","last_fullsized":"2024-09-14T10:58:34.141947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.141859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:14.978632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.429031+0000","last_change":"2024-09-14T10:58:57.429031+0000","last_active":"2024-09-14T10:58:57.429031+0000","last_peered":"2024-09-14T10:58:57.429031+0000","last_clean":"2024-09-14T10:58:57.429031+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:58:57.429031+0000","last_undegraded":"2024-09-14T10:58:57.429031+0000","last_fullsized":"2024-09-14T10:58:57.429031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.428941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:25.714161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'49","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.636564+0000","last_change":"2024-09-14T10:59:00.636564+0000","last_active":"2024-09-14T10:59:00.636564+0000","last_peered":"2024-09-14T10:59:00.636564+0000","last_clean":"2024-09-14T10:59:00.636564+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:59:00.636564+0000","last_undegraded":"2024-09-14T10:59:00.636564+0000","last_fullsized":"2024-09-14T10:59:00.636564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.636458+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.391010+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":406,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.817738+0000","last_change":"2024-09-14T10:55:12.718132+0000","last_active":"2024-09-14T10:58:19.817738+0000","last_peered":"2024-09-14T10:58:19.817738+0000","last_clean":"2024-09-14T10:58:19.817738+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:58:19.817738+0000","last_undegraded":"2024-09-14T10:58:19.817738+0000","last_fullsized":"2024-09-14T10:58:19.817738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:55.319681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'12","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:20.086202+0000","last_change":"2024-09-14T10:55:14.722491+0000","last_active":"2024-09-14T10:57:20.086202+0000","last_peered":"2024-09-14T10:57:20.086202+0000","last_clean":"2024-09-14T10:57:20.086202+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:57:20.086202+0000","last_undegraded":"2024-09-14T10:57:20.086202+0000","last_fullsized":"2024-09-14T10:57:20.086202+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:54.367243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.764524+0000","last_change":"2024-09-14T10:58:40.764524+0000","last_active":"2024-09-14T10:58:40.764524+0000","last_peered":"2024-09-14T10:58:40.764524+0000","last_clean":"2024-09-14T10:58:40.764524+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:40.764524+0000","last_undegraded":"2024-09-14T10:58:40.764524+0000","last_fullsized":"2024-09-14T10:58:40.764524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.764431+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:57.754237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.139853+0000","last_change":"2024-09-14T10:58:33.139853+0000","last_active":"2024-09-14T10:58:33.139853+0000","last_peered":"2024-09-14T10:58:33.139853+0000","last_clean":"2024-09-14T10:58:33.139853+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:58:33.139853+0000","last_undegraded":"2024-09-14T10:58:33.139853+0000","last_fullsized":"2024-09-14T10:58:33.139853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.139755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.454102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.798574+0000","last_change":"2024-09-14T10:55:08.702317+0000","last_active":"2024-09-14T10:58:19.798574+0000","last_peered":"2024-09-14T10:58:19.798574+0000","last_clean":"2024-09-14T10:58:19.798574+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:58:19.798574+0000","last_undegraded":"2024-09-14T10:58:19.798574+0000","last_fullsized":"2024-09-14T10:58:19.798574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:24.578945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":462,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.819049+0000","last_change":"2024-09-14T10:55:12.708520+0000","last_active":"2024-09-14T10:58:19.819049+0000","last_peered":"2024-09-14T10:58:19.819049+0000","last_clean":"2024-09-14T10:58:19.819049+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:58:19.819049+0000","last_undegraded":"2024-09-14T10:58:19.819049+0000","last_fullsized":"2024-09-14T10:58:19.819049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:09.508931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.360149+0000","last_change":"2024-09-14T10:55:14.719528+0000","last_active":"2024-09-14T10:57:12.360149+0000","last_peered":"2024-09-14T10:57:12.360149+0000","last_clean":"2024-09-14T10:57:12.360149+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:57:12.360149+0000","last_undegraded":"2024-09-14T10:57:12.360149+0000","last_fullsized":"2024-09-14T10:57:12.360149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:52.213053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.122287+0000","last_change":"2024-09-14T10:58:42.122287+0000","last_active":"2024-09-14T10:58:42.122287+0000","last_peered":"2024-09-14T10:58:42.122287+0000","last_clean":"2024-09-14T10:58:42.122287+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:58:42.122287+0000","last_undegraded":"2024-09-14T10:58:42.122287+0000","last_fullsized":"2024-09-14T10:58:42.122287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.122178+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:54.680983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.154586+0000","last_change":"2024-09-14T10:58:32.154586+0000","last_active":"2024-09-14T10:58:32.154586+0000","last_peered":"2024-09-14T10:58:32.154586+0000","last_clean":"2024-09-14T10:58:32.154586+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:58:32.154586+0000","last_undegraded":"2024-09-14T10:58:32.154586+0000","last_fullsized":"2024-09-14T10:58:32.154586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.154493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.858878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744454+0000","last_change":"2024-09-14T10:55:08.698663+0000","last_active":"2024-09-14T10:55:41.744454+0000","last_peered":"2024-09-14T10:55:41.744454+0000","last_clean":"2024-09-14T10:55:41.744454+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:55:41.744454+0000","last_undegraded":"2024-09-14T10:55:41.744454+0000","last_fullsized":"2024-09-14T10:55:41.744454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:44.069754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'42","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.941607+0000","last_change":"2024-09-14T10:55:10.705131+0000","last_active":"2024-09-14T10:58:19.941607+0000","last_peered":"2024-09-14T10:58:19.941607+0000","last_clean":"2024-09-14T10:58:19.941607+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:58:19.941607+0000","last_undegraded":"2024-09-14T10:58:19.941607+0000","last_fullsized":"2024-09-14T10:58:19.941607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:35.231424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749232+0000","last_change":"2024-09-14T10:55:12.721413+0000","last_active":"2024-09-14T10:55:41.749232+0000","last_peered":"2024-09-14T10:55:41.749232+0000","last_clean":"2024-09-14T10:55:41.749232+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:55:41.749232+0000","last_undegraded":"2024-09-14T10:55:41.749232+0000","last_fullsized":"2024-09-14T10:55:41.749232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:54.832420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'6","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.313870+0000","last_change":"2024-09-14T10:55:14.723201+0000","last_active":"2024-09-14T10:58:13.313870+0000","last_peered":"2024-09-14T10:58:13.313870+0000","last_clean":"2024-09-14T10:58:13.313870+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:58:13.313870+0000","last_undegraded":"2024-09-14T10:58:13.313870+0000","last_fullsized":"2024-09-14T10:58:13.313870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.270045+0000","last_change":"2024-09-14T10:58:54.270045+0000","last_active":"2024-09-14T10:58:54.270045+0000","last_peered":"2024-09-14T10:58:54.270045+0000","last_clean":"2024-09-14T10:58:54.270045+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:58:54.270045+0000","last_undegraded":"2024-09-14T10:58:54.270045+0000","last_fullsized":"2024-09-14T10:58:54.270045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.269944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:15.040276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.259271+0000","last_change":"2024-09-14T10:58:24.259197+0000","last_active":"2024-09-14T10:58:24.259271+0000","last_peered":"2024-09-14T10:58:24.259271+0000","last_clean":"2024-09-14T10:58:24.259271+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:58:24.259271+0000","last_undegraded":"2024-09-14T10:58:24.259271+0000","last_fullsized":"2024-09-14T10:58:24.259271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.259102+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:48.731970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.056067+0000","last_change":"2024-09-14T10:58:28.055953+0000","last_active":"2024-09-14T10:58:28.056067+0000","last_peered":"2024-09-14T10:58:28.056067+0000","last_clean":"2024-09-14T10:58:28.056067+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:58:28.056067+0000","last_undegraded":"2024-09-14T10:58:28.056067+0000","last_fullsized":"2024-09-14T10:58:28.056067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.055847+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:09.084414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.127641+0000","last_change":"2024-09-14T10:58:30.127641+0000","last_active":"2024-09-14T10:58:30.127641+0000","last_peered":"2024-09-14T10:58:30.127641+0000","last_clean":"2024-09-14T10:58:30.127641+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:30.127641+0000","last_undegraded":"2024-09-14T10:58:30.127641+0000","last_fullsized":"2024-09-14T10:58:30.127641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.127553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.604808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.100923+0000","last_change":"2024-09-14T10:58:58.100923+0000","last_active":"2024-09-14T10:58:58.100923+0000","last_peered":"2024-09-14T10:58:58.100923+0000","last_clean":"2024-09-14T10:58:58.100923+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:58:58.100923+0000","last_undegraded":"2024-09-14T10:58:58.100923+0000","last_fullsized":"2024-09-14T10:58:58.100923+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.100810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:42.350681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.947965+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:58:19.947965+0000","last_peered":"2024-09-14T10:58:19.947965+0000","last_clean":"2024-09-14T10:58:19.947965+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:58:19.947965+0000","last_undegraded":"2024-09-14T10:58:19.947965+0000","last_fullsized":"2024-09-14T10:58:19.947965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746918+0000","last_change":"2024-09-14T10:55:12.714112+0000","last_active":"2024-09-14T10:55:41.746918+0000","last_peered":"2024-09-14T10:55:41.746918+0000","last_clean":"2024-09-14T10:55:41.746918+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:55:41.746918+0000","last_undegraded":"2024-09-14T10:55:41.746918+0000","last_fullsized":"2024-09-14T10:55:41.746918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:57.998950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.291881+0000","last_change":"2024-09-14T10:55:14.721387+0000","last_active":"2024-09-14T10:58:13.291881+0000","last_peered":"2024-09-14T10:58:13.291881+0000","last_clean":"2024-09-14T10:58:13.291881+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:58:13.291881+0000","last_undegraded":"2024-09-14T10:58:13.291881+0000","last_fullsized":"2024-09-14T10:58:13.291881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:26.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.286417+0000","last_change":"2024-09-14T10:58:55.286417+0000","last_active":"2024-09-14T10:58:55.286417+0000","last_peered":"2024-09-14T10:58:55.286417+0000","last_clean":"2024-09-14T10:58:55.286417+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:55.286417+0000","last_undegraded":"2024-09-14T10:58:55.286417+0000","last_fullsized":"2024-09-14T10:58:55.286417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.286296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.817177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.090047+0000","last_change":"2024-09-14T10:58:25.089983+0000","last_active":"2024-09-14T10:58:25.090047+0000","last_peered":"2024-09-14T10:58:25.090047+0000","last_clean":"2024-09-14T10:58:25.090047+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:58:25.090047+0000","last_undegraded":"2024-09-14T10:58:25.090047+0000","last_fullsized":"2024-09-14T10:58:25.090047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:47.106405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.587548+0000","last_change":"2024-09-14T10:58:26.587548+0000","last_active":"2024-09-14T10:58:26.587548+0000","last_peered":"2024-09-14T10:58:26.587548+0000","last_clean":"2024-09-14T10:58:26.587548+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:58:26.587548+0000","last_undegraded":"2024-09-14T10:58:26.587548+0000","last_fullsized":"2024-09-14T10:58:26.587548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.587449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:17.118474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.754236+0000","last_change":"2024-09-14T10:55:41.752669+0000","last_active":"2024-09-14T10:55:41.754236+0000","last_peered":"2024-09-14T10:55:41.754236+0000","last_clean":"2024-09-14T10:55:41.754236+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:55:41.754236+0000","last_undegraded":"2024-09-14T10:55:41.754236+0000","last_fullsized":"2024-09-14T10:55:41.754236+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:26.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'284","reported_seq":500,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.945814+0000","last_change":"2024-09-14T10:55:10.705690+0000","last_active":"2024-09-14T10:58:19.945814+0000","last_peered":"2024-09-14T10:58:19.945814+0000","last_clean":"2024-09-14T10:58:19.945814+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:58:19.945814+0000","last_undegraded":"2024-09-14T10:58:19.945814+0000","last_fullsized":"2024-09-14T10:58:19.945814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:39.703118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742844+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:55:41.742844+0000","last_peered":"2024-09-14T10:55:41.742844+0000","last_clean":"2024-09-14T10:55:41.742844+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:55:41.742844+0000","last_undegraded":"2024-09-14T10:55:41.742844+0000","last_fullsized":"2024-09-14T10:55:41.742844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:16.992474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.258335+0000","last_change":"2024-09-14T10:55:14.727672+0000","last_active":"2024-09-14T10:58:13.258335+0000","last_peered":"2024-09-14T10:58:13.258335+0000","last_clean":"2024-09-14T10:58:13.258335+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:58:13.258335+0000","last_undegraded":"2024-09-14T10:58:13.258335+0000","last_fullsized":"2024-09-14T10:58:13.258335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:28.916048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.557700+0000","last_change":"2024-09-14T10:58:40.557700+0000","last_active":"2024-09-14T10:58:40.557700+0000","last_peered":"2024-09-14T10:58:40.557700+0000","last_clean":"2024-09-14T10:58:40.557700+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:40.557700+0000","last_undegraded":"2024-09-14T10:58:40.557700+0000","last_fullsized":"2024-09-14T10:58:40.557700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.557602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:10.950855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.791361+0000","last_change":"2024-09-14T10:58:23.791275+0000","last_active":"2024-09-14T10:58:23.791361+0000","last_peered":"2024-09-14T10:58:23.791361+0000","last_clean":"2024-09-14T10:58:23.791361+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:58:23.791361+0000","last_undegraded":"2024-09-14T10:58:23.791361+0000","last_fullsized":"2024-09-14T10:58:23.791361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.791189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:54.211244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.586908+0000","last_change":"2024-09-14T10:58:25.586908+0000","last_active":"2024-09-14T10:58:25.586908+0000","last_peered":"2024-09-14T10:58:25.586908+0000","last_clean":"2024-09-14T10:58:25.586908+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:25.586908+0000","last_undegraded":"2024-09-14T10:58:25.586908+0000","last_fullsized":"2024-09-14T10:58:25.586908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.586807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:59.791741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.694574+0000","last_change":"2024-09-14T10:58:51.694574+0000","last_active":"2024-09-14T10:58:51.694574+0000","last_peered":"2024-09-14T10:58:51.694574+0000","last_clean":"2024-09-14T10:58:51.694574+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:58:51.694574+0000","last_undegraded":"2024-09-14T10:58:51.694574+0000","last_fullsized":"2024-09-14T10:58:51.694574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.694493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:32.029523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.678947+0000","last_change":"2024-09-14T10:58:58.678947+0000","last_active":"2024-09-14T10:58:58.678947+0000","last_peered":"2024-09-14T10:58:58.678947+0000","last_clean":"2024-09-14T10:58:58.678947+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:58.678947+0000","last_undegraded":"2024-09-14T10:58:58.678947+0000","last_fullsized":"2024-09-14T10:58:58.678947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.678809+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:42.184294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746632+0000","last_change":"2024-09-14T10:55:12.714391+0000","last_active":"2024-09-14T10:55:41.746632+0000","last_peered":"2024-09-14T10:55:41.746632+0000","last_clean":"2024-09-14T10:55:41.746632+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:55:41.746632+0000","last_undegraded":"2024-09-14T10:55:41.746632+0000","last_fullsized":"2024-09-14T10:55:41.746632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:24.388885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.572915+0000","last_change":"2024-09-14T10:58:39.572915+0000","last_active":"2024-09-14T10:58:39.572915+0000","last_peered":"2024-09-14T10:58:39.572915+0000","last_clean":"2024-09-14T10:58:39.572915+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:39.572915+0000","last_undegraded":"2024-09-14T10:58:39.572915+0000","last_fullsized":"2024-09-14T10:58:39.572915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.572821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.045575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.107071+0000","last_change":"2024-09-14T10:58:26.106994+0000","last_active":"2024-09-14T10:58:26.107071+0000","last_peered":"2024-09-14T10:58:26.107071+0000","last_clean":"2024-09-14T10:58:26.107071+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:58:26.107071+0000","last_undegraded":"2024-09-14T10:58:26.107071+0000","last_fullsized":"2024-09-14T10:58:26.107071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.106908+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:54.967192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.820612+0000","last_change":"2024-09-14T10:58:24.820612+0000","last_active":"2024-09-14T10:58:24.820612+0000","last_peered":"2024-09-14T10:58:24.820612+0000","last_clean":"2024-09-14T10:58:24.820612+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:58:24.820612+0000","last_undegraded":"2024-09-14T10:58:24.820612+0000","last_fullsized":"2024-09-14T10:58:24.820612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.820510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:45.492993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.499067+0000","last_change":"2024-09-14T10:58:54.499067+0000","last_active":"2024-09-14T10:58:54.499067+0000","last_peered":"2024-09-14T10:58:54.499067+0000","last_clean":"2024-09-14T10:58:54.499067+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:58:54.499067+0000","last_undegraded":"2024-09-14T10:58:54.499067+0000","last_fullsized":"2024-09-14T10:58:54.499067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.498961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.100542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.598205+0000","last_change":"2024-09-14T10:55:10.716027+0000","last_active":"2024-09-14T10:58:12.598205+0000","last_peered":"2024-09-14T10:58:12.598205+0000","last_clean":"2024-09-14T10:58:12.598205+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:58:12.598205+0000","last_undegraded":"2024-09-14T10:58:12.598205+0000","last_fullsized":"2024-09-14T10:58:12.598205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:18.233301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.340213+0000","last_change":"2024-09-14T10:55:14.730531+0000","last_active":"2024-09-14T10:57:12.340213+0000","last_peered":"2024-09-14T10:57:12.340213+0000","last_clean":"2024-09-14T10:57:12.340213+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:57:12.340213+0000","last_undegraded":"2024-09-14T10:57:12.340213+0000","last_fullsized":"2024-09-14T10:57:12.340213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:14.163633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.173058+0000","last_change":"2024-09-14T10:58:37.173058+0000","last_active":"2024-09-14T10:58:37.173058+0000","last_peered":"2024-09-14T10:58:37.173058+0000","last_clean":"2024-09-14T10:58:37.173058+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:37.173058+0000","last_undegraded":"2024-09-14T10:58:37.173058+0000","last_fullsized":"2024-09-14T10:58:37.173058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.172972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:17.508002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.859668+0000","last_change":"2024-09-14T10:58:26.859668+0000","last_active":"2024-09-14T10:58:26.859668+0000","last_peered":"2024-09-14T10:58:26.859668+0000","last_clean":"2024-09-14T10:58:26.859668+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:58:26.859668+0000","last_undegraded":"2024-09-14T10:58:26.859668+0000","last_fullsized":"2024-09-14T10:58:26.859668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.859576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:53.447405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.568609+0000","last_change":"2024-09-14T10:58:23.568609+0000","last_active":"2024-09-14T10:58:23.568609+0000","last_peered":"2024-09-14T10:58:23.568609+0000","last_clean":"2024-09-14T10:58:23.568609+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:58:23.568609+0000","last_undegraded":"2024-09-14T10:58:23.568609+0000","last_fullsized":"2024-09-14T10:58:23.568609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.568525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:01.283682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.462273+0000","last_change":"2024-09-14T10:58:53.462273+0000","last_active":"2024-09-14T10:58:53.462273+0000","last_peered":"2024-09-14T10:58:53.462273+0000","last_clean":"2024-09-14T10:58:53.462273+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:53.462273+0000","last_undegraded":"2024-09-14T10:58:53.462273+0000","last_fullsized":"2024-09-14T10:58:53.462273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.462186+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:08.865241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'67","reported_seq":135,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.926285+0000","last_change":"2024-09-14T10:55:10.706454+0000","last_active":"2024-09-14T10:58:19.926285+0000","last_peered":"2024-09-14T10:58:19.926285+0000","last_clean":"2024-09-14T10:58:19.926285+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:58:19.926285+0000","last_undegraded":"2024-09-14T10:58:19.926285+0000","last_fullsized":"2024-09-14T10:58:19.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:09.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747390+0000","last_change":"2024-09-14T10:55:12.717200+0000","last_active":"2024-09-14T10:55:41.747390+0000","last_peered":"2024-09-14T10:55:41.747390+0000","last_clean":"2024-09-14T10:55:41.747390+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:55:41.747390+0000","last_undegraded":"2024-09-14T10:55:41.747390+0000","last_fullsized":"2024-09-14T10:55:41.747390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:22.212722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.116558+0000","last_change":"2024-09-14T10:58:39.116558+0000","last_active":"2024-09-14T10:58:39.116558+0000","last_peered":"2024-09-14T10:58:39.116558+0000","last_clean":"2024-09-14T10:58:39.116558+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:39.116558+0000","last_undegraded":"2024-09-14T10:58:39.116558+0000","last_fullsized":"2024-09-14T10:58:39.116558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.116455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:06.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.594149+0000","last_change":"2024-09-14T10:58:27.594149+0000","last_active":"2024-09-14T10:58:27.594149+0000","last_peered":"2024-09-14T10:58:27.594149+0000","last_clean":"2024-09-14T10:58:27.594149+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:27.594149+0000","last_undegraded":"2024-09-14T10:58:27.594149+0000","last_fullsized":"2024-09-14T10:58:27.594149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.594048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:09.026037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.081677+0000","last_change":"2024-09-14T10:58:27.081564+0000","last_active":"2024-09-14T10:58:27.081677+0000","last_peered":"2024-09-14T10:58:27.081677+0000","last_clean":"2024-09-14T10:58:27.081677+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:58:27.081677+0000","last_undegraded":"2024-09-14T10:58:27.081677+0000","last_fullsized":"2024-09-14T10:58:27.081677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.081459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741959+0000","last_change":"2024-09-14T10:55:08.701668+0000","last_active":"2024-09-14T10:55:41.741959+0000","last_peered":"2024-09-14T10:55:41.741959+0000","last_clean":"2024-09-14T10:55:41.741959+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:55:41.741959+0000","last_undegraded":"2024-09-14T10:55:41.741959+0000","last_fullsized":"2024-09-14T10:55:41.741959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:57.771647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744013+0000","last_change":"2024-09-14T10:55:10.707467+0000","last_active":"2024-09-14T10:55:41.744013+0000","last_peered":"2024-09-14T10:55:41.744013+0000","last_clean":"2024-09-14T10:55:41.744013+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:55:41.744013+0000","last_undegraded":"2024-09-14T10:55:41.744013+0000","last_fullsized":"2024-09-14T10:55:41.744013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.770299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.815435+0000","last_change":"2024-09-14T10:55:12.710088+0000","last_active":"2024-09-14T10:58:19.815435+0000","last_peered":"2024-09-14T10:58:19.815435+0000","last_clean":"2024-09-14T10:58:19.815435+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:58:19.815435+0000","last_undegraded":"2024-09-14T10:58:19.815435+0000","last_fullsized":"2024-09-14T10:58:19.815435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:49.163303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.238709+0000","last_change":"2024-09-14T10:58:53.238709+0000","last_active":"2024-09-14T10:58:53.238709+0000","last_peered":"2024-09-14T10:58:53.238709+0000","last_clean":"2024-09-14T10:58:53.238709+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:58:53.238709+0000","last_undegraded":"2024-09-14T10:58:53.238709+0000","last_fullsized":"2024-09-14T10:58:53.238709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.238622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.890586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.116581+0000","last_change":"2024-09-14T10:58:31.116581+0000","last_active":"2024-09-14T10:58:31.116581+0000","last_peered":"2024-09-14T10:58:31.116581+0000","last_clean":"2024-09-14T10:58:31.116581+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:58:31.116581+0000","last_undegraded":"2024-09-14T10:58:31.116581+0000","last_fullsized":"2024-09-14T10:58:31.116581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.116494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.643323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.589271+0000","last_change":"2024-09-14T10:58:24.589271+0000","last_active":"2024-09-14T10:58:24.589271+0000","last_peered":"2024-09-14T10:58:24.589271+0000","last_clean":"2024-09-14T10:58:24.589271+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:58:24.589271+0000","last_undegraded":"2024-09-14T10:58:24.589271+0000","last_fullsized":"2024-09-14T10:58:24.589271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.589189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:10.074498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745293+0000","last_change":"2024-09-14T10:55:08.703742+0000","last_active":"2024-09-14T10:55:41.745293+0000","last_peered":"2024-09-14T10:55:41.745293+0000","last_clean":"2024-09-14T10:55:41.745293+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:55:41.745293+0000","last_undegraded":"2024-09-14T10:55:41.745293+0000","last_fullsized":"2024-09-14T10:55:41.745293+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:05.740006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743067+0000","last_change":"2024-09-14T10:55:10.715540+0000","last_active":"2024-09-14T10:55:41.743067+0000","last_peered":"2024-09-14T10:55:41.743067+0000","last_clean":"2024-09-14T10:55:41.743067+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:55:41.743067+0000","last_undegraded":"2024-09-14T10:55:41.743067+0000","last_fullsized":"2024-09-14T10:55:41.743067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:57.643964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":392,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.820557+0000","last_change":"2024-09-14T10:55:12.719259+0000","last_active":"2024-09-14T10:58:19.820557+0000","last_peered":"2024-09-14T10:58:19.820557+0000","last_clean":"2024-09-14T10:58:19.820557+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:58:19.820557+0000","last_undegraded":"2024-09-14T10:58:19.820557+0000","last_fullsized":"2024-09-14T10:58:19.820557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:58.390101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.335367+0000","last_change":"2024-09-14T10:55:14.729278+0000","last_active":"2024-09-14T10:58:13.335367+0000","last_peered":"2024-09-14T10:58:13.335367+0000","last_clean":"2024-09-14T10:58:13.335367+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:58:13.335367+0000","last_undegraded":"2024-09-14T10:58:13.335367+0000","last_fullsized":"2024-09-14T10:58:13.335367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:15.988076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.745965+0000","last_change":"2024-09-14T10:58:38.745965+0000","last_active":"2024-09-14T10:58:38.745965+0000","last_peered":"2024-09-14T10:58:38.745965+0000","last_clean":"2024-09-14T10:58:38.745965+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:38.745965+0000","last_undegraded":"2024-09-14T10:58:38.745965+0000","last_fullsized":"2024-09-14T10:58:38.745965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.745855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.592315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.289652+0000","last_change":"2024-09-14T10:58:26.289652+0000","last_active":"2024-09-14T10:58:26.289652+0000","last_peered":"2024-09-14T10:58:26.289652+0000","last_clean":"2024-09-14T10:58:26.289652+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:58:26.289652+0000","last_undegraded":"2024-09-14T10:58:26.289652+0000","last_fullsized":"2024-09-14T10:58:26.289652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.289566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.279373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.103701+0000","last_change":"2024-09-14T10:58:29.103701+0000","last_active":"2024-09-14T10:58:29.103701+0000","last_peered":"2024-09-14T10:58:29.103701+0000","last_clean":"2024-09-14T10:58:29.103701+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:58:29.103701+0000","last_undegraded":"2024-09-14T10:58:29.103701+0000","last_fullsized":"2024-09-14T10:58:29.103701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.103624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:04.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.788559+0000","last_change":"2024-09-14T10:55:08.702914+0000","last_active":"2024-09-14T10:58:19.788559+0000","last_peered":"2024-09-14T10:58:19.788559+0000","last_clean":"2024-09-14T10:58:19.788559+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:58:19.788559+0000","last_undegraded":"2024-09-14T10:58:19.788559+0000","last_fullsized":"2024-09-14T10:58:19.788559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:32.858866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'101","reported_seq":194,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.691503+0000","last_change":"2024-09-14T10:58:56.691503+0000","last_active":"2024-09-14T10:58:56.691503+0000","last_peered":"2024-09-14T10:58:56.691503+0000","last_clean":"2024-09-14T10:58:56.691503+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:56.691503+0000","last_undegraded":"2024-09-14T10:58:56.691503+0000","last_fullsized":"2024-09-14T10:58:56.691503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'101","last_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_deep_scrub":"37'101","last_deep_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.691401+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:40.292482+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745659+0000","last_change":"2024-09-14T10:55:12.717889+0000","last_active":"2024-09-14T10:55:41.745659+0000","last_peered":"2024-09-14T10:55:41.745659+0000","last_clean":"2024-09-14T10:55:41.745659+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:55:41.745659+0000","last_undegraded":"2024-09-14T10:55:41.745659+0000","last_fullsized":"2024-09-14T10:55:41.745659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:00.142764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.749466+0000","last_change":"2024-09-14T10:55:14.722608+0000","last_active":"2024-09-14T10:55:41.749466+0000","last_peered":"2024-09-14T10:55:41.749466+0000","last_clean":"2024-09-14T10:55:41.749466+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:55:41.749466+0000","last_undegraded":"2024-09-14T10:55:41.749466+0000","last_fullsized":"2024-09-14T10:55:41.749466+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:56.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:46.271308+0000","last_change":"2024-09-14T10:55:14.724935+0000","last_active":"2024-09-14T10:55:46.271308+0000","last_peered":"2024-09-14T10:55:46.271308+0000","last_clean":"2024-09-14T10:55:46.271308+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:55:46.271308+0000","last_undegraded":"2024-09-14T10:55:46.271308+0000","last_fullsized":"2024-09-14T10:55:46.271308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:39.344744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.732352+0000","last_change":"2024-09-14T10:58:42.732352+0000","last_active":"2024-09-14T10:58:42.732352+0000","last_peered":"2024-09-14T10:58:42.732352+0000","last_clean":"2024-09-14T10:58:42.732352+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:58:42.732352+0000","last_undegraded":"2024-09-14T10:58:42.732352+0000","last_fullsized":"2024-09-14T10:58:42.732352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.732246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:14.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.177563+0000","last_change":"2024-09-14T10:58:41.177563+0000","last_active":"2024-09-14T10:58:41.177563+0000","last_peered":"2024-09-14T10:58:41.177563+0000","last_clean":"2024-09-14T10:58:41.177563+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:58:41.177563+0000","last_undegraded":"2024-09-14T10:58:41.177563+0000","last_fullsized":"2024-09-14T10:58:41.177563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.177454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:25.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.069060+0000","last_change":"2024-09-14T10:59:00.069060+0000","last_active":"2024-09-14T10:59:00.069060+0000","last_peered":"2024-09-14T10:59:00.069060+0000","last_clean":"2024-09-14T10:59:00.069060+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:59:00.069060+0000","last_undegraded":"2024-09-14T10:59:00.069060+0000","last_fullsized":"2024-09-14T10:59:00.069060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.068976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:01.384012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.953860+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:58:19.953860+0000","last_peered":"2024-09-14T10:58:19.953860+0000","last_clean":"2024-09-14T10:58:19.953860+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:58:19.953860+0000","last_undegraded":"2024-09-14T10:58:19.953860+0000","last_fullsized":"2024-09-14T10:58:19.953860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:10.868869+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:10.868869+0000","last_peered":"2024-09-14T10:57:10.868869+0000","last_clean":"2024-09-14T10:57:10.868869+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:10.868869+0000","last_undegraded":"2024-09-14T10:57:10.868869+0000","last_fullsized":"2024-09-14T10:57:10.868869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:01.727802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.081008+0000","last_change":"2024-09-14T10:58:43.081008+0000","last_active":"2024-09-14T10:58:43.081008+0000","last_peered":"2024-09-14T10:58:43.081008+0000","last_clean":"2024-09-14T10:58:43.081008+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:58:43.081008+0000","last_undegraded":"2024-09-14T10:58:43.081008+0000","last_fullsized":"2024-09-14T10:58:43.081008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.080921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:50.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.775299+0000","last_change":"2024-09-14T10:58:30.775299+0000","last_active":"2024-09-14T10:58:30.775299+0000","last_peered":"2024-09-14T10:58:30.775299+0000","last_clean":"2024-09-14T10:58:30.775299+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:58:30.775299+0000","last_undegraded":"2024-09-14T10:58:30.775299+0000","last_fullsized":"2024-09-14T10:58:30.775299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.775211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:47.614898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.743709+0000","last_change":"2024-09-14T10:55:08.702083+0000","last_active":"2024-09-14T10:55:41.743709+0000","last_peered":"2024-09-14T10:55:41.743709+0000","last_clean":"2024-09-14T10:55:41.743709+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:55:41.743709+0000","last_undegraded":"2024-09-14T10:55:41.743709+0000","last_fullsized":"2024-09-14T10:55:41.743709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:45.635622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'5","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.602955+0000","last_change":"2024-09-14T10:55:10.703686+0000","last_active":"2024-09-14T10:58:12.602955+0000","last_peered":"2024-09-14T10:58:12.602955+0000","last_clean":"2024-09-14T10:58:12.602955+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:58:12.602955+0000","last_undegraded":"2024-09-14T10:58:12.602955+0000","last_fullsized":"2024-09-14T10:58:12.602955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:18.767656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747094+0000","last_change":"2024-09-14T10:55:12.722339+0000","last_active":"2024-09-14T10:55:41.747094+0000","last_peered":"2024-09-14T10:55:41.747094+0000","last_clean":"2024-09-14T10:55:41.747094+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:55:41.747094+0000","last_undegraded":"2024-09-14T10:55:41.747094+0000","last_fullsized":"2024-09-14T10:55:41.747094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:59.198448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.535431+0000","last_change":"2024-09-14T10:58:41.535431+0000","last_active":"2024-09-14T10:58:41.535431+0000","last_peered":"2024-09-14T10:58:41.535431+0000","last_clean":"2024-09-14T10:58:41.535431+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:41.535431+0000","last_undegraded":"2024-09-14T10:58:41.535431+0000","last_fullsized":"2024-09-14T10:58:41.535431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.535348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:23.024244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.788388+0000","last_change":"2024-09-14T10:58:29.788388+0000","last_active":"2024-09-14T10:58:29.788388+0000","last_peered":"2024-09-14T10:58:29.788388+0000","last_clean":"2024-09-14T10:58:29.788388+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:58:29.788388+0000","last_undegraded":"2024-09-14T10:58:29.788388+0000","last_fullsized":"2024-09-14T10:58:29.788388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.788303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:32.833510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.684626+0000","last_change":"2024-09-14T10:58:52.684626+0000","last_active":"2024-09-14T10:58:52.684626+0000","last_peered":"2024-09-14T10:58:52.684626+0000","last_clean":"2024-09-14T10:58:52.684626+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:58:52.684626+0000","last_undegraded":"2024-09-14T10:58:52.684626+0000","last_fullsized":"2024-09-14T10:58:52.684626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.684528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.491610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'43","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.919871+0000","last_change":"2024-09-14T10:55:10.704610+0000","last_active":"2024-09-14T10:58:19.919871+0000","last_peered":"2024-09-14T10:58:19.919871+0000","last_clean":"2024-09-14T10:58:19.919871+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:58:19.919871+0000","last_undegraded":"2024-09-14T10:58:19.919871+0000","last_fullsized":"2024-09-14T10:58:19.919871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:29.197940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744729+0000","last_change":"2024-09-14T10:55:12.714708+0000","last_active":"2024-09-14T10:55:41.744729+0000","last_peered":"2024-09-14T10:55:41.744729+0000","last_clean":"2024-09-14T10:55:41.744729+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:55:41.744729+0000","last_undegraded":"2024-09-14T10:55:41.744729+0000","last_fullsized":"2024-09-14T10:55:41.744729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:22.003863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.289056+0000","last_change":"2024-09-14T10:58:58.289056+0000","last_active":"2024-09-14T10:58:58.289056+0000","last_peered":"2024-09-14T10:58:58.289056+0000","last_clean":"2024-09-14T10:58:58.289056+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:58:58.289056+0000","last_undegraded":"2024-09-14T10:58:58.289056+0000","last_fullsized":"2024-09-14T10:58:58.289056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.288955+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.787124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.206920+0000","last_change":"2024-09-14T10:58:29.206920+0000","last_active":"2024-09-14T10:58:29.206920+0000","last_peered":"2024-09-14T10:58:29.206920+0000","last_clean":"2024-09-14T10:58:29.206920+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:58:29.206920+0000","last_undegraded":"2024-09-14T10:58:29.206920+0000","last_fullsized":"2024-09-14T10:58:29.206920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.206835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:53.545366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741607+0000","last_change":"2024-09-14T10:55:08.698866+0000","last_active":"2024-09-14T10:55:41.741607+0000","last_peered":"2024-09-14T10:55:41.741607+0000","last_clean":"2024-09-14T10:55:41.741607+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:55:41.741607+0000","last_undegraded":"2024-09-14T10:55:41.741607+0000","last_fullsized":"2024-09-14T10:55:41.741607+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:24.988260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.665776+0000","last_change":"2024-09-14T10:59:01.665776+0000","last_active":"2024-09-14T10:59:01.665776+0000","last_peered":"2024-09-14T10:59:01.665776+0000","last_clean":"2024-09-14T10:59:01.665776+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:59:01.665776+0000","last_undegraded":"2024-09-14T10:59:01.665776+0000","last_fullsized":"2024-09-14T10:59:01.665776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.665619+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:22.301986+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745753+0000","last_change":"2024-09-14T10:55:12.718612+0000","last_active":"2024-09-14T10:55:41.745753+0000","last_peered":"2024-09-14T10:55:41.745753+0000","last_clean":"2024-09-14T10:55:41.745753+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:55:41.745753+0000","last_undegraded":"2024-09-14T10:55:41.745753+0000","last_fullsized":"2024-09-14T10:55:41.745753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:26.230882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:47.043576+0000","last_change":"2024-09-14T10:55:06.688519+0000","last_active":"2024-09-14T10:55:47.043576+0000","last_peered":"2024-09-14T10:55:47.043576+0000","last_clean":"2024-09-14T10:55:47.043576+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:55:47.043576+0000","last_undegraded":"2024-09-14T10:55:47.043576+0000","last_fullsized":"2024-09-14T10:55:47.043576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:26.167673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.107566+0000","last_change":"2024-09-14T10:58:39.107566+0000","last_active":"2024-09-14T10:58:39.107566+0000","last_peered":"2024-09-14T10:58:39.107566+0000","last_clean":"2024-09-14T10:58:39.107566+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:58:39.107566+0000","last_undegraded":"2024-09-14T10:58:39.107566+0000","last_fullsized":"2024-09-14T10:58:39.107566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.107454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:43.832399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748489+0000","last_change":"2024-09-14T10:55:08.697138+0000","last_active":"2024-09-14T10:55:41.748489+0000","last_peered":"2024-09-14T10:55:41.748489+0000","last_clean":"2024-09-14T10:55:41.748489+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:55:41.748489+0000","last_undegraded":"2024-09-14T10:55:41.748489+0000","last_fullsized":"2024-09-14T10:55:41.748489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:08.563729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.971352+0000","last_change":"2024-09-14T10:55:10.703682+0000","last_active":"2024-09-14T10:58:19.971352+0000","last_peered":"2024-09-14T10:58:19.971352+0000","last_clean":"2024-09-14T10:58:19.971352+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:58:19.971352+0000","last_undegraded":"2024-09-14T10:58:19.971352+0000","last_fullsized":"2024-09-14T10:58:19.971352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:15.040362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746578+0000","last_change":"2024-09-14T10:55:12.718683+0000","last_active":"2024-09-14T10:55:41.746578+0000","last_peered":"2024-09-14T10:55:41.746578+0000","last_clean":"2024-09-14T10:55:41.746578+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:55:41.746578+0000","last_undegraded":"2024-09-14T10:55:41.746578+0000","last_fullsized":"2024-09-14T10:55:41.746578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:56.086565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.518493+0000","last_change":"2024-09-14T10:58:43.518493+0000","last_active":"2024-09-14T10:58:43.518493+0000","last_peered":"2024-09-14T10:58:43.518493+0000","last_clean":"2024-09-14T10:58:43.518493+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:43.518493+0000","last_undegraded":"2024-09-14T10:58:43.518493+0000","last_fullsized":"2024-09-14T10:58:43.518493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.518393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:29.224226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.217001+0000","last_change":"2024-09-14T10:58:28.217001+0000","last_active":"2024-09-14T10:58:28.217001+0000","last_peered":"2024-09-14T10:58:28.217001+0000","last_clean":"2024-09-14T10:58:28.217001+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:58:28.217001+0000","last_undegraded":"2024-09-14T10:58:28.217001+0000","last_fullsized":"2024-09-14T10:58:28.217001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.216899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:59.951004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.664147+0000","last_change":"2024-09-14T10:58:54.664147+0000","last_active":"2024-09-14T10:58:54.664147+0000","last_peered":"2024-09-14T10:58:54.664147+0000","last_clean":"2024-09-14T10:58:54.664147+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:58:54.664147+0000","last_undegraded":"2024-09-14T10:58:54.664147+0000","last_fullsized":"2024-09-14T10:58:54.664147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.664065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:15.688027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.913746+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:58:19.913746+0000","last_peered":"2024-09-14T10:58:19.913746+0000","last_clean":"2024-09-14T10:58:19.913746+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:58:19.913746+0000","last_undegraded":"2024-09-14T10:58:19.913746+0000","last_fullsized":"2024-09-14T10:58:19.913746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745245+0000","last_change":"2024-09-14T10:55:12.719860+0000","last_active":"2024-09-14T10:55:41.745245+0000","last_peered":"2024-09-14T10:55:41.745245+0000","last_clean":"2024-09-14T10:55:41.745245+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:55:41.745245+0000","last_undegraded":"2024-09-14T10:55:41.745245+0000","last_fullsized":"2024-09-14T10:55:41.745245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:37.337531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.255041+0000","last_change":"2024-09-14T10:55:06.701135+0000","last_active":"2024-09-14T10:58:13.255041+0000","last_peered":"2024-09-14T10:58:13.255041+0000","last_clean":"2024-09-14T10:58:13.255041+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:58:13.255041+0000","last_undegraded":"2024-09-14T10:58:13.255041+0000","last_fullsized":"2024-09-14T10:58:13.255041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:36.262023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.239940+0000","last_change":"2024-09-14T10:58:27.239940+0000","last_active":"2024-09-14T10:58:27.239940+0000","last_peered":"2024-09-14T10:58:27.239940+0000","last_clean":"2024-09-14T10:58:27.239940+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:58:27.239940+0000","last_undegraded":"2024-09-14T10:58:27.239940+0000","last_fullsized":"2024-09-14T10:58:27.239940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.239835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:20.526619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.649814+0000","last_change":"2024-09-14T10:58:53.649814+0000","last_active":"2024-09-14T10:58:53.649814+0000","last_peered":"2024-09-14T10:58:53.649814+0000","last_clean":"2024-09-14T10:58:53.649814+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:58:53.649814+0000","last_undegraded":"2024-09-14T10:58:53.649814+0000","last_fullsized":"2024-09-14T10:58:53.649814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.649710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:50.909366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.965137+0000","last_change":"2024-09-14T10:55:10.712965+0000","last_active":"2024-09-14T10:58:19.965137+0000","last_peered":"2024-09-14T10:58:19.965137+0000","last_clean":"2024-09-14T10:58:19.965137+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:58:19.965137+0000","last_undegraded":"2024-09-14T10:58:19.965137+0000","last_fullsized":"2024-09-14T10:58:19.965137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:38.763076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746877+0000","last_change":"2024-09-14T10:55:12.718090+0000","last_active":"2024-09-14T10:55:41.746877+0000","last_peered":"2024-09-14T10:55:41.746877+0000","last_clean":"2024-09-14T10:55:41.746877+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:55:41.746877+0000","last_undegraded":"2024-09-14T10:55:41.746877+0000","last_fullsized":"2024-09-14T10:55:41.746877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:02.346415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.487050+0000","last_change":"2024-09-14T10:58:44.487050+0000","last_active":"2024-09-14T10:58:44.487050+0000","last_peered":"2024-09-14T10:58:44.487050+0000","last_clean":"2024-09-14T10:58:44.487050+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:44.487050+0000","last_undegraded":"2024-09-14T10:58:44.487050+0000","last_fullsized":"2024-09-14T10:58:44.487050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.486941+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:33.241927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.153933+0000","last_change":"2024-09-14T10:58:40.153933+0000","last_active":"2024-09-14T10:58:40.153933+0000","last_peered":"2024-09-14T10:58:40.153933+0000","last_clean":"2024-09-14T10:58:40.153933+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:58:40.153933+0000","last_undegraded":"2024-09-14T10:58:40.153933+0000","last_fullsized":"2024-09-14T10:58:40.153933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.153809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.748234+0000","last_change":"2024-09-14T10:55:08.701365+0000","last_active":"2024-09-14T10:55:41.748234+0000","last_peered":"2024-09-14T10:55:41.748234+0000","last_clean":"2024-09-14T10:55:41.748234+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:55:41.748234+0000","last_undegraded":"2024-09-14T10:55:41.748234+0000","last_fullsized":"2024-09-14T10:55:41.748234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:46.053285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744141+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:55:41.744141+0000","last_peered":"2024-09-14T10:55:41.744141+0000","last_clean":"2024-09-14T10:55:41.744141+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:55:41.744141+0000","last_undegraded":"2024-09-14T10:55:41.744141+0000","last_fullsized":"2024-09-14T10:55:41.744141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:36.273783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":373,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.813753+0000","last_change":"2024-09-14T10:55:12.721511+0000","last_active":"2024-09-14T10:58:19.813753+0000","last_peered":"2024-09-14T10:58:19.813753+0000","last_clean":"2024-09-14T10:58:19.813753+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:58:19.813753+0000","last_undegraded":"2024-09-14T10:58:19.813753+0000","last_fullsized":"2024-09-14T10:58:19.813753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:32.873529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.766566+0000","last_change":"2024-09-14T10:58:43.766566+0000","last_active":"2024-09-14T10:58:43.766566+0000","last_peered":"2024-09-14T10:58:43.766566+0000","last_clean":"2024-09-14T10:58:43.766566+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:58:43.766566+0000","last_undegraded":"2024-09-14T10:58:43.766566+0000","last_fullsized":"2024-09-14T10:58:43.766566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.766463+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:32.340255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.227452+0000","last_change":"2024-09-14T10:58:30.227452+0000","last_active":"2024-09-14T10:58:30.227452+0000","last_peered":"2024-09-14T10:58:30.227452+0000","last_clean":"2024-09-14T10:58:30.227452+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:30.227452+0000","last_undegraded":"2024-09-14T10:58:30.227452+0000","last_fullsized":"2024-09-14T10:58:30.227452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.227364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:25.413050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.747551+0000","last_change":"2024-09-14T10:55:08.701691+0000","last_active":"2024-09-14T10:55:41.747551+0000","last_peered":"2024-09-14T10:55:41.747551+0000","last_clean":"2024-09-14T10:55:41.747551+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:55:41.747551+0000","last_undegraded":"2024-09-14T10:55:41.747551+0000","last_fullsized":"2024-09-14T10:55:41.747551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:07.677947+0000","last_clean_scrub_stamp":"2024-09-14T10:55:07.677947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:40.692091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.871260+0000","last_change":"2024-09-14T10:55:10.704594+0000","last_active":"2024-09-14T10:58:19.871260+0000","last_peered":"2024-09-14T10:58:19.871260+0000","last_clean":"2024-09-14T10:58:19.871260+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:58:19.871260+0000","last_undegraded":"2024-09-14T10:58:19.871260+0000","last_fullsized":"2024-09-14T10:58:19.871260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:30.185125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.744872+0000","last_change":"2024-09-14T10:55:12.714653+0000","last_active":"2024-09-14T10:55:41.744872+0000","last_peered":"2024-09-14T10:55:41.744872+0000","last_clean":"2024-09-14T10:55:41.744872+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:55:41.744872+0000","last_undegraded":"2024-09-14T10:55:41.744872+0000","last_fullsized":"2024-09-14T10:55:41.744872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:42.690657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.735243+0000","last_change":"2024-09-14T10:58:44.735243+0000","last_active":"2024-09-14T10:58:44.735243+0000","last_peered":"2024-09-14T10:58:44.735243+0000","last_clean":"2024-09-14T10:58:44.735243+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:44.735243+0000","last_undegraded":"2024-09-14T10:58:44.735243+0000","last_fullsized":"2024-09-14T10:58:44.735243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.735157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:39.920842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.246127+0000","last_change":"2024-09-14T10:58:43.246127+0000","last_active":"2024-09-14T10:58:43.246127+0000","last_peered":"2024-09-14T10:58:43.246127+0000","last_clean":"2024-09-14T10:58:43.246127+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:58:43.246127+0000","last_undegraded":"2024-09-14T10:58:43.246127+0000","last_fullsized":"2024-09-14T10:58:43.246127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.246039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.703082+0000","last_change":"2024-09-14T10:58:55.703082+0000","last_active":"2024-09-14T10:58:55.703082+0000","last_peered":"2024-09-14T10:58:55.703082+0000","last_clean":"2024-09-14T10:58:55.703082+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:58:55.703082+0000","last_undegraded":"2024-09-14T10:58:55.703082+0000","last_fullsized":"2024-09-14T10:58:55.703082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.702997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:50.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.874352+0000","last_change":"2024-09-14T10:55:10.706555+0000","last_active":"2024-09-14T10:58:19.874352+0000","last_peered":"2024-09-14T10:58:19.874352+0000","last_clean":"2024-09-14T10:58:19.874352+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:58:19.874352+0000","last_undegraded":"2024-09-14T10:58:19.874352+0000","last_fullsized":"2024-09-14T10:58:19.874352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:13.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.309250+0000","last_change":"2024-09-14T10:59:01.309250+0000","last_active":"2024-09-14T10:59:01.309250+0000","last_peered":"2024-09-14T10:59:01.309250+0000","last_clean":"2024-09-14T10:59:01.309250+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:59:01.309250+0000","last_undegraded":"2024-09-14T10:59:01.309250+0000","last_fullsized":"2024-09-14T10:59:01.309250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.309130+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.220911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.633837+0000","last_change":"2024-09-14T10:58:28.633837+0000","last_active":"2024-09-14T10:58:28.633837+0000","last_peered":"2024-09-14T10:58:28.633837+0000","last_clean":"2024-09-14T10:58:28.633837+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:58:28.633837+0000","last_undegraded":"2024-09-14T10:58:28.633837+0000","last_fullsized":"2024-09-14T10:58:28.633837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.633728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:50.487848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.057121+0000","last_change":"2024-09-14T10:59:02.057121+0000","last_active":"2024-09-14T10:59:02.057121+0000","last_peered":"2024-09-14T10:59:02.057121+0000","last_clean":"2024-09-14T10:59:02.057121+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:59:02.057121+0000","last_undegraded":"2024-09-14T10:59:02.057121+0000","last_fullsized":"2024-09-14T10:59:02.057121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.057026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:06.578087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.959227+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:58:19.959227+0000","last_peered":"2024-09-14T10:58:19.959227+0000","last_clean":"2024-09-14T10:58:19.959227+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:58:19.959227+0000","last_undegraded":"2024-09-14T10:58:19.959227+0000","last_fullsized":"2024-09-14T10:58:19.959227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.678256+0000","last_change":"2024-09-14T10:58:47.678256+0000","last_active":"2024-09-14T10:58:47.678256+0000","last_peered":"2024-09-14T10:58:47.678256+0000","last_clean":"2024-09-14T10:58:47.678256+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:47.678256+0000","last_undegraded":"2024-09-14T10:58:47.678256+0000","last_fullsized":"2024-09-14T10:58:47.678256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.678157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:56.701033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.187976+0000","last_change":"2024-09-14T10:58:31.187976+0000","last_active":"2024-09-14T10:58:31.187976+0000","last_peered":"2024-09-14T10:58:31.187976+0000","last_clean":"2024-09-14T10:58:31.187976+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:31.187976+0000","last_undegraded":"2024-09-14T10:58:31.187976+0000","last_fullsized":"2024-09-14T10:58:31.187976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.187893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:06.988528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'5","reported_seq":233,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.025603+0000","last_change":"2024-09-14T10:59:01.025603+0000","last_active":"2024-09-14T10:59:01.025603+0000","last_peered":"2024-09-14T10:59:01.025603+0000","last_clean":"2024-09-14T10:59:01.025603+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:59:01.025603+0000","last_undegraded":"2024-09-14T10:59:01.025603+0000","last_fullsized":"2024-09-14T10:59:01.025603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.025515+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:21.372068+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'35","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.968171+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:19.968171+0000","last_peered":"2024-09-14T10:58:19.968171+0000","last_clean":"2024-09-14T10:58:19.968171+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:19.968171+0000","last_undegraded":"2024-09-14T10:58:19.968171+0000","last_fullsized":"2024-09-14T10:58:19.968171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745679+0000","last_change":"2024-09-14T10:55:12.714346+0000","last_active":"2024-09-14T10:55:41.745679+0000","last_peered":"2024-09-14T10:55:41.745679+0000","last_clean":"2024-09-14T10:55:41.745679+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:55:41.745679+0000","last_undegraded":"2024-09-14T10:55:41.745679+0000","last_fullsized":"2024-09-14T10:55:41.745679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:40.887772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.049274+0000","last_change":"2024-09-14T10:58:44.049274+0000","last_active":"2024-09-14T10:58:44.049274+0000","last_peered":"2024-09-14T10:58:44.049274+0000","last_clean":"2024-09-14T10:58:44.049274+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:44.049274+0000","last_undegraded":"2024-09-14T10:58:44.049274+0000","last_fullsized":"2024-09-14T10:58:44.049274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.049194+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:59.063252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.769098+0000","last_change":"2024-09-14T10:58:32.769098+0000","last_active":"2024-09-14T10:58:32.769098+0000","last_peered":"2024-09-14T10:58:32.769098+0000","last_clean":"2024-09-14T10:58:32.769098+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:58:32.769098+0000","last_undegraded":"2024-09-14T10:58:32.769098+0000","last_fullsized":"2024-09-14T10:58:32.769098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.768987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:20.659652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.498479+0000","last_change":"2024-09-14T10:58:48.498479+0000","last_active":"2024-09-14T10:58:48.498479+0000","last_peered":"2024-09-14T10:58:48.498479+0000","last_clean":"2024-09-14T10:58:48.498479+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:48.498479+0000","last_undegraded":"2024-09-14T10:58:48.498479+0000","last_fullsized":"2024-09-14T10:58:48.498479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.498391+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.696592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.646671+0000","last_change":"2024-09-14T10:58:30.646671+0000","last_active":"2024-09-14T10:58:30.646671+0000","last_peered":"2024-09-14T10:58:30.646671+0000","last_clean":"2024-09-14T10:58:30.646671+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:58:30.646671+0000","last_undegraded":"2024-09-14T10:58:30.646671+0000","last_fullsized":"2024-09-14T10:58:30.646671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.646582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:28.625565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'8","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.333918+0000","last_change":"2024-09-14T10:55:06.692648+0000","last_active":"2024-09-14T10:58:13.333918+0000","last_peered":"2024-09-14T10:58:13.333918+0000","last_clean":"2024-09-14T10:58:13.333918+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:58:13.333918+0000","last_undegraded":"2024-09-14T10:58:13.333918+0000","last_fullsized":"2024-09-14T10:58:13.333918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:54.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.225339+0000","last_change":"2024-09-14T10:58:42.225339+0000","last_active":"2024-09-14T10:58:42.225339+0000","last_peered":"2024-09-14T10:58:42.225339+0000","last_clean":"2024-09-14T10:58:42.225339+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:58:42.225339+0000","last_undegraded":"2024-09-14T10:58:42.225339+0000","last_fullsized":"2024-09-14T10:58:42.225339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.225249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:35.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.540121+0000","last_change":"2024-09-14T10:58:47.540121+0000","last_active":"2024-09-14T10:58:47.540121+0000","last_peered":"2024-09-14T10:58:47.540121+0000","last_clean":"2024-09-14T10:58:47.540121+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:47.540121+0000","last_undegraded":"2024-09-14T10:58:47.540121+0000","last_fullsized":"2024-09-14T10:58:47.540121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.540036+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:13.554682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.620545+0000","last_change":"2024-09-14T10:58:31.620545+0000","last_active":"2024-09-14T10:58:31.620545+0000","last_peered":"2024-09-14T10:58:31.620545+0000","last_clean":"2024-09-14T10:58:31.620545+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:31.620545+0000","last_undegraded":"2024-09-14T10:58:31.620545+0000","last_fullsized":"2024-09-14T10:58:31.620545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.620459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.184499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.510519+0000","last_change":"2024-09-14T10:58:45.510519+0000","last_active":"2024-09-14T10:58:45.510519+0000","last_peered":"2024-09-14T10:58:45.510519+0000","last_clean":"2024-09-14T10:58:45.510519+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:58:45.510519+0000","last_undegraded":"2024-09-14T10:58:45.510519+0000","last_fullsized":"2024-09-14T10:58:45.510519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.510404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:33.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.632337+0000","last_change":"2024-09-14T10:58:32.632337+0000","last_active":"2024-09-14T10:58:32.632337+0000","last_peered":"2024-09-14T10:58:32.632337+0000","last_clean":"2024-09-14T10:58:32.632337+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:58:32.632337+0000","last_undegraded":"2024-09-14T10:58:32.632337+0000","last_fullsized":"2024-09-14T10:58:32.632337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.632202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:15.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.056837+0000","last_change":"2024-09-14T10:58:46.056837+0000","last_active":"2024-09-14T10:58:46.056837+0000","last_peered":"2024-09-14T10:58:46.056837+0000","last_clean":"2024-09-14T10:58:46.056837+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:58:46.056837+0000","last_undegraded":"2024-09-14T10:58:46.056837+0000","last_fullsized":"2024-09-14T10:58:46.056837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.056739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:40.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.181486+0000","last_change":"2024-09-14T10:58:33.181486+0000","last_active":"2024-09-14T10:58:33.181486+0000","last_peered":"2024-09-14T10:58:33.181486+0000","last_clean":"2024-09-14T10:58:33.181486+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:58:33.181486+0000","last_undegraded":"2024-09-14T10:58:33.181486+0000","last_fullsized":"2024-09-14T10:58:33.181486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.181378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:00.642621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.491300+0000","last_change":"2024-09-14T10:58:46.491300+0000","last_active":"2024-09-14T10:58:46.491300+0000","last_peered":"2024-09-14T10:58:46.491300+0000","last_clean":"2024-09-14T10:58:46.491300+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:46.491300+0000","last_undegraded":"2024-09-14T10:58:46.491300+0000","last_fullsized":"2024-09-14T10:58:46.491300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.491200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:00.231388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.729483+0000","last_change":"2024-09-14T10:58:31.729483+0000","last_active":"2024-09-14T10:58:31.729483+0000","last_peered":"2024-09-14T10:58:31.729483+0000","last_clean":"2024-09-14T10:58:31.729483+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:58:31.729483+0000","last_undegraded":"2024-09-14T10:58:31.729483+0000","last_fullsized":"2024-09-14T10:58:31.729483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.729382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:17.181102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.085631+0000","last_change":"2024-09-14T10:58:45.085631+0000","last_active":"2024-09-14T10:58:45.085631+0000","last_peered":"2024-09-14T10:58:45.085631+0000","last_clean":"2024-09-14T10:58:45.085631+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:58:45.085631+0000","last_undegraded":"2024-09-14T10:58:45.085631+0000","last_fullsized":"2024-09-14T10:58:45.085631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.085504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:36.257221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.607227+0000","last_change":"2024-09-14T10:58:33.607227+0000","last_active":"2024-09-14T10:58:33.607227+0000","last_peered":"2024-09-14T10:58:33.607227+0000","last_clean":"2024-09-14T10:58:33.607227+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:58:33.607227+0000","last_undegraded":"2024-09-14T10:58:33.607227+0000","last_fullsized":"2024-09-14T10:58:33.607227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.607100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:52.664954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.160075+0000","last_change":"2024-09-14T10:58:51.160075+0000","last_active":"2024-09-14T10:58:51.160075+0000","last_peered":"2024-09-14T10:58:51.160075+0000","last_clean":"2024-09-14T10:58:51.160075+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:51.160075+0000","last_undegraded":"2024-09-14T10:58:51.160075+0000","last_fullsized":"2024-09-14T10:58:51.160075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.159979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:22.667198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.212687+0000","last_change":"2024-09-14T10:58:48.212687+0000","last_active":"2024-09-14T10:58:48.212687+0000","last_peered":"2024-09-14T10:58:48.212687+0000","last_clean":"2024-09-14T10:58:48.212687+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:58:48.212687+0000","last_undegraded":"2024-09-14T10:58:48.212687+0000","last_fullsized":"2024-09-14T10:58:48.212687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.212580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:27.361696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.972447+0000","last_change":"2024-09-14T10:55:06.702470+0000","last_active":"2024-09-14T10:58:12.972447+0000","last_peered":"2024-09-14T10:58:12.972447+0000","last_clean":"2024-09-14T10:58:12.972447+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:58:12.972447+0000","last_undegraded":"2024-09-14T10:58:12.972447+0000","last_fullsized":"2024-09-14T10:58:12.972447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:26.848672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.649901+0000","last_change":"2024-09-14T10:58:34.649901+0000","last_active":"2024-09-14T10:58:34.649901+0000","last_peered":"2024-09-14T10:58:34.649901+0000","last_clean":"2024-09-14T10:58:34.649901+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:34.649901+0000","last_undegraded":"2024-09-14T10:58:34.649901+0000","last_fullsized":"2024-09-14T10:58:34.649901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.649810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:05.982892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.483078+0000","last_change":"2024-09-14T10:58:49.483078+0000","last_active":"2024-09-14T10:58:49.483078+0000","last_peered":"2024-09-14T10:58:49.483078+0000","last_clean":"2024-09-14T10:58:49.483078+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:58:49.483078+0000","last_undegraded":"2024-09-14T10:58:49.483078+0000","last_fullsized":"2024-09-14T10:58:49.483078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.482969+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.100489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.215888+0000","last_change":"2024-09-14T10:58:32.215888+0000","last_active":"2024-09-14T10:58:32.215888+0000","last_peered":"2024-09-14T10:58:32.215888+0000","last_clean":"2024-09-14T10:58:32.215888+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:58:32.215888+0000","last_undegraded":"2024-09-14T10:58:32.215888+0000","last_fullsized":"2024-09-14T10:58:32.215888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.215791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.184022+0000","last_change":"2024-09-14T10:58:50.184022+0000","last_active":"2024-09-14T10:58:50.184022+0000","last_peered":"2024-09-14T10:58:50.184022+0000","last_clean":"2024-09-14T10:58:50.184022+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:58:50.184022+0000","last_undegraded":"2024-09-14T10:58:50.184022+0000","last_fullsized":"2024-09-14T10:58:50.184022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.183944+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:41.356134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.123439+0000","last_change":"2024-09-14T10:58:35.123439+0000","last_active":"2024-09-14T10:58:35.123439+0000","last_peered":"2024-09-14T10:58:35.123439+0000","last_clean":"2024-09-14T10:58:35.123439+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:58:35.123439+0000","last_undegraded":"2024-09-14T10:58:35.123439+0000","last_fullsized":"2024-09-14T10:58:35.123439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.123338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:26.005173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.179766+0000","last_change":"2024-09-14T10:58:49.179766+0000","last_active":"2024-09-14T10:58:49.179766+0000","last_peered":"2024-09-14T10:58:49.179766+0000","last_clean":"2024-09-14T10:58:49.179766+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:49.179766+0000","last_undegraded":"2024-09-14T10:58:49.179766+0000","last_fullsized":"2024-09-14T10:58:49.179766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.179681+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.816048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.266002+0000","last_change":"2024-09-14T10:58:45.266002+0000","last_active":"2024-09-14T10:58:45.266002+0000","last_peered":"2024-09-14T10:58:45.266002+0000","last_clean":"2024-09-14T10:58:45.266002+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:58:45.266002+0000","last_undegraded":"2024-09-14T10:58:45.266002+0000","last_fullsized":"2024-09-14T10:58:45.266002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.265914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.079568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.131536+0000","last_change":"2024-09-14T10:58:48.131536+0000","last_active":"2024-09-14T10:58:48.131536+0000","last_peered":"2024-09-14T10:58:48.131536+0000","last_clean":"2024-09-14T10:58:48.131536+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:48.131536+0000","last_undegraded":"2024-09-14T10:58:48.131536+0000","last_fullsized":"2024-09-14T10:58:48.131536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.131427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:07.192316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.286543+0000","last_change":"2024-09-14T10:58:44.286543+0000","last_active":"2024-09-14T10:58:44.286543+0000","last_peered":"2024-09-14T10:58:44.286543+0000","last_clean":"2024-09-14T10:58:44.286543+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:58:44.286543+0000","last_undegraded":"2024-09-14T10:58:44.286543+0000","last_fullsized":"2024-09-14T10:58:44.286543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.286454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.534792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742393+0000","last_change":"2024-09-14T10:55:06.695345+0000","last_active":"2024-09-14T10:55:41.742393+0000","last_peered":"2024-09-14T10:55:41.742393+0000","last_clean":"2024-09-14T10:55:41.742393+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:55:41.742393+0000","last_undegraded":"2024-09-14T10:55:41.742393+0000","last_fullsized":"2024-09-14T10:55:41.742393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:05.668503+0000","last_clean_scrub_stamp":"2024-09-14T10:55:05.668503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:50.556642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.750129+0000","last_change":"2024-09-14T10:58:33.750129+0000","last_active":"2024-09-14T10:58:33.750129+0000","last_peered":"2024-09-14T10:58:33.750129+0000","last_clean":"2024-09-14T10:58:33.750129+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:33.750129+0000","last_undegraded":"2024-09-14T10:58:33.750129+0000","last_fullsized":"2024-09-14T10:58:33.750129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.750046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:41.673497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.083486+0000","last_change":"2024-09-14T10:58:47.083486+0000","last_active":"2024-09-14T10:58:47.083486+0000","last_peered":"2024-09-14T10:58:47.083486+0000","last_clean":"2024-09-14T10:58:47.083486+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:47.083486+0000","last_undegraded":"2024-09-14T10:58:47.083486+0000","last_fullsized":"2024-09-14T10:58:47.083486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.083386+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:48.862348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.225553+0000","last_change":"2024-09-14T10:58:46.225553+0000","last_active":"2024-09-14T10:58:46.225553+0000","last_peered":"2024-09-14T10:58:46.225553+0000","last_clean":"2024-09-14T10:58:46.225553+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:58:46.225553+0000","last_undegraded":"2024-09-14T10:58:46.225553+0000","last_fullsized":"2024-09-14T10:58:46.225553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.225471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.589934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.182383+0000","last_change":"2024-09-14T10:58:47.182383+0000","last_active":"2024-09-14T10:58:47.182383+0000","last_peered":"2024-09-14T10:58:47.182383+0000","last_clean":"2024-09-14T10:58:47.182383+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:58:47.182383+0000","last_undegraded":"2024-09-14T10:58:47.182383+0000","last_fullsized":"2024-09-14T10:58:47.182383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.182295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.861086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.410163+0000","last_change":"2024-09-14T10:58:51.410163+0000","last_active":"2024-09-14T10:58:51.410163+0000","last_peered":"2024-09-14T10:58:51.410163+0000","last_clean":"2024-09-14T10:58:51.410163+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:51.410163+0000","last_undegraded":"2024-09-14T10:58:51.410163+0000","last_fullsized":"2024-09-14T10:58:51.410163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.410073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:45.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.601919+0000","last_change":"2024-09-14T10:58:35.601919+0000","last_active":"2024-09-14T10:58:35.601919+0000","last_peered":"2024-09-14T10:58:35.601919+0000","last_clean":"2024-09-14T10:58:35.601919+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:35.601919+0000","last_undegraded":"2024-09-14T10:58:35.601919+0000","last_fullsized":"2024-09-14T10:58:35.601919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.601827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:44.673365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.139091+0000","last_change":"2024-09-14T10:58:57.139091+0000","last_active":"2024-09-14T10:58:57.139091+0000","last_peered":"2024-09-14T10:58:57.139091+0000","last_clean":"2024-09-14T10:58:57.139091+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:57.139091+0000","last_undegraded":"2024-09-14T10:58:57.139091+0000","last_fullsized":"2024-09-14T10:58:57.139091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.139001+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.477286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1410,"ondisk_log_size":1410,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640310,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640311,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:59:05.152 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.152 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.153 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.154 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.155 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.156 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.157 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.158 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.158 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.158 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.158 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.158 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.159 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.160 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.161 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.162 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.163 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.164 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.165 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:55:07.677947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.166 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.167 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.168 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:55:05.668503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:05.168 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:59:25.169 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.281+0000 7f89fe27f640 1 Processor -- start 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.281+0000 7f89fe27f640 1 -- start start 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.281+0000 7f89fe27f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f89f812c0b0 0x7f89f812c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.281+0000 7f89fe27f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f809a290 con 0x7f89f812c9d0 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.281+0000 7f89fe27f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f89f8071860 con 0x7f89f812c0b0 2024-09-14T10:59:25.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f7fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f89f812c0b0 0x7f89f812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:25.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f77fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f89f812c9d0 0x7f89f8097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51740/0 (socket says 172.21.15.116:51740) 2024-09-14T10:59:25.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f77fe640 1 -- 172.21.15.116:0/2335404664 learned_addr learned my addr 172.21.15.116:0/2335404664 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:59:25.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f7fff640 1 -- 172.21.15.116:0/2335404664 >> v1:172.21.15.116:6789/0 conn(0x7f89f812c9d0 legacy=0x7f89f8097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:25.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f7fff640 1 -- 172.21.15.116:0/2335404664 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8099e20 con 0x7f89f812c0b0 2024-09-14T10:59:25.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.282+0000 7f89f6ffd640 1 -- 172.21.15.116:0/2335404664 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886486891 0 0) 0x7f89f809a290 con 0x7f89f812c9d0 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89f7fff640 1 --2- 172.21.15.116:0/2335404664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f812c490 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009750 tx=0x7f89e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf54f5d70889991 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89f6ffd640 1 -- 172.21.15.116:0/2335404664 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e8037070 con 0x7f89f812c0b0 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89f6ffd640 1 -- 172.21.15.116:0/2335404664 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e802ad80 con 0x7f89f812c0b0 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89f6ffd640 1 -- 172.21.15.116:0/2335404664 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e8032590 con 0x7f89f812c0b0 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 -- 172.21.15.116:0/2335404664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 msgr2=0x7f89f812c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 --2- 172.21.15.116:0/2335404664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f812c490 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009750 tx=0x7f89e802a140 comp rx=0 tx=0).stop 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 -- 172.21.15.116:0/2335404664 shutdown_connections 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 --2- 172.21.15.116:0/2335404664 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f812c490 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 -- 172.21.15.116:0/2335404664 >> 172.21.15.116:0/2335404664 conn(0x7f89f809abc0 msgr2=0x7f89f8098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:25.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 -- 172.21.15.116:0/2335404664 shutdown_connections 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.283+0000 7f89fe27f640 1 -- 172.21.15.116:0/2335404664 wait complete. 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.284+0000 7f89fe27f640 1 Processor -- start 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.284+0000 7f89fe27f640 1 -- start start 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89fe27f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89fe27f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f89f812ce00 con 0x7f89f812c0b0 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:36120/0 (socket says 172.21.15.116:36120) 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f7fff640 1 -- 172.21.15.116:0/1031809160 learned_addr learned my addr 172.21.15.116:0/1031809160 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f7fff640 1 -- 172.21.15.116:0/1031809160 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f8129390 con 0x7f89f812c0b0 2024-09-14T10:59:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f7fff640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009750 tx=0x7f89e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e80433f0 con 0x7f89f812c0b0 2024-09-14T10:59:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e8043590 con 0x7f89f812c0b0 2024-09-14T10:59:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f8126520 con 0x7f89f812c0b0 2024-09-14T10:59:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89e8043870 con 0x7f89f812c0b0 2024-09-14T10:59:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.285+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f81269f0 con 0x7f89f812c0b0 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.286+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f89e804a060 con 0x7f89f812c0b0 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.287+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f812c490 con 0x7f89f812c0b0 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.287+0000 7f89f4ff9640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 0x7f89e4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.287+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f89e80755b0 con 0x7f89f812c0b0 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.287+0000 7f89f77fe640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 0x7f89e4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:25.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.288+0000 7f89f77fe640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 0x7f89e4040a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:25.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.291+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f89e803e070 con 0x7f89f812c0b0 2024-09-14T10:59:25.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.463+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89f8074090 con 0x7f89e403e570 2024-09-14T10:59:25.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.474+0000 7f89f4ff9640 1 -- 172.21.15.116:0/1031809160 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665912 (secure 0 0 0) 0x7f89f8074090 con 0x7f89e403e570 2024-09-14T10:59:25.484 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:59:25.490 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 msgr2=0x7f89e4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 0x7f89e4040a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f89ec000c00 tx=0x7f89ec0078f0 comp rx=0 tx=0).stop 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 msgr2=0x7f89f8125fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009750 tx=0x7f89e80046c0 comp rx=0 tx=0).stop 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 shutdown_connections 2024-09-14T10:59:25.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f89e403e570 0x7f89e4040a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:25.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 --2- 172.21.15.116:0/1031809160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f89f812c0b0 0x7f89f8125fe0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:25.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 >> 172.21.15.116:0/1031809160 conn(0x7f89f809abc0 msgr2=0x7f89f8071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:25.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 shutdown_connections 2024-09-14T10:59:25.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:25.479+0000 7f89fe27f640 1 -- 172.21.15.116:0/1031809160 wait complete. 2024-09-14T10:59:25.494 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-14T10:59:24.141098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4725,"ondisk_log_size":4725,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156864,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330496,"statfs":{"total":386547056640,"available":386386427904,"internally_reserved":0,"allocated":3080192,"data_stored":1819780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.768980+0000","last_change":"2024-09-14T10:58:37.768923+0000","last_active":"2024-09-14T10:58:37.768980+0000","last_peered":"2024-09-14T10:58:37.768980+0000","last_clean":"2024-09-14T10:58:37.768980+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:58:37.768980+0000","last_undegraded":"2024-09-14T10:58:37.768980+0000","last_fullsized":"2024-09-14T10:58:37.768980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.768838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:59.090598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.199300+0000","last_change":"2024-09-14T10:58:55.199300+0000","last_active":"2024-09-14T10:58:55.199300+0000","last_peered":"2024-09-14T10:58:55.199300+0000","last_clean":"2024-09-14T10:58:55.199300+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:58:55.199300+0000","last_undegraded":"2024-09-14T10:58:55.199300+0000","last_fullsized":"2024-09-14T10:58:55.199300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.199194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.549583+0000","last_change":"2024-09-14T10:58:38.549485+0000","last_active":"2024-09-14T10:58:38.549583+0000","last_peered":"2024-09-14T10:58:38.549583+0000","last_clean":"2024-09-14T10:58:38.549583+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:58:38.549583+0000","last_undegraded":"2024-09-14T10:58:38.549583+0000","last_fullsized":"2024-09-14T10:58:38.549583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.549386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.035874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.450785+0000","last_change":"2024-09-14T10:58:52.450785+0000","last_active":"2024-09-14T10:58:52.450785+0000","last_peered":"2024-09-14T10:58:52.450785+0000","last_clean":"2024-09-14T10:58:52.450785+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:58:52.450785+0000","last_undegraded":"2024-09-14T10:58:52.450785+0000","last_fullsized":"2024-09-14T10:58:52.450785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.450685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:49.376289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.232878+0000","last_change":"2024-09-14T10:58:52.232804+0000","last_active":"2024-09-14T10:58:52.232878+0000","last_peered":"2024-09-14T10:58:52.232878+0000","last_clean":"2024-09-14T10:58:52.232878+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:58:52.232878+0000","last_undegraded":"2024-09-14T10:58:52.232878+0000","last_fullsized":"2024-09-14T10:58:52.232878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.232718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:22.618318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.211047+0000","last_change":"2024-09-14T10:59:08.211047+0000","last_active":"2024-09-14T10:59:08.211047+0000","last_peered":"2024-09-14T10:59:08.211047+0000","last_clean":"2024-09-14T10:59:08.211047+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:59:08.211047+0000","last_undegraded":"2024-09-14T10:59:08.211047+0000","last_fullsized":"2024-09-14T10:59:08.211047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.210952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:36.569390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.746604+0000","last_change":"2024-09-14T10:58:36.746554+0000","last_active":"2024-09-14T10:58:36.746604+0000","last_peered":"2024-09-14T10:58:36.746604+0000","last_clean":"2024-09-14T10:58:36.746604+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:58:36.746604+0000","last_undegraded":"2024-09-14T10:58:36.746604+0000","last_fullsized":"2024-09-14T10:58:36.746604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.746473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:56.987213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.647611+0000","last_change":"2024-09-14T10:58:46.647611+0000","last_active":"2024-09-14T10:58:46.647611+0000","last_peered":"2024-09-14T10:58:46.647611+0000","last_clean":"2024-09-14T10:58:46.647611+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:46.647611+0000","last_undegraded":"2024-09-14T10:58:46.647611+0000","last_fullsized":"2024-09-14T10:58:46.647611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.647534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.998212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.210331+0000","last_change":"2024-09-14T10:58:51.210331+0000","last_active":"2024-09-14T10:58:51.210331+0000","last_peered":"2024-09-14T10:58:51.210331+0000","last_clean":"2024-09-14T10:58:51.210331+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:51.210331+0000","last_undegraded":"2024-09-14T10:58:51.210331+0000","last_fullsized":"2024-09-14T10:58:51.210331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.210239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:23.207843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.157380+0000","last_change":"2024-09-14T10:58:56.157322+0000","last_active":"2024-09-14T10:58:56.157380+0000","last_peered":"2024-09-14T10:58:56.157380+0000","last_clean":"2024-09-14T10:58:56.157380+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:56.157380+0000","last_undegraded":"2024-09-14T10:58:56.157380+0000","last_fullsized":"2024-09-14T10:58:56.157380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.157235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:11.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.781933+0000","last_change":"2024-09-14T10:58:35.781933+0000","last_active":"2024-09-14T10:58:35.781933+0000","last_peered":"2024-09-14T10:58:35.781933+0000","last_clean":"2024-09-14T10:58:35.781933+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:58:35.781933+0000","last_undegraded":"2024-09-14T10:58:35.781933+0000","last_fullsized":"2024-09-14T10:58:35.781933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.781832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.948433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.236407+0000","last_change":"2024-09-14T10:59:09.236343+0000","last_active":"2024-09-14T10:59:09.236407+0000","last_peered":"2024-09-14T10:59:09.236407+0000","last_clean":"2024-09-14T10:59:09.236407+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:59:09.236407+0000","last_undegraded":"2024-09-14T10:59:09.236407+0000","last_fullsized":"2024-09-14T10:59:09.236407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.236262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:20.332076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.229232+0000","last_change":"2024-09-14T10:58:50.229232+0000","last_active":"2024-09-14T10:58:50.229232+0000","last_peered":"2024-09-14T10:58:50.229232+0000","last_clean":"2024-09-14T10:58:50.229232+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:50.229232+0000","last_undegraded":"2024-09-14T10:58:50.229232+0000","last_fullsized":"2024-09-14T10:58:50.229232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.229092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:49.980838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.696564+0000","last_change":"2024-09-14T10:58:49.696483+0000","last_active":"2024-09-14T10:58:49.696564+0000","last_peered":"2024-09-14T10:58:49.696564+0000","last_clean":"2024-09-14T10:58:49.696564+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:58:49.696564+0000","last_undegraded":"2024-09-14T10:58:49.696564+0000","last_fullsized":"2024-09-14T10:58:49.696564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.696365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:27.219012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.557545+0000","last_change":"2024-09-14T10:58:36.557545+0000","last_active":"2024-09-14T10:58:36.557545+0000","last_peered":"2024-09-14T10:58:36.557545+0000","last_clean":"2024-09-14T10:58:36.557545+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:58:36.557545+0000","last_undegraded":"2024-09-14T10:58:36.557545+0000","last_fullsized":"2024-09-14T10:58:36.557545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:19.674856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.655955+0000","last_change":"2024-09-14T10:58:48.655853+0000","last_active":"2024-09-14T10:58:48.655955+0000","last_peered":"2024-09-14T10:58:48.655955+0000","last_clean":"2024-09-14T10:58:48.655955+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:58:48.655955+0000","last_undegraded":"2024-09-14T10:58:48.655955+0000","last_fullsized":"2024-09-14T10:58:48.655955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.655753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:09.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.204128+0000","last_change":"2024-09-14T10:59:10.204128+0000","last_active":"2024-09-14T10:59:10.204128+0000","last_peered":"2024-09-14T10:59:10.204128+0000","last_clean":"2024-09-14T10:59:10.204128+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:59:10.204128+0000","last_undegraded":"2024-09-14T10:59:10.204128+0000","last_fullsized":"2024-09-14T10:59:10.204128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.204034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.143862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.116444+0000","last_change":"2024-09-14T10:58:41.116444+0000","last_active":"2024-09-14T10:58:41.116444+0000","last_peered":"2024-09-14T10:58:41.116444+0000","last_clean":"2024-09-14T10:58:41.116444+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:41.116444+0000","last_undegraded":"2024-09-14T10:58:41.116444+0000","last_fullsized":"2024-09-14T10:58:41.116444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.116320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.336574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.131032+0000","last_change":"2024-09-14T10:58:52.131032+0000","last_active":"2024-09-14T10:58:52.131032+0000","last_peered":"2024-09-14T10:58:52.131032+0000","last_clean":"2024-09-14T10:58:52.131032+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:52.131032+0000","last_undegraded":"2024-09-14T10:58:52.131032+0000","last_fullsized":"2024-09-14T10:58:52.131032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.130944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:47.420179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.762283+0000","last_change":"2024-09-14T10:58:34.762283+0000","last_active":"2024-09-14T10:58:34.762283+0000","last_peered":"2024-09-14T10:58:34.762283+0000","last_clean":"2024-09-14T10:58:34.762283+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:58:34.762283+0000","last_undegraded":"2024-09-14T10:58:34.762283+0000","last_fullsized":"2024-09-14T10:58:34.762283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.762201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:32.819316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.205330+0000","last_change":"2024-09-14T10:58:54.205330+0000","last_active":"2024-09-14T10:58:54.205330+0000","last_peered":"2024-09-14T10:58:54.205330+0000","last_clean":"2024-09-14T10:58:54.205330+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:58:54.205330+0000","last_undegraded":"2024-09-14T10:58:54.205330+0000","last_fullsized":"2024-09-14T10:58:54.205330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.205219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:44.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.125124+0000","last_change":"2024-09-14T10:58:36.125124+0000","last_active":"2024-09-14T10:58:36.125124+0000","last_peered":"2024-09-14T10:58:36.125124+0000","last_clean":"2024-09-14T10:58:36.125124+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:58:36.125124+0000","last_undegraded":"2024-09-14T10:58:36.125124+0000","last_fullsized":"2024-09-14T10:58:36.125124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.125007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:02.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.433757+0000","last_change":"2024-09-14T10:58:50.433757+0000","last_active":"2024-09-14T10:58:50.433757+0000","last_peered":"2024-09-14T10:58:50.433757+0000","last_clean":"2024-09-14T10:58:50.433757+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:50.433757+0000","last_undegraded":"2024-09-14T10:58:50.433757+0000","last_fullsized":"2024-09-14T10:58:50.433757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.433642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:12.306523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.151676+0000","last_change":"2024-09-14T10:58:34.151676+0000","last_active":"2024-09-14T10:58:34.151676+0000","last_peered":"2024-09-14T10:58:34.151676+0000","last_clean":"2024-09-14T10:58:34.151676+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:58:34.151676+0000","last_undegraded":"2024-09-14T10:58:34.151676+0000","last_fullsized":"2024-09-14T10:58:34.151676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.151591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.433519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.688675+0000","last_change":"2024-09-14T10:58:45.688675+0000","last_active":"2024-09-14T10:58:45.688675+0000","last_peered":"2024-09-14T10:58:45.688675+0000","last_clean":"2024-09-14T10:58:45.688675+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:58:45.688675+0000","last_undegraded":"2024-09-14T10:58:45.688675+0000","last_fullsized":"2024-09-14T10:58:45.688675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.688582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:29.115809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.579906+0000","last_change":"2024-09-14T10:58:37.579906+0000","last_active":"2024-09-14T10:58:37.579906+0000","last_peered":"2024-09-14T10:58:37.579906+0000","last_clean":"2024-09-14T10:58:37.579906+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:58:37.579906+0000","last_undegraded":"2024-09-14T10:58:37.579906+0000","last_fullsized":"2024-09-14T10:58:37.579906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.579809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:06.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.168366+0000","last_change":"2024-09-14T10:58:53.168366+0000","last_active":"2024-09-14T10:58:53.168366+0000","last_peered":"2024-09-14T10:58:53.168366+0000","last_clean":"2024-09-14T10:58:53.168366+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:58:53.168366+0000","last_undegraded":"2024-09-14T10:58:53.168366+0000","last_fullsized":"2024-09-14T10:58:53.168366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.168255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:30.421815+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.259070+0000","last_change":"2024-09-14T10:58:49.259070+0000","last_active":"2024-09-14T10:58:49.259070+0000","last_peered":"2024-09-14T10:58:49.259070+0000","last_clean":"2024-09-14T10:58:49.259070+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:49.259070+0000","last_undegraded":"2024-09-14T10:58:49.259070+0000","last_fullsized":"2024-09-14T10:58:49.259070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.258968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.093328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'37","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.230272+0000","last_change":"2024-09-14T10:55:14.730294+0000","last_active":"2024-09-14T10:58:13.230272+0000","last_peered":"2024-09-14T10:58:13.230272+0000","last_clean":"2024-09-14T10:58:13.230272+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:58:13.230272+0000","last_undegraded":"2024-09-14T10:58:13.230272+0000","last_fullsized":"2024-09-14T10:58:13.230272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:34.058386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.304557+0000","last_change":"2024-09-14T10:58:59.304557+0000","last_active":"2024-09-14T10:58:59.304557+0000","last_peered":"2024-09-14T10:58:59.304557+0000","last_clean":"2024-09-14T10:58:59.304557+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:58:59.304557+0000","last_undegraded":"2024-09-14T10:58:59.304557+0000","last_fullsized":"2024-09-14T10:58:59.304557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.304438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.011910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.122467+0000","last_change":"2024-09-14T10:58:38.122467+0000","last_active":"2024-09-14T10:58:38.122467+0000","last_peered":"2024-09-14T10:58:38.122467+0000","last_clean":"2024-09-14T10:58:38.122467+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:58:38.122467+0000","last_undegraded":"2024-09-14T10:58:38.122467+0000","last_fullsized":"2024-09-14T10:58:38.122467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.122377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.370779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.287297+0000","last_change":"2024-09-14T10:59:18.287297+0000","last_active":"2024-09-14T10:59:18.287297+0000","last_peered":"2024-09-14T10:59:18.287297+0000","last_clean":"2024-09-14T10:59:18.287297+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:59:18.287297+0000","last_undegraded":"2024-09-14T10:59:18.287297+0000","last_fullsized":"2024-09-14T10:59:18.287297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.287174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.835680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.938635+0000","last_change":"2024-09-14T10:55:10.715712+0000","last_active":"2024-09-14T10:58:19.938635+0000","last_peered":"2024-09-14T10:58:19.938635+0000","last_clean":"2024-09-14T10:58:19.938635+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:58:19.938635+0000","last_undegraded":"2024-09-14T10:58:19.938635+0000","last_fullsized":"2024-09-14T10:58:19.938635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:27.358037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.828449+0000","last_change":"2024-09-14T10:59:15.828449+0000","last_active":"2024-09-14T10:59:15.828449+0000","last_peered":"2024-09-14T10:59:15.828449+0000","last_clean":"2024-09-14T10:59:15.828449+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:59:15.828449+0000","last_undegraded":"2024-09-14T10:59:15.828449+0000","last_fullsized":"2024-09-14T10:59:15.828449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.828352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:20.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.890257+0000","last_change":"2024-09-14T10:55:14.731537+0000","last_active":"2024-09-14T10:56:28.890257+0000","last_peered":"2024-09-14T10:56:28.890257+0000","last_clean":"2024-09-14T10:56:28.890257+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:56:28.890257+0000","last_undegraded":"2024-09-14T10:56:28.890257+0000","last_fullsized":"2024-09-14T10:56:28.890257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:11.762633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.341862+0000","last_change":"2024-09-14T10:59:00.341862+0000","last_active":"2024-09-14T10:59:00.341862+0000","last_peered":"2024-09-14T10:59:00.341862+0000","last_clean":"2024-09-14T10:59:00.341862+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:59:00.341862+0000","last_undegraded":"2024-09-14T10:59:00.341862+0000","last_fullsized":"2024-09-14T10:59:00.341862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.341770+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:16.361583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.833117+0000","last_change":"2024-09-14T10:58:28.833117+0000","last_active":"2024-09-14T10:58:28.833117+0000","last_peered":"2024-09-14T10:58:28.833117+0000","last_clean":"2024-09-14T10:58:28.833117+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:58:28.833117+0000","last_undegraded":"2024-09-14T10:58:28.833117+0000","last_fullsized":"2024-09-14T10:58:28.833117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.833024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.803836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.423501+0000","last_change":"2024-09-14T10:58:58.423501+0000","last_active":"2024-09-14T10:58:58.423501+0000","last_peered":"2024-09-14T10:58:58.423501+0000","last_clean":"2024-09-14T10:58:58.423501+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:58:58.423501+0000","last_undegraded":"2024-09-14T10:58:58.423501+0000","last_fullsized":"2024-09-14T10:58:58.423501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.423413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:14.071911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.903992+0000","last_change":"2024-09-14T10:59:11.903992+0000","last_active":"2024-09-14T10:59:11.903992+0000","last_peered":"2024-09-14T10:59:11.903992+0000","last_clean":"2024-09-14T10:59:11.903992+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:59:11.903992+0000","last_undegraded":"2024-09-14T10:59:11.903992+0000","last_fullsized":"2024-09-14T10:59:11.903992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.903906+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:21.118231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.838078+0000","last_change":"2024-09-14T10:59:14.838078+0000","last_active":"2024-09-14T10:59:14.838078+0000","last_peered":"2024-09-14T10:59:14.838078+0000","last_clean":"2024-09-14T10:59:14.838078+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:59:14.838078+0000","last_undegraded":"2024-09-14T10:59:14.838078+0000","last_fullsized":"2024-09-14T10:59:14.838078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.837975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:00.387583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.745022+0000","last_change":"2024-09-14T10:55:14.722236+0000","last_active":"2024-09-14T10:55:41.745022+0000","last_peered":"2024-09-14T10:55:41.745022+0000","last_clean":"2024-09-14T10:55:41.745022+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:55:41.745022+0000","last_undegraded":"2024-09-14T10:55:41.745022+0000","last_fullsized":"2024-09-14T10:55:41.745022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:15.070077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.301344+0000","last_change":"2024-09-14T10:59:02.301344+0000","last_active":"2024-09-14T10:59:02.301344+0000","last_peered":"2024-09-14T10:59:02.301344+0000","last_clean":"2024-09-14T10:59:02.301344+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:59:02.301344+0000","last_undegraded":"2024-09-14T10:59:02.301344+0000","last_fullsized":"2024-09-14T10:59:02.301344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.301206+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:42.934531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.134905+0000","last_change":"2024-09-14T10:58:37.134905+0000","last_active":"2024-09-14T10:58:37.134905+0000","last_peered":"2024-09-14T10:58:37.134905+0000","last_clean":"2024-09-14T10:58:37.134905+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:58:37.134905+0000","last_undegraded":"2024-09-14T10:58:37.134905+0000","last_fullsized":"2024-09-14T10:58:37.134905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.134801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:19.758122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.426312+0000","last_change":"2024-09-14T10:58:59.426312+0000","last_active":"2024-09-14T10:58:59.426312+0000","last_peered":"2024-09-14T10:58:59.426312+0000","last_clean":"2024-09-14T10:58:59.426312+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:58:59.426312+0000","last_undegraded":"2024-09-14T10:58:59.426312+0000","last_fullsized":"2024-09-14T10:58:59.426312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.426181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.700362+0000","last_change":"2024-09-14T10:59:03.700362+0000","last_active":"2024-09-14T10:59:03.700362+0000","last_peered":"2024-09-14T10:59:03.700362+0000","last_clean":"2024-09-14T10:59:03.700362+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:59:03.700362+0000","last_undegraded":"2024-09-14T10:59:03.700362+0000","last_fullsized":"2024-09-14T10:59:03.700362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.700267+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:35.207485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":407,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.816667+0000","last_change":"2024-09-14T10:55:12.723480+0000","last_active":"2024-09-14T10:58:19.816667+0000","last_peered":"2024-09-14T10:58:19.816667+0000","last_clean":"2024-09-14T10:58:19.816667+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:58:19.816667+0000","last_undegraded":"2024-09-14T10:58:19.816667+0000","last_fullsized":"2024-09-14T10:58:19.816667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:52.606564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.846165+0000","last_change":"2024-09-14T10:59:15.846165+0000","last_active":"2024-09-14T10:59:15.846165+0000","last_peered":"2024-09-14T10:59:15.846165+0000","last_clean":"2024-09-14T10:59:15.846165+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:59:15.846165+0000","last_undegraded":"2024-09-14T10:59:15.846165+0000","last_fullsized":"2024-09-14T10:59:15.846165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.846039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:36.510986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.509476+0000","last_change":"2024-09-14T10:58:42.509476+0000","last_active":"2024-09-14T10:58:42.509476+0000","last_peered":"2024-09-14T10:58:42.509476+0000","last_clean":"2024-09-14T10:58:42.509476+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:58:42.509476+0000","last_undegraded":"2024-09-14T10:58:42.509476+0000","last_fullsized":"2024-09-14T10:58:42.509476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.509389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:30.236260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.293841+0000","last_change":"2024-09-14T10:58:25.293841+0000","last_active":"2024-09-14T10:58:25.293841+0000","last_peered":"2024-09-14T10:58:25.293841+0000","last_clean":"2024-09-14T10:58:25.293841+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:58:25.293841+0000","last_undegraded":"2024-09-14T10:58:25.293841+0000","last_fullsized":"2024-09-14T10:58:25.293841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.293744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:40.765776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.327074+0000","last_change":"2024-09-14T10:59:19.327074+0000","last_active":"2024-09-14T10:59:19.327074+0000","last_peered":"2024-09-14T10:59:19.327074+0000","last_clean":"2024-09-14T10:59:19.327074+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:59:19.327074+0000","last_undegraded":"2024-09-14T10:59:19.327074+0000","last_fullsized":"2024-09-14T10:59:19.327074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.326990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:03.623781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.698812+0000","last_change":"2024-09-14T10:59:02.698812+0000","last_active":"2024-09-14T10:59:02.698812+0000","last_peered":"2024-09-14T10:59:02.698812+0000","last_clean":"2024-09-14T10:59:02.698812+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:59:02.698812+0000","last_undegraded":"2024-09-14T10:59:02.698812+0000","last_fullsized":"2024-09-14T10:59:02.698812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.698703+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:35.538644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":447,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.491953+0000","last_change":"2024-09-14T10:59:11.491953+0000","last_active":"2024-09-14T10:59:11.491953+0000","last_peered":"2024-09-14T10:59:11.491953+0000","last_clean":"2024-09-14T10:59:11.491953+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:59:11.491953+0000","last_undegraded":"2024-09-14T10:59:11.491953+0000","last_fullsized":"2024-09-14T10:59:11.491953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.491837+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:50.595963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.265017+0000","last_change":"2024-09-14T10:58:57.265017+0000","last_active":"2024-09-14T10:58:57.265017+0000","last_peered":"2024-09-14T10:58:57.265017+0000","last_clean":"2024-09-14T10:58:57.265017+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:57.265017+0000","last_undegraded":"2024-09-14T10:58:57.265017+0000","last_fullsized":"2024-09-14T10:58:57.265017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.264932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.108926+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.849928+0000","last_change":"2024-09-14T10:58:27.849928+0000","last_active":"2024-09-14T10:58:27.849928+0000","last_peered":"2024-09-14T10:58:27.849928+0000","last_clean":"2024-09-14T10:58:27.849928+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:58:27.849928+0000","last_undegraded":"2024-09-14T10:58:27.849928+0000","last_fullsized":"2024-09-14T10:58:27.849928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.849846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:39.863957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.114524+0000","last_change":"2024-09-14T10:58:59.114524+0000","last_active":"2024-09-14T10:58:59.114524+0000","last_peered":"2024-09-14T10:58:59.114524+0000","last_clean":"2024-09-14T10:58:59.114524+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:58:59.114524+0000","last_undegraded":"2024-09-14T10:58:59.114524+0000","last_fullsized":"2024-09-14T10:58:59.114524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.114437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:51.358552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.680885+0000","last_change":"2024-09-14T10:58:59.680885+0000","last_active":"2024-09-14T10:58:59.680885+0000","last_peered":"2024-09-14T10:58:59.680885+0000","last_clean":"2024-09-14T10:58:59.680885+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:59.680885+0000","last_undegraded":"2024-09-14T10:58:59.680885+0000","last_fullsized":"2024-09-14T10:58:59.680885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.680755+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:54.152021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.503094+0000","last_change":"2024-09-14T10:59:18.503094+0000","last_active":"2024-09-14T10:59:18.503094+0000","last_peered":"2024-09-14T10:59:18.503094+0000","last_clean":"2024-09-14T10:59:18.503094+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:59:18.503094+0000","last_undegraded":"2024-09-14T10:59:18.503094+0000","last_fullsized":"2024-09-14T10:59:18.503094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.503011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:17.545714+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.738448+0000","last_change":"2024-09-14T10:59:12.738448+0000","last_active":"2024-09-14T10:59:12.738448+0000","last_peered":"2024-09-14T10:59:12.738448+0000","last_clean":"2024-09-14T10:59:12.738448+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:59:12.738448+0000","last_undegraded":"2024-09-14T10:59:12.738448+0000","last_fullsized":"2024-09-14T10:59:12.738448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.738366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.547524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.142295+0000","last_change":"2024-09-14T10:58:38.142295+0000","last_active":"2024-09-14T10:58:38.142295+0000","last_peered":"2024-09-14T10:58:38.142295+0000","last_clean":"2024-09-14T10:58:38.142295+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:58:38.142295+0000","last_undegraded":"2024-09-14T10:58:38.142295+0000","last_fullsized":"2024-09-14T10:58:38.142295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.142187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:18.412057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.853379+0000","last_change":"2024-09-14T10:58:25.853379+0000","last_active":"2024-09-14T10:58:25.853379+0000","last_peered":"2024-09-14T10:58:25.853379+0000","last_clean":"2024-09-14T10:58:25.853379+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:58:25.853379+0000","last_undegraded":"2024-09-14T10:58:25.853379+0000","last_fullsized":"2024-09-14T10:58:25.853379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.853290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.774127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.503539+0000","last_change":"2024-09-14T10:58:55.503539+0000","last_active":"2024-09-14T10:58:55.503539+0000","last_peered":"2024-09-14T10:58:55.503539+0000","last_clean":"2024-09-14T10:58:55.503539+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:58:55.503539+0000","last_undegraded":"2024-09-14T10:58:55.503539+0000","last_fullsized":"2024-09-14T10:58:55.503539+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.503455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.311229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'34","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.877437+0000","last_change":"2024-09-14T10:55:10.716389+0000","last_active":"2024-09-14T10:58:19.877437+0000","last_peered":"2024-09-14T10:58:19.877437+0000","last_clean":"2024-09-14T10:58:19.877437+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:58:19.877437+0000","last_undegraded":"2024-09-14T10:58:19.877437+0000","last_fullsized":"2024-09-14T10:58:19.877437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:27.080362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.469166+0000","last_change":"2024-09-14T10:59:10.469166+0000","last_active":"2024-09-14T10:59:10.469166+0000","last_peered":"2024-09-14T10:59:10.469166+0000","last_clean":"2024-09-14T10:59:10.469166+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:59:10.469166+0000","last_undegraded":"2024-09-14T10:59:10.469166+0000","last_fullsized":"2024-09-14T10:59:10.469166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.469058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:25.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.803897+0000","last_change":"2024-09-14T10:59:18.803897+0000","last_active":"2024-09-14T10:59:18.803897+0000","last_peered":"2024-09-14T10:59:18.803897+0000","last_clean":"2024-09-14T10:59:18.803897+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:59:18.803897+0000","last_undegraded":"2024-09-14T10:59:18.803897+0000","last_fullsized":"2024-09-14T10:59:18.803897+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.803791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:35.021908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.751967+0000","last_change":"2024-09-14T10:58:39.751967+0000","last_active":"2024-09-14T10:58:39.751967+0000","last_peered":"2024-09-14T10:58:39.751967+0000","last_clean":"2024-09-14T10:58:39.751967+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:39.751967+0000","last_undegraded":"2024-09-14T10:58:39.751967+0000","last_fullsized":"2024-09-14T10:58:39.751967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.751871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:01.585910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.126916+0000","last_change":"2024-09-14T10:58:36.126916+0000","last_active":"2024-09-14T10:58:36.126916+0000","last_peered":"2024-09-14T10:58:36.126916+0000","last_clean":"2024-09-14T10:58:36.126916+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:58:36.126916+0000","last_undegraded":"2024-09-14T10:58:36.126916+0000","last_fullsized":"2024-09-14T10:58:36.126916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.126801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.157003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.468948+0000","last_change":"2024-09-14T10:58:56.468948+0000","last_active":"2024-09-14T10:58:56.468948+0000","last_peered":"2024-09-14T10:58:56.468948+0000","last_clean":"2024-09-14T10:58:56.468948+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:58:56.468948+0000","last_undegraded":"2024-09-14T10:58:56.468948+0000","last_fullsized":"2024-09-14T10:58:56.468948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.468851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:39.048237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.956566+0000","last_change":"2024-09-14T10:55:10.713878+0000","last_active":"2024-09-14T10:58:19.956566+0000","last_peered":"2024-09-14T10:58:19.956566+0000","last_clean":"2024-09-14T10:58:19.956566+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:58:19.956566+0000","last_undegraded":"2024-09-14T10:58:19.956566+0000","last_fullsized":"2024-09-14T10:58:19.956566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:09.093096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":409,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.491089+0000","last_change":"2024-09-14T10:59:15.491089+0000","last_active":"2024-09-14T10:59:15.491089+0000","last_peered":"2024-09-14T10:59:15.491089+0000","last_clean":"2024-09-14T10:59:15.491089+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:59:15.491089+0000","last_undegraded":"2024-09-14T10:59:15.491089+0000","last_fullsized":"2024-09-14T10:59:15.491089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.490991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:43.901316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:09.524849+0000","last_change":"2024-09-14T10:55:14.722182+0000","last_active":"2024-09-14T10:57:09.524849+0000","last_peered":"2024-09-14T10:57:09.524849+0000","last_clean":"2024-09-14T10:57:09.524849+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:57:09.524849+0000","last_undegraded":"2024-09-14T10:57:09.524849+0000","last_fullsized":"2024-09-14T10:57:09.524849+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:38.431255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.762964+0000","last_change":"2024-09-14T10:58:41.762964+0000","last_active":"2024-09-14T10:58:41.762964+0000","last_peered":"2024-09-14T10:58:41.762964+0000","last_clean":"2024-09-14T10:58:41.762964+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:58:41.762964+0000","last_undegraded":"2024-09-14T10:58:41.762964+0000","last_fullsized":"2024-09-14T10:58:41.762964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.762874+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:35.049658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.164518+0000","last_change":"2024-09-14T10:58:35.164518+0000","last_active":"2024-09-14T10:58:35.164518+0000","last_peered":"2024-09-14T10:58:35.164518+0000","last_clean":"2024-09-14T10:58:35.164518+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:58:35.164518+0000","last_undegraded":"2024-09-14T10:58:35.164518+0000","last_fullsized":"2024-09-14T10:58:35.164518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.164436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:54.849680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.647837+0000","last_change":"2024-09-14T10:58:50.647837+0000","last_active":"2024-09-14T10:58:50.647837+0000","last_peered":"2024-09-14T10:58:50.647837+0000","last_clean":"2024-09-14T10:58:50.647837+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:58:50.647837+0000","last_undegraded":"2024-09-14T10:58:50.647837+0000","last_fullsized":"2024-09-14T10:58:50.647837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.647749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.851323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'60","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.961897+0000","last_change":"2024-09-14T10:55:10.713716+0000","last_active":"2024-09-14T10:58:19.961897+0000","last_peered":"2024-09-14T10:58:19.961897+0000","last_clean":"2024-09-14T10:58:19.961897+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:58:19.961897+0000","last_undegraded":"2024-09-14T10:58:19.961897+0000","last_fullsized":"2024-09-14T10:58:19.961897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:29.952910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.460959+0000","last_change":"2024-09-14T10:59:12.460959+0000","last_active":"2024-09-14T10:59:12.460959+0000","last_peered":"2024-09-14T10:59:12.460959+0000","last_clean":"2024-09-14T10:59:12.460959+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:59:12.460959+0000","last_undegraded":"2024-09-14T10:59:12.460959+0000","last_fullsized":"2024-09-14T10:59:12.460959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.460863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:01.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.377651+0000","last_change":"2024-09-14T10:55:14.718288+0000","last_active":"2024-09-14T10:58:13.377651+0000","last_peered":"2024-09-14T10:58:13.377651+0000","last_clean":"2024-09-14T10:58:13.377651+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:58:13.377651+0000","last_undegraded":"2024-09-14T10:58:13.377651+0000","last_fullsized":"2024-09-14T10:58:13.377651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:01.972054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.145252+0000","last_change":"2024-09-14T10:58:40.145252+0000","last_active":"2024-09-14T10:58:40.145252+0000","last_peered":"2024-09-14T10:58:40.145252+0000","last_clean":"2024-09-14T10:58:40.145252+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:58:40.145252+0000","last_undegraded":"2024-09-14T10:58:40.145252+0000","last_fullsized":"2024-09-14T10:58:40.145252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.145160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:03.438344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.623781+0000","last_change":"2024-09-14T10:58:29.623781+0000","last_active":"2024-09-14T10:58:29.623781+0000","last_peered":"2024-09-14T10:58:29.623781+0000","last_clean":"2024-09-14T10:58:29.623781+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:58:29.623781+0000","last_undegraded":"2024-09-14T10:58:29.623781+0000","last_fullsized":"2024-09-14T10:58:29.623781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.623676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:28.939281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.719508+0000","last_change":"2024-09-14T10:58:57.719508+0000","last_active":"2024-09-14T10:58:57.719508+0000","last_peered":"2024-09-14T10:58:57.719508+0000","last_clean":"2024-09-14T10:58:57.719508+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:58:57.719508+0000","last_undegraded":"2024-09-14T10:58:57.719508+0000","last_fullsized":"2024-09-14T10:58:57.719508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.719407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:05.463897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'43","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.937066+0000","last_change":"2024-09-14T10:59:09.937066+0000","last_active":"2024-09-14T10:59:09.937066+0000","last_peered":"2024-09-14T10:59:09.937066+0000","last_clean":"2024-09-14T10:59:09.937066+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:59:09.937066+0000","last_undegraded":"2024-09-14T10:59:09.937066+0000","last_fullsized":"2024-09-14T10:59:09.937066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'43","last_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_deep_scrub":"37'43","last_deep_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.936931+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:22.882495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746371+0000","last_change":"2024-09-14T10:55:12.723340+0000","last_active":"2024-09-14T10:55:41.746371+0000","last_peered":"2024-09-14T10:55:41.746371+0000","last_clean":"2024-09-14T10:55:41.746371+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:55:41.746371+0000","last_undegraded":"2024-09-14T10:55:41.746371+0000","last_fullsized":"2024-09-14T10:55:41.746371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:36.166228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.336899+0000","last_change":"2024-09-14T10:55:14.728083+0000","last_active":"2024-09-14T10:58:13.336899+0000","last_peered":"2024-09-14T10:58:13.336899+0000","last_clean":"2024-09-14T10:58:13.336899+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:58:13.336899+0000","last_undegraded":"2024-09-14T10:58:13.336899+0000","last_fullsized":"2024-09-14T10:58:13.336899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.260882+0000","last_change":"2024-09-14T10:58:56.260882+0000","last_active":"2024-09-14T10:58:56.260882+0000","last_peered":"2024-09-14T10:58:56.260882+0000","last_clean":"2024-09-14T10:58:56.260882+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:58:56.260882+0000","last_undegraded":"2024-09-14T10:58:56.260882+0000","last_fullsized":"2024-09-14T10:58:56.260882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.260781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.141947+0000","last_change":"2024-09-14T10:58:34.141947+0000","last_active":"2024-09-14T10:58:34.141947+0000","last_peered":"2024-09-14T10:58:34.141947+0000","last_clean":"2024-09-14T10:58:34.141947+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:58:34.141947+0000","last_undegraded":"2024-09-14T10:58:34.141947+0000","last_fullsized":"2024-09-14T10:58:34.141947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.141859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:14.978632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.429031+0000","last_change":"2024-09-14T10:58:57.429031+0000","last_active":"2024-09-14T10:58:57.429031+0000","last_peered":"2024-09-14T10:58:57.429031+0000","last_clean":"2024-09-14T10:58:57.429031+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:58:57.429031+0000","last_undegraded":"2024-09-14T10:58:57.429031+0000","last_fullsized":"2024-09-14T10:58:57.429031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.428941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:25.714161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'49","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.636564+0000","last_change":"2024-09-14T10:59:00.636564+0000","last_active":"2024-09-14T10:59:00.636564+0000","last_peered":"2024-09-14T10:59:00.636564+0000","last_clean":"2024-09-14T10:59:00.636564+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:59:00.636564+0000","last_undegraded":"2024-09-14T10:59:00.636564+0000","last_fullsized":"2024-09-14T10:59:00.636564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.636458+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.391010+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.675897+0000","last_change":"2024-09-14T10:59:06.675897+0000","last_active":"2024-09-14T10:59:06.675897+0000","last_peered":"2024-09-14T10:59:06.675897+0000","last_clean":"2024-09-14T10:59:06.675897+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:59:06.675897+0000","last_undegraded":"2024-09-14T10:59:06.675897+0000","last_fullsized":"2024-09-14T10:59:06.675897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.675797+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:04.953299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'13","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.452175+0000","last_change":"2024-09-14T10:59:16.452175+0000","last_active":"2024-09-14T10:59:16.452175+0000","last_peered":"2024-09-14T10:59:16.452175+0000","last_clean":"2024-09-14T10:59:16.452175+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:59:16.452175+0000","last_undegraded":"2024-09-14T10:59:16.452175+0000","last_fullsized":"2024-09-14T10:59:16.452175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'13","last_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_deep_scrub":"37'13","last_deep_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.452083+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:31.073850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.764524+0000","last_change":"2024-09-14T10:58:40.764524+0000","last_active":"2024-09-14T10:58:40.764524+0000","last_peered":"2024-09-14T10:58:40.764524+0000","last_clean":"2024-09-14T10:58:40.764524+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:40.764524+0000","last_undegraded":"2024-09-14T10:58:40.764524+0000","last_fullsized":"2024-09-14T10:58:40.764524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.764431+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:57.754237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.139853+0000","last_change":"2024-09-14T10:58:33.139853+0000","last_active":"2024-09-14T10:58:33.139853+0000","last_peered":"2024-09-14T10:58:33.139853+0000","last_clean":"2024-09-14T10:58:33.139853+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:58:33.139853+0000","last_undegraded":"2024-09-14T10:58:33.139853+0000","last_fullsized":"2024-09-14T10:58:33.139853+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.139755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.454102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.097284+0000","last_change":"2024-09-14T10:59:04.097284+0000","last_active":"2024-09-14T10:59:04.097284+0000","last_peered":"2024-09-14T10:59:04.097284+0000","last_clean":"2024-09-14T10:59:04.097284+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:59:04.097284+0000","last_undegraded":"2024-09-14T10:59:04.097284+0000","last_fullsized":"2024-09-14T10:59:04.097284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.097190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:24.762136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.586965+0000","last_change":"2024-09-14T10:55:10.715966+0000","last_active":"2024-09-14T10:57:12.586965+0000","last_peered":"2024-09-14T10:57:12.586965+0000","last_clean":"2024-09-14T10:57:12.586965+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:57:12.586965+0000","last_undegraded":"2024-09-14T10:57:12.586965+0000","last_fullsized":"2024-09-14T10:57:12.586965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:40.106010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":471,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.979812+0000","last_change":"2024-09-14T10:59:08.979812+0000","last_active":"2024-09-14T10:59:08.979812+0000","last_peered":"2024-09-14T10:59:08.979812+0000","last_clean":"2024-09-14T10:59:08.979812+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:59:08.979812+0000","last_undegraded":"2024-09-14T10:59:08.979812+0000","last_fullsized":"2024-09-14T10:59:08.979812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.979700+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:04.708361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.696117+0000","last_change":"2024-09-14T10:59:11.696117+0000","last_active":"2024-09-14T10:59:11.696117+0000","last_peered":"2024-09-14T10:59:11.696117+0000","last_clean":"2024-09-14T10:59:11.696117+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:59:11.696117+0000","last_undegraded":"2024-09-14T10:59:11.696117+0000","last_fullsized":"2024-09-14T10:59:11.696117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.696028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.462538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.122287+0000","last_change":"2024-09-14T10:58:42.122287+0000","last_active":"2024-09-14T10:58:42.122287+0000","last_peered":"2024-09-14T10:58:42.122287+0000","last_clean":"2024-09-14T10:58:42.122287+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:58:42.122287+0000","last_undegraded":"2024-09-14T10:58:42.122287+0000","last_fullsized":"2024-09-14T10:58:42.122287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.122178+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:54.680983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.154586+0000","last_change":"2024-09-14T10:58:32.154586+0000","last_active":"2024-09-14T10:58:32.154586+0000","last_peered":"2024-09-14T10:58:32.154586+0000","last_clean":"2024-09-14T10:58:32.154586+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:58:32.154586+0000","last_undegraded":"2024-09-14T10:58:32.154586+0000","last_fullsized":"2024-09-14T10:58:32.154586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.154493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.858878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.211383+0000","last_change":"2024-09-14T10:59:14.211383+0000","last_active":"2024-09-14T10:59:14.211383+0000","last_peered":"2024-09-14T10:59:14.211383+0000","last_clean":"2024-09-14T10:59:14.211383+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:59:14.211383+0000","last_undegraded":"2024-09-14T10:59:14.211383+0000","last_fullsized":"2024-09-14T10:59:14.211383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.211298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:33.896220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.008101+0000","last_change":"2024-09-14T10:59:08.008101+0000","last_active":"2024-09-14T10:59:08.008101+0000","last_peered":"2024-09-14T10:59:08.008101+0000","last_clean":"2024-09-14T10:59:08.008101+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:59:08.008101+0000","last_undegraded":"2024-09-14T10:59:08.008101+0000","last_fullsized":"2024-09-14T10:59:08.008101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.007987+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:18.101895+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.666964+0000","last_change":"2024-09-14T10:59:05.666964+0000","last_active":"2024-09-14T10:59:05.666964+0000","last_peered":"2024-09-14T10:59:05.666964+0000","last_clean":"2024-09-14T10:59:05.666964+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:59:05.666964+0000","last_undegraded":"2024-09-14T10:59:05.666964+0000","last_fullsized":"2024-09-14T10:59:05.666964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.666866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:58.215776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.813354+0000","last_change":"2024-09-14T10:59:17.813354+0000","last_active":"2024-09-14T10:59:17.813354+0000","last_peered":"2024-09-14T10:59:17.813354+0000","last_clean":"2024-09-14T10:59:17.813354+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:59:17.813354+0000","last_undegraded":"2024-09-14T10:59:17.813354+0000","last_fullsized":"2024-09-14T10:59:17.813354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.813268+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.517653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.270136+0000","last_change":"2024-09-14T10:58:54.270045+0000","last_active":"2024-09-14T10:58:54.270136+0000","last_peered":"2024-09-14T10:58:54.270136+0000","last_clean":"2024-09-14T10:58:54.270136+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:58:54.270136+0000","last_undegraded":"2024-09-14T10:58:54.270136+0000","last_fullsized":"2024-09-14T10:58:54.270136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.269944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:15.040276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.259271+0000","last_change":"2024-09-14T10:58:24.259197+0000","last_active":"2024-09-14T10:58:24.259271+0000","last_peered":"2024-09-14T10:58:24.259271+0000","last_clean":"2024-09-14T10:58:24.259271+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:58:24.259271+0000","last_undegraded":"2024-09-14T10:58:24.259271+0000","last_fullsized":"2024-09-14T10:58:24.259271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.259102+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:48.731970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.056067+0000","last_change":"2024-09-14T10:58:28.055953+0000","last_active":"2024-09-14T10:58:28.056067+0000","last_peered":"2024-09-14T10:58:28.056067+0000","last_clean":"2024-09-14T10:58:28.056067+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:58:28.056067+0000","last_undegraded":"2024-09-14T10:58:28.056067+0000","last_fullsized":"2024-09-14T10:58:28.056067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.055847+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:09.084414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.127724+0000","last_change":"2024-09-14T10:58:30.127641+0000","last_active":"2024-09-14T10:58:30.127724+0000","last_peered":"2024-09-14T10:58:30.127724+0000","last_clean":"2024-09-14T10:58:30.127724+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:30.127724+0000","last_undegraded":"2024-09-14T10:58:30.127724+0000","last_fullsized":"2024-09-14T10:58:30.127724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.127553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.604808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.100990+0000","last_change":"2024-09-14T10:58:58.100923+0000","last_active":"2024-09-14T10:58:58.100990+0000","last_peered":"2024-09-14T10:58:58.100990+0000","last_clean":"2024-09-14T10:58:58.100990+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:58:58.100990+0000","last_undegraded":"2024-09-14T10:58:58.100990+0000","last_fullsized":"2024-09-14T10:58:58.100990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.100810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:42.350681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.947965+0000","last_change":"2024-09-14T10:55:10.714287+0000","last_active":"2024-09-14T10:58:19.947965+0000","last_peered":"2024-09-14T10:58:19.947965+0000","last_clean":"2024-09-14T10:58:19.947965+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:58:19.947965+0000","last_undegraded":"2024-09-14T10:58:19.947965+0000","last_fullsized":"2024-09-14T10:58:19.947965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:50.606792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.415993+0000","last_change":"2024-09-14T10:59:08.415993+0000","last_active":"2024-09-14T10:59:08.415993+0000","last_peered":"2024-09-14T10:59:08.415993+0000","last_clean":"2024-09-14T10:59:08.415993+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:59:08.415993+0000","last_undegraded":"2024-09-14T10:59:08.415993+0000","last_fullsized":"2024-09-14T10:59:08.415993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.415907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.088717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":171,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.788337+0000","last_change":"2024-09-14T10:59:13.788337+0000","last_active":"2024-09-14T10:59:13.788337+0000","last_peered":"2024-09-14T10:59:13.788337+0000","last_clean":"2024-09-14T10:59:13.788337+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:59:13.788337+0000","last_undegraded":"2024-09-14T10:59:13.788337+0000","last_fullsized":"2024-09-14T10:59:13.788337+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'81","last_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_deep_scrub":"37'81","last_deep_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.788216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:53.195658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.286417+0000","last_change":"2024-09-14T10:58:55.286417+0000","last_active":"2024-09-14T10:58:55.286417+0000","last_peered":"2024-09-14T10:58:55.286417+0000","last_clean":"2024-09-14T10:58:55.286417+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:55.286417+0000","last_undegraded":"2024-09-14T10:58:55.286417+0000","last_fullsized":"2024-09-14T10:58:55.286417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.286296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.817177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.090047+0000","last_change":"2024-09-14T10:58:25.089983+0000","last_active":"2024-09-14T10:58:25.090047+0000","last_peered":"2024-09-14T10:58:25.090047+0000","last_clean":"2024-09-14T10:58:25.090047+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:58:25.090047+0000","last_undegraded":"2024-09-14T10:58:25.090047+0000","last_fullsized":"2024-09-14T10:58:25.090047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:47.106405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.587614+0000","last_change":"2024-09-14T10:58:26.587548+0000","last_active":"2024-09-14T10:58:26.587614+0000","last_peered":"2024-09-14T10:58:26.587614+0000","last_clean":"2024-09-14T10:58:26.587614+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:58:26.587614+0000","last_undegraded":"2024-09-14T10:58:26.587614+0000","last_fullsized":"2024-09-14T10:58:26.587614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.587449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:17.118474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.240769+0000","last_change":"2024-09-14T10:59:15.240769+0000","last_active":"2024-09-14T10:59:15.240769+0000","last_peered":"2024-09-14T10:59:15.240769+0000","last_clean":"2024-09-14T10:59:15.240769+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:59:15.240769+0000","last_undegraded":"2024-09-14T10:59:15.240769+0000","last_fullsized":"2024-09-14T10:59:15.240769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.240678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:15.558925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":519,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.015481+0000","last_change":"2024-09-14T10:59:07.015417+0000","last_active":"2024-09-14T10:59:07.015481+0000","last_peered":"2024-09-14T10:59:07.015481+0000","last_clean":"2024-09-14T10:59:07.015481+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:59:07.015481+0000","last_undegraded":"2024-09-14T10:59:07.015481+0000","last_fullsized":"2024-09-14T10:59:07.015481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.015303+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:51.782594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:17.097128+0000","last_change":"2024-09-14T10:55:12.723419+0000","last_active":"2024-09-14T10:57:17.097128+0000","last_peered":"2024-09-14T10:57:17.097128+0000","last_clean":"2024-09-14T10:57:17.097128+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:57:17.097128+0000","last_undegraded":"2024-09-14T10:57:17.097128+0000","last_fullsized":"2024-09-14T10:57:17.097128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.858942+0000","last_change":"2024-09-14T10:59:20.858942+0000","last_active":"2024-09-14T10:59:20.858942+0000","last_peered":"2024-09-14T10:59:20.858942+0000","last_clean":"2024-09-14T10:59:20.858942+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:59:20.858942+0000","last_undegraded":"2024-09-14T10:59:20.858942+0000","last_fullsized":"2024-09-14T10:59:20.858942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.858844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.544088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.557700+0000","last_change":"2024-09-14T10:58:40.557700+0000","last_active":"2024-09-14T10:58:40.557700+0000","last_peered":"2024-09-14T10:58:40.557700+0000","last_clean":"2024-09-14T10:58:40.557700+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:40.557700+0000","last_undegraded":"2024-09-14T10:58:40.557700+0000","last_fullsized":"2024-09-14T10:58:40.557700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.557602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:10.950855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.791361+0000","last_change":"2024-09-14T10:58:23.791275+0000","last_active":"2024-09-14T10:58:23.791361+0000","last_peered":"2024-09-14T10:58:23.791361+0000","last_clean":"2024-09-14T10:58:23.791361+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:58:23.791361+0000","last_undegraded":"2024-09-14T10:58:23.791361+0000","last_fullsized":"2024-09-14T10:58:23.791361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.791189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:54.211244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.586979+0000","last_change":"2024-09-14T10:58:25.586908+0000","last_active":"2024-09-14T10:58:25.586979+0000","last_peered":"2024-09-14T10:58:25.586979+0000","last_clean":"2024-09-14T10:58:25.586979+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:25.586979+0000","last_undegraded":"2024-09-14T10:58:25.586979+0000","last_fullsized":"2024-09-14T10:58:25.586979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.586807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:59.791741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.694574+0000","last_change":"2024-09-14T10:58:51.694574+0000","last_active":"2024-09-14T10:58:51.694574+0000","last_peered":"2024-09-14T10:58:51.694574+0000","last_clean":"2024-09-14T10:58:51.694574+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:58:51.694574+0000","last_undegraded":"2024-09-14T10:58:51.694574+0000","last_fullsized":"2024-09-14T10:58:51.694574+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.694493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:32.029523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.679036+0000","last_change":"2024-09-14T10:58:58.678947+0000","last_active":"2024-09-14T10:58:58.679036+0000","last_peered":"2024-09-14T10:58:58.679036+0000","last_clean":"2024-09-14T10:58:58.679036+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:58.679036+0000","last_undegraded":"2024-09-14T10:58:58.679036+0000","last_fullsized":"2024-09-14T10:58:58.679036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.678809+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:42.184294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.385340+0000","last_change":"2024-09-14T10:59:07.385340+0000","last_active":"2024-09-14T10:59:07.385340+0000","last_peered":"2024-09-14T10:59:07.385340+0000","last_clean":"2024-09-14T10:59:07.385340+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:59:07.385340+0000","last_undegraded":"2024-09-14T10:59:07.385340+0000","last_fullsized":"2024-09-14T10:59:07.385340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.385243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:37.754783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.067621+0000","last_change":"2024-09-14T10:55:14.729403+0000","last_active":"2024-09-14T10:58:13.067621+0000","last_peered":"2024-09-14T10:58:13.067621+0000","last_clean":"2024-09-14T10:58:13.067621+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:58:13.067621+0000","last_undegraded":"2024-09-14T10:58:13.067621+0000","last_fullsized":"2024-09-14T10:58:13.067621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:53.970443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.572976+0000","last_change":"2024-09-14T10:58:39.572915+0000","last_active":"2024-09-14T10:58:39.572976+0000","last_peered":"2024-09-14T10:58:39.572976+0000","last_clean":"2024-09-14T10:58:39.572976+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:39.572976+0000","last_undegraded":"2024-09-14T10:58:39.572976+0000","last_fullsized":"2024-09-14T10:58:39.572976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.572821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.045575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.107071+0000","last_change":"2024-09-14T10:58:26.106994+0000","last_active":"2024-09-14T10:58:26.107071+0000","last_peered":"2024-09-14T10:58:26.107071+0000","last_clean":"2024-09-14T10:58:26.107071+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:58:26.107071+0000","last_undegraded":"2024-09-14T10:58:26.107071+0000","last_fullsized":"2024-09-14T10:58:26.107071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.106908+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:54.967192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.820671+0000","last_change":"2024-09-14T10:58:24.820612+0000","last_active":"2024-09-14T10:58:24.820671+0000","last_peered":"2024-09-14T10:58:24.820671+0000","last_clean":"2024-09-14T10:58:24.820671+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:58:24.820671+0000","last_undegraded":"2024-09-14T10:58:24.820671+0000","last_fullsized":"2024-09-14T10:58:24.820671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.820510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:45.492993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.499164+0000","last_change":"2024-09-14T10:58:54.499067+0000","last_active":"2024-09-14T10:58:54.499164+0000","last_peered":"2024-09-14T10:58:54.499164+0000","last_clean":"2024-09-14T10:58:54.499164+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:58:54.499164+0000","last_undegraded":"2024-09-14T10:58:54.499164+0000","last_fullsized":"2024-09-14T10:58:54.499164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.498961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.100542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'22","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.388113+0000","last_change":"2024-09-14T10:59:21.388113+0000","last_active":"2024-09-14T10:59:21.388113+0000","last_peered":"2024-09-14T10:59:21.388113+0000","last_clean":"2024-09-14T10:59:21.388113+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:59:21.388113+0000","last_undegraded":"2024-09-14T10:59:21.388113+0000","last_fullsized":"2024-09-14T10:59:21.388113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.388025+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:27.387659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746907+0000","last_change":"2024-09-14T10:55:12.723582+0000","last_active":"2024-09-14T10:55:41.746907+0000","last_peered":"2024-09-14T10:55:41.746907+0000","last_clean":"2024-09-14T10:55:41.746907+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:55:41.746907+0000","last_undegraded":"2024-09-14T10:55:41.746907+0000","last_fullsized":"2024-09-14T10:55:41.746907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:27.165393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.826528+0000","last_change":"2024-09-14T10:59:19.826528+0000","last_active":"2024-09-14T10:59:19.826528+0000","last_peered":"2024-09-14T10:59:19.826528+0000","last_clean":"2024-09-14T10:59:19.826528+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:59:19.826528+0000","last_undegraded":"2024-09-14T10:59:19.826528+0000","last_fullsized":"2024-09-14T10:59:19.826528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.826448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:56.627240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.173116+0000","last_change":"2024-09-14T10:58:37.173058+0000","last_active":"2024-09-14T10:58:37.173116+0000","last_peered":"2024-09-14T10:58:37.173116+0000","last_clean":"2024-09-14T10:58:37.173116+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:37.173116+0000","last_undegraded":"2024-09-14T10:58:37.173116+0000","last_fullsized":"2024-09-14T10:58:37.173116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.172972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:17.508002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.859776+0000","last_change":"2024-09-14T10:58:26.859668+0000","last_active":"2024-09-14T10:58:26.859776+0000","last_peered":"2024-09-14T10:58:26.859776+0000","last_clean":"2024-09-14T10:58:26.859776+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:58:26.859776+0000","last_undegraded":"2024-09-14T10:58:26.859776+0000","last_fullsized":"2024-09-14T10:58:26.859776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.859576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:53.447405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.568697+0000","last_change":"2024-09-14T10:58:23.568609+0000","last_active":"2024-09-14T10:58:23.568697+0000","last_peered":"2024-09-14T10:58:23.568697+0000","last_clean":"2024-09-14T10:58:23.568697+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:58:23.568697+0000","last_undegraded":"2024-09-14T10:58:23.568697+0000","last_fullsized":"2024-09-14T10:58:23.568697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.568525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:01.283682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.462335+0000","last_change":"2024-09-14T10:58:53.462273+0000","last_active":"2024-09-14T10:58:53.462335+0000","last_peered":"2024-09-14T10:58:53.462335+0000","last_clean":"2024-09-14T10:58:53.462335+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:53.462335+0000","last_undegraded":"2024-09-14T10:58:53.462335+0000","last_fullsized":"2024-09-14T10:58:53.462335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.462186+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:08.865241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'76","reported_seq":153,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.436010+0000","last_change":"2024-09-14T10:59:01.435949+0000","last_active":"2024-09-14T10:59:01.436010+0000","last_peered":"2024-09-14T10:59:01.436010+0000","last_clean":"2024-09-14T10:59:01.436010+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:59:01.436010+0000","last_undegraded":"2024-09-14T10:59:01.436010+0000","last_fullsized":"2024-09-14T10:59:01.436010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'76","last_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_deep_scrub":"37'76","last_deep_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.435845+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:19.503768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.681206+0000","last_change":"2024-09-14T10:59:04.681154+0000","last_active":"2024-09-14T10:59:04.681206+0000","last_peered":"2024-09-14T10:59:04.681206+0000","last_clean":"2024-09-14T10:59:04.681206+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:59:04.681206+0000","last_undegraded":"2024-09-14T10:59:04.681206+0000","last_fullsized":"2024-09-14T10:59:04.681206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.681068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:31.995348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.521690+0000","last_change":"2024-09-14T10:55:14.720854+0000","last_active":"2024-09-14T10:57:12.521690+0000","last_peered":"2024-09-14T10:57:12.521690+0000","last_clean":"2024-09-14T10:57:12.521690+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:57:12.521690+0000","last_undegraded":"2024-09-14T10:57:12.521690+0000","last_fullsized":"2024-09-14T10:57:12.521690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:25.927111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.116613+0000","last_change":"2024-09-14T10:58:39.116558+0000","last_active":"2024-09-14T10:58:39.116613+0000","last_peered":"2024-09-14T10:58:39.116613+0000","last_clean":"2024-09-14T10:58:39.116613+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:39.116613+0000","last_undegraded":"2024-09-14T10:58:39.116613+0000","last_fullsized":"2024-09-14T10:58:39.116613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.116455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:06.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.594205+0000","last_change":"2024-09-14T10:58:27.594149+0000","last_active":"2024-09-14T10:58:27.594205+0000","last_peered":"2024-09-14T10:58:27.594205+0000","last_clean":"2024-09-14T10:58:27.594205+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:27.594205+0000","last_undegraded":"2024-09-14T10:58:27.594205+0000","last_fullsized":"2024-09-14T10:58:27.594205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.594048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:09.026037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.081677+0000","last_change":"2024-09-14T10:58:27.081564+0000","last_active":"2024-09-14T10:58:27.081677+0000","last_peered":"2024-09-14T10:58:27.081677+0000","last_clean":"2024-09-14T10:58:27.081677+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:58:27.081677+0000","last_undegraded":"2024-09-14T10:58:27.081677+0000","last_fullsized":"2024-09-14T10:58:27.081677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.081459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.187198+0000","last_change":"2024-09-14T10:59:13.187086+0000","last_active":"2024-09-14T10:59:13.187198+0000","last_peered":"2024-09-14T10:59:13.187198+0000","last_clean":"2024-09-14T10:59:13.187198+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:59:13.187198+0000","last_undegraded":"2024-09-14T10:59:13.187198+0000","last_fullsized":"2024-09-14T10:59:13.187198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.186988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:15.867651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.059645+0000","last_change":"2024-09-14T10:59:06.059580+0000","last_active":"2024-09-14T10:59:06.059645+0000","last_peered":"2024-09-14T10:59:06.059645+0000","last_clean":"2024-09-14T10:59:06.059645+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:59:06.059645+0000","last_undegraded":"2024-09-14T10:59:06.059645+0000","last_fullsized":"2024-09-14T10:59:06.059645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.059473+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:52.359073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.929779+0000","last_change":"2024-09-14T10:59:10.929681+0000","last_active":"2024-09-14T10:59:10.929779+0000","last_peered":"2024-09-14T10:59:10.929779+0000","last_clean":"2024-09-14T10:59:10.929779+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:59:10.929779+0000","last_undegraded":"2024-09-14T10:59:10.929779+0000","last_fullsized":"2024-09-14T10:59:10.929779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.929558+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:32.946072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.238769+0000","last_change":"2024-09-14T10:58:53.238709+0000","last_active":"2024-09-14T10:58:53.238769+0000","last_peered":"2024-09-14T10:58:53.238769+0000","last_clean":"2024-09-14T10:58:53.238769+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:58:53.238769+0000","last_undegraded":"2024-09-14T10:58:53.238769+0000","last_fullsized":"2024-09-14T10:58:53.238769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.238622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.890586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.116581+0000","last_change":"2024-09-14T10:58:31.116581+0000","last_active":"2024-09-14T10:58:31.116581+0000","last_peered":"2024-09-14T10:58:31.116581+0000","last_clean":"2024-09-14T10:58:31.116581+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:58:31.116581+0000","last_undegraded":"2024-09-14T10:58:31.116581+0000","last_fullsized":"2024-09-14T10:58:31.116581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.116494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.643323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.589321+0000","last_change":"2024-09-14T10:58:24.589271+0000","last_active":"2024-09-14T10:58:24.589321+0000","last_peered":"2024-09-14T10:58:24.589321+0000","last_clean":"2024-09-14T10:58:24.589321+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:58:24.589321+0000","last_undegraded":"2024-09-14T10:58:24.589321+0000","last_fullsized":"2024-09-14T10:58:24.589321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.589189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:10.074498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.205725+0000","last_change":"2024-09-14T10:59:12.205661+0000","last_active":"2024-09-14T10:59:12.205725+0000","last_peered":"2024-09-14T10:59:12.205725+0000","last_clean":"2024-09-14T10:59:12.205725+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:59:12.205725+0000","last_undegraded":"2024-09-14T10:59:12.205725+0000","last_fullsized":"2024-09-14T10:59:12.205725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.205517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.359398+0000","last_change":"2024-09-14T10:59:20.359321+0000","last_active":"2024-09-14T10:59:20.359398+0000","last_peered":"2024-09-14T10:59:20.359398+0000","last_clean":"2024-09-14T10:59:20.359398+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:59:20.359398+0000","last_undegraded":"2024-09-14T10:59:20.359398+0000","last_fullsized":"2024-09-14T10:59:20.359398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.359218+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:25.021682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":401,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.493228+0000","last_change":"2024-09-14T10:59:13.493228+0000","last_active":"2024-09-14T10:59:13.493228+0000","last_peered":"2024-09-14T10:59:13.493228+0000","last_clean":"2024-09-14T10:59:13.493228+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:59:13.493228+0000","last_undegraded":"2024-09-14T10:59:13.493228+0000","last_fullsized":"2024-09-14T10:59:13.493228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.493141+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:03.120118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'8","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.843260+0000","last_change":"2024-09-14T10:59:21.843260+0000","last_active":"2024-09-14T10:59:21.843260+0000","last_peered":"2024-09-14T10:59:21.843260+0000","last_clean":"2024-09-14T10:59:21.843260+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:59:21.843260+0000","last_undegraded":"2024-09-14T10:59:21.843260+0000","last_fullsized":"2024-09-14T10:59:21.843260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.843177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:05.873379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.746067+0000","last_change":"2024-09-14T10:58:38.745965+0000","last_active":"2024-09-14T10:58:38.746067+0000","last_peered":"2024-09-14T10:58:38.746067+0000","last_clean":"2024-09-14T10:58:38.746067+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:38.746067+0000","last_undegraded":"2024-09-14T10:58:38.746067+0000","last_fullsized":"2024-09-14T10:58:38.746067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.745855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.592315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.289652+0000","last_change":"2024-09-14T10:58:26.289652+0000","last_active":"2024-09-14T10:58:26.289652+0000","last_peered":"2024-09-14T10:58:26.289652+0000","last_clean":"2024-09-14T10:58:26.289652+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:58:26.289652+0000","last_undegraded":"2024-09-14T10:58:26.289652+0000","last_fullsized":"2024-09-14T10:58:26.289652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.289566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.279373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.103763+0000","last_change":"2024-09-14T10:58:29.103701+0000","last_active":"2024-09-14T10:58:29.103763+0000","last_peered":"2024-09-14T10:58:29.103763+0000","last_clean":"2024-09-14T10:58:29.103763+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:58:29.103763+0000","last_undegraded":"2024-09-14T10:58:29.103763+0000","last_fullsized":"2024-09-14T10:58:29.103763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.103624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:04.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.222060+0000","last_change":"2024-09-14T10:59:11.221996+0000","last_active":"2024-09-14T10:59:11.222060+0000","last_peered":"2024-09-14T10:59:11.222060+0000","last_clean":"2024-09-14T10:59:11.222060+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:59:11.222060+0000","last_undegraded":"2024-09-14T10:59:11.222060+0000","last_fullsized":"2024-09-14T10:59:11.222060+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.221910+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:56.327449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'101","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.691560+0000","last_change":"2024-09-14T10:58:56.691503+0000","last_active":"2024-09-14T10:58:56.691560+0000","last_peered":"2024-09-14T10:58:56.691560+0000","last_clean":"2024-09-14T10:58:56.691560+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:56.691560+0000","last_undegraded":"2024-09-14T10:58:56.691560+0000","last_fullsized":"2024-09-14T10:58:56.691560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'101","last_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_deep_scrub":"37'101","last_deep_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.691401+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:40.292482+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.423553+0000","last_change":"2024-09-14T10:59:06.423553+0000","last_active":"2024-09-14T10:59:06.423553+0000","last_peered":"2024-09-14T10:59:06.423553+0000","last_clean":"2024-09-14T10:59:06.423553+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:59:06.423553+0000","last_undegraded":"2024-09-14T10:59:06.423553+0000","last_fullsized":"2024-09-14T10:59:06.423553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.423468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:55.849051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.824478+0000","last_change":"2024-09-14T10:59:14.824478+0000","last_active":"2024-09-14T10:59:14.824478+0000","last_peered":"2024-09-14T10:59:14.824478+0000","last_clean":"2024-09-14T10:59:14.824478+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:59:14.824478+0000","last_undegraded":"2024-09-14T10:59:14.824478+0000","last_fullsized":"2024-09-14T10:59:14.824478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.824378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:39.981806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.895449+0000","last_change":"2024-09-14T10:59:16.895449+0000","last_active":"2024-09-14T10:59:16.895449+0000","last_peered":"2024-09-14T10:59:16.895449+0000","last_clean":"2024-09-14T10:59:16.895449+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:59:16.895449+0000","last_undegraded":"2024-09-14T10:59:16.895449+0000","last_fullsized":"2024-09-14T10:59:16.895449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.895366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.067531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.732352+0000","last_change":"2024-09-14T10:58:42.732352+0000","last_active":"2024-09-14T10:58:42.732352+0000","last_peered":"2024-09-14T10:58:42.732352+0000","last_clean":"2024-09-14T10:58:42.732352+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:58:42.732352+0000","last_undegraded":"2024-09-14T10:58:42.732352+0000","last_fullsized":"2024-09-14T10:58:42.732352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.732246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:14.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.177563+0000","last_change":"2024-09-14T10:58:41.177563+0000","last_active":"2024-09-14T10:58:41.177563+0000","last_peered":"2024-09-14T10:58:41.177563+0000","last_clean":"2024-09-14T10:58:41.177563+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:58:41.177563+0000","last_undegraded":"2024-09-14T10:58:41.177563+0000","last_fullsized":"2024-09-14T10:58:41.177563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.177454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:25.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.069060+0000","last_change":"2024-09-14T10:59:00.069060+0000","last_active":"2024-09-14T10:59:00.069060+0000","last_peered":"2024-09-14T10:59:00.069060+0000","last_clean":"2024-09-14T10:59:00.069060+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:59:00.069060+0000","last_undegraded":"2024-09-14T10:59:00.069060+0000","last_fullsized":"2024-09-14T10:59:00.069060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.068976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:01.384012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.953860+0000","last_change":"2024-09-14T10:55:10.712174+0000","last_active":"2024-09-14T10:58:19.953860+0000","last_peered":"2024-09-14T10:58:19.953860+0000","last_clean":"2024-09-14T10:58:19.953860+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:58:19.953860+0000","last_undegraded":"2024-09-14T10:58:19.953860+0000","last_fullsized":"2024-09-14T10:58:19.953860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:00.657691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742524+0000","last_change":"2024-09-14T10:55:12.722034+0000","last_active":"2024-09-14T10:55:41.742524+0000","last_peered":"2024-09-14T10:55:41.742524+0000","last_clean":"2024-09-14T10:55:41.742524+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:55:41.742524+0000","last_undegraded":"2024-09-14T10:55:41.742524+0000","last_fullsized":"2024-09-14T10:55:41.742524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:21:01.514046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:15.085529+0000","last_change":"2024-09-14T10:55:14.718281+0000","last_active":"2024-09-14T10:57:15.085529+0000","last_peered":"2024-09-14T10:57:15.085529+0000","last_clean":"2024-09-14T10:57:15.085529+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:57:15.085529+0000","last_undegraded":"2024-09-14T10:57:15.085529+0000","last_fullsized":"2024-09-14T10:57:15.085529+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.081008+0000","last_change":"2024-09-14T10:58:43.081008+0000","last_active":"2024-09-14T10:58:43.081008+0000","last_peered":"2024-09-14T10:58:43.081008+0000","last_clean":"2024-09-14T10:58:43.081008+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:58:43.081008+0000","last_undegraded":"2024-09-14T10:58:43.081008+0000","last_fullsized":"2024-09-14T10:58:43.081008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.080921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:50.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.775299+0000","last_change":"2024-09-14T10:58:30.775299+0000","last_active":"2024-09-14T10:58:30.775299+0000","last_peered":"2024-09-14T10:58:30.775299+0000","last_clean":"2024-09-14T10:58:30.775299+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:58:30.775299+0000","last_undegraded":"2024-09-14T10:58:30.775299+0000","last_fullsized":"2024-09-14T10:58:30.775299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.775211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:47.614898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.294422+0000","last_change":"2024-09-14T10:59:17.294422+0000","last_active":"2024-09-14T10:59:17.294422+0000","last_peered":"2024-09-14T10:59:17.294422+0000","last_clean":"2024-09-14T10:59:17.294422+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:59:17.294422+0000","last_undegraded":"2024-09-14T10:59:17.294422+0000","last_fullsized":"2024-09-14T10:59:17.294422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.294339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:41.287665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.450923+0000","last_change":"2024-09-14T10:59:05.450923+0000","last_active":"2024-09-14T10:59:05.450923+0000","last_peered":"2024-09-14T10:59:05.450923+0000","last_clean":"2024-09-14T10:59:05.450923+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:59:05.450923+0000","last_undegraded":"2024-09-14T10:59:05.450923+0000","last_fullsized":"2024-09-14T10:59:05.450923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.450828+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.547681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.721772+0000","last_change":"2024-09-14T10:59:07.721772+0000","last_active":"2024-09-14T10:59:07.721772+0000","last_peered":"2024-09-14T10:59:07.721772+0000","last_clean":"2024-09-14T10:59:07.721772+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:59:07.721772+0000","last_undegraded":"2024-09-14T10:59:07.721772+0000","last_fullsized":"2024-09-14T10:59:07.721772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.721683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:53.356436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746361+0000","last_change":"2024-09-14T10:55:14.722441+0000","last_active":"2024-09-14T10:55:41.746361+0000","last_peered":"2024-09-14T10:55:41.746361+0000","last_clean":"2024-09-14T10:55:41.746361+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:55:41.746361+0000","last_undegraded":"2024-09-14T10:55:41.746361+0000","last_fullsized":"2024-09-14T10:55:41.746361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:44.177757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.535431+0000","last_change":"2024-09-14T10:58:41.535431+0000","last_active":"2024-09-14T10:58:41.535431+0000","last_peered":"2024-09-14T10:58:41.535431+0000","last_clean":"2024-09-14T10:58:41.535431+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:41.535431+0000","last_undegraded":"2024-09-14T10:58:41.535431+0000","last_fullsized":"2024-09-14T10:58:41.535431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.535348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:23.024244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.788388+0000","last_change":"2024-09-14T10:58:29.788388+0000","last_active":"2024-09-14T10:58:29.788388+0000","last_peered":"2024-09-14T10:58:29.788388+0000","last_clean":"2024-09-14T10:58:29.788388+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:58:29.788388+0000","last_undegraded":"2024-09-14T10:58:29.788388+0000","last_fullsized":"2024-09-14T10:58:29.788388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.788303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:32.833510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.684626+0000","last_change":"2024-09-14T10:58:52.684626+0000","last_active":"2024-09-14T10:58:52.684626+0000","last_peered":"2024-09-14T10:58:52.684626+0000","last_clean":"2024-09-14T10:58:52.684626+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:58:52.684626+0000","last_undegraded":"2024-09-14T10:58:52.684626+0000","last_fullsized":"2024-09-14T10:58:52.684626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.684528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.491610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'49","reported_seq":121,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.435649+0000","last_change":"2024-09-14T10:59:02.435649+0000","last_active":"2024-09-14T10:59:02.435649+0000","last_peered":"2024-09-14T10:59:02.435649+0000","last_clean":"2024-09-14T10:59:02.435649+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:59:02.435649+0000","last_undegraded":"2024-09-14T10:59:02.435649+0000","last_fullsized":"2024-09-14T10:59:02.435649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.435554+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:13.499863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.855092+0000","last_change":"2024-09-14T10:59:13.855092+0000","last_active":"2024-09-14T10:59:13.855092+0000","last_peered":"2024-09-14T10:59:13.855092+0000","last_clean":"2024-09-14T10:59:13.855092+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:59:13.855092+0000","last_undegraded":"2024-09-14T10:59:13.855092+0000","last_fullsized":"2024-09-14T10:59:13.855092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.855007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.983456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.289056+0000","last_change":"2024-09-14T10:58:58.289056+0000","last_active":"2024-09-14T10:58:58.289056+0000","last_peered":"2024-09-14T10:58:58.289056+0000","last_clean":"2024-09-14T10:58:58.289056+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:58:58.289056+0000","last_undegraded":"2024-09-14T10:58:58.289056+0000","last_fullsized":"2024-09-14T10:58:58.289056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.288955+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.787124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.206920+0000","last_change":"2024-09-14T10:58:29.206920+0000","last_active":"2024-09-14T10:58:29.206920+0000","last_peered":"2024-09-14T10:58:29.206920+0000","last_clean":"2024-09-14T10:58:29.206920+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:58:29.206920+0000","last_undegraded":"2024-09-14T10:58:29.206920+0000","last_fullsized":"2024-09-14T10:58:29.206920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.206835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:53.545366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.247242+0000","last_change":"2024-09-14T10:59:16.247242+0000","last_active":"2024-09-14T10:59:16.247242+0000","last_peered":"2024-09-14T10:59:16.247242+0000","last_clean":"2024-09-14T10:59:16.247242+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:59:16.247242+0000","last_undegraded":"2024-09-14T10:59:16.247242+0000","last_fullsized":"2024-09-14T10:59:16.247242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.247150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:52.172918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.665776+0000","last_change":"2024-09-14T10:59:01.665776+0000","last_active":"2024-09-14T10:59:01.665776+0000","last_peered":"2024-09-14T10:59:01.665776+0000","last_clean":"2024-09-14T10:59:01.665776+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:59:01.665776+0000","last_undegraded":"2024-09-14T10:59:01.665776+0000","last_fullsized":"2024-09-14T10:59:01.665776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.665619+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:22.301986+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.686929+0000","last_change":"2024-09-14T10:59:08.686929+0000","last_active":"2024-09-14T10:59:08.686929+0000","last_peered":"2024-09-14T10:59:08.686929+0000","last_clean":"2024-09-14T10:59:08.686929+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:59:08.686929+0000","last_undegraded":"2024-09-14T10:59:08.686929+0000","last_fullsized":"2024-09-14T10:59:08.686929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.686815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:37.922629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.311192+0000","last_change":"2024-09-14T10:59:03.311089+0000","last_active":"2024-09-14T10:59:03.311192+0000","last_peered":"2024-09-14T10:59:03.311192+0000","last_clean":"2024-09-14T10:59:03.311192+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:59:03.311192+0000","last_undegraded":"2024-09-14T10:59:03.311192+0000","last_fullsized":"2024-09-14T10:59:03.311192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.310960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:15.706209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.107566+0000","last_change":"2024-09-14T10:58:39.107566+0000","last_active":"2024-09-14T10:58:39.107566+0000","last_peered":"2024-09-14T10:58:39.107566+0000","last_clean":"2024-09-14T10:58:39.107566+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:58:39.107566+0000","last_undegraded":"2024-09-14T10:58:39.107566+0000","last_fullsized":"2024-09-14T10:58:39.107566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.107454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:43.832399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.451636+0000","last_change":"2024-09-14T10:59:00.451569+0000","last_active":"2024-09-14T10:59:00.451636+0000","last_peered":"2024-09-14T10:59:00.451636+0000","last_clean":"2024-09-14T10:59:00.451636+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:59:00.451636+0000","last_undegraded":"2024-09-14T10:59:00.451636+0000","last_fullsized":"2024-09-14T10:59:00.451636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.451469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:40.073007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'65","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.484527+0000","last_change":"2024-09-14T10:59:03.484527+0000","last_active":"2024-09-14T10:59:03.484527+0000","last_peered":"2024-09-14T10:59:03.484527+0000","last_clean":"2024-09-14T10:59:03.484527+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:59:03.484527+0000","last_undegraded":"2024-09-14T10:59:03.484527+0000","last_fullsized":"2024-09-14T10:59:03.484527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.484426+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.066126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.696165+0000","last_change":"2024-09-14T10:59:09.696165+0000","last_active":"2024-09-14T10:59:09.696165+0000","last_peered":"2024-09-14T10:59:09.696165+0000","last_clean":"2024-09-14T10:59:09.696165+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:59:09.696165+0000","last_undegraded":"2024-09-14T10:59:09.696165+0000","last_fullsized":"2024-09-14T10:59:09.696165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.696077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:53.945948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.518499+0000","last_change":"2024-09-14T10:55:14.722239+0000","last_active":"2024-09-14T10:57:12.518499+0000","last_peered":"2024-09-14T10:57:12.518499+0000","last_clean":"2024-09-14T10:57:12.518499+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:57:12.518499+0000","last_undegraded":"2024-09-14T10:57:12.518499+0000","last_fullsized":"2024-09-14T10:57:12.518499+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:17.086919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.518559+0000","last_change":"2024-09-14T10:58:43.518493+0000","last_active":"2024-09-14T10:58:43.518559+0000","last_peered":"2024-09-14T10:58:43.518559+0000","last_clean":"2024-09-14T10:58:43.518559+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:43.518559+0000","last_undegraded":"2024-09-14T10:58:43.518559+0000","last_fullsized":"2024-09-14T10:58:43.518559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.518393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:29.224226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.217001+0000","last_change":"2024-09-14T10:58:28.217001+0000","last_active":"2024-09-14T10:58:28.217001+0000","last_peered":"2024-09-14T10:58:28.217001+0000","last_clean":"2024-09-14T10:58:28.217001+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:58:28.217001+0000","last_undegraded":"2024-09-14T10:58:28.217001+0000","last_fullsized":"2024-09-14T10:58:28.217001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.216899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:59.951004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.664202+0000","last_change":"2024-09-14T10:58:54.664147+0000","last_active":"2024-09-14T10:58:54.664202+0000","last_peered":"2024-09-14T10:58:54.664202+0000","last_clean":"2024-09-14T10:58:54.664202+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:58:54.664202+0000","last_undegraded":"2024-09-14T10:58:54.664202+0000","last_fullsized":"2024-09-14T10:58:54.664202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.664065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:15.688027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.913746+0000","last_change":"2024-09-14T10:55:10.713915+0000","last_active":"2024-09-14T10:58:19.913746+0000","last_peered":"2024-09-14T10:58:19.913746+0000","last_clean":"2024-09-14T10:58:19.913746+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:58:19.913746+0000","last_undegraded":"2024-09-14T10:58:19.913746+0000","last_fullsized":"2024-09-14T10:58:19.913746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:23.795440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.854224+0000","last_change":"2024-09-14T10:59:16.854224+0000","last_active":"2024-09-14T10:59:16.854224+0000","last_peered":"2024-09-14T10:59:16.854224+0000","last_clean":"2024-09-14T10:59:16.854224+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:59:16.854224+0000","last_undegraded":"2024-09-14T10:59:16.854224+0000","last_fullsized":"2024-09-14T10:59:16.854224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.854142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:20.380972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.344968+0000","last_change":"2024-09-14T10:59:04.344968+0000","last_active":"2024-09-14T10:59:04.344968+0000","last_peered":"2024-09-14T10:59:04.344968+0000","last_clean":"2024-09-14T10:59:04.344968+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:59:04.344968+0000","last_undegraded":"2024-09-14T10:59:04.344968+0000","last_fullsized":"2024-09-14T10:59:04.344968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.344883+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.737716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.239940+0000","last_change":"2024-09-14T10:58:27.239940+0000","last_active":"2024-09-14T10:58:27.239940+0000","last_peered":"2024-09-14T10:58:27.239940+0000","last_clean":"2024-09-14T10:58:27.239940+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:58:27.239940+0000","last_undegraded":"2024-09-14T10:58:27.239940+0000","last_fullsized":"2024-09-14T10:58:27.239940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.239835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:20.526619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.649814+0000","last_change":"2024-09-14T10:58:53.649814+0000","last_active":"2024-09-14T10:58:53.649814+0000","last_peered":"2024-09-14T10:58:53.649814+0000","last_clean":"2024-09-14T10:58:53.649814+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:58:53.649814+0000","last_undegraded":"2024-09-14T10:58:53.649814+0000","last_fullsized":"2024-09-14T10:58:53.649814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.649710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:50.909366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.477299+0000","last_change":"2024-09-14T10:59:04.477244+0000","last_active":"2024-09-14T10:59:04.477299+0000","last_peered":"2024-09-14T10:59:04.477299+0000","last_clean":"2024-09-14T10:59:04.477299+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:59:04.477299+0000","last_undegraded":"2024-09-14T10:59:04.477299+0000","last_fullsized":"2024-09-14T10:59:04.477299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.477125+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:02.058047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.497609+0000","last_change":"2024-09-14T10:59:14.497556+0000","last_active":"2024-09-14T10:59:14.497609+0000","last_peered":"2024-09-14T10:59:14.497609+0000","last_clean":"2024-09-14T10:59:14.497609+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:59:14.497609+0000","last_undegraded":"2024-09-14T10:59:14.497609+0000","last_fullsized":"2024-09-14T10:59:14.497609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.497472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:22.192393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.487050+0000","last_change":"2024-09-14T10:58:44.487050+0000","last_active":"2024-09-14T10:58:44.487050+0000","last_peered":"2024-09-14T10:58:44.487050+0000","last_clean":"2024-09-14T10:58:44.487050+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:44.487050+0000","last_undegraded":"2024-09-14T10:58:44.487050+0000","last_fullsized":"2024-09-14T10:58:44.487050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.486941+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:33.241927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.153933+0000","last_change":"2024-09-14T10:58:40.153933+0000","last_active":"2024-09-14T10:58:40.153933+0000","last_peered":"2024-09-14T10:58:40.153933+0000","last_clean":"2024-09-14T10:58:40.153933+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:58:40.153933+0000","last_undegraded":"2024-09-14T10:58:40.153933+0000","last_fullsized":"2024-09-14T10:58:40.153933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.153809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.058987+0000","last_change":"2024-09-14T10:59:05.058987+0000","last_active":"2024-09-14T10:59:05.058987+0000","last_peered":"2024-09-14T10:59:05.058987+0000","last_clean":"2024-09-14T10:59:05.058987+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:59:05.058987+0000","last_undegraded":"2024-09-14T10:59:05.058987+0000","last_fullsized":"2024-09-14T10:59:05.058987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.058900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:57.231065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.096360+0000","last_change":"2024-09-14T10:55:10.716154+0000","last_active":"2024-09-14T10:57:12.096360+0000","last_peered":"2024-09-14T10:57:12.096360+0000","last_clean":"2024-09-14T10:57:12.096360+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:57:12.096360+0000","last_undegraded":"2024-09-14T10:57:12.096360+0000","last_fullsized":"2024-09-14T10:57:12.096360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.656144+0000","last_change":"2024-09-14T10:59:10.656083+0000","last_active":"2024-09-14T10:59:10.656144+0000","last_peered":"2024-09-14T10:59:10.656144+0000","last_clean":"2024-09-14T10:59:10.656144+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:59:10.656144+0000","last_undegraded":"2024-09-14T10:59:10.656144+0000","last_fullsized":"2024-09-14T10:59:10.656144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.655996+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:02.900112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.766566+0000","last_change":"2024-09-14T10:58:43.766566+0000","last_active":"2024-09-14T10:58:43.766566+0000","last_peered":"2024-09-14T10:58:43.766566+0000","last_clean":"2024-09-14T10:58:43.766566+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:58:43.766566+0000","last_undegraded":"2024-09-14T10:58:43.766566+0000","last_fullsized":"2024-09-14T10:58:43.766566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.766463+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:32.340255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.227452+0000","last_change":"2024-09-14T10:58:30.227452+0000","last_active":"2024-09-14T10:58:30.227452+0000","last_peered":"2024-09-14T10:58:30.227452+0000","last_clean":"2024-09-14T10:58:30.227452+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:30.227452+0000","last_undegraded":"2024-09-14T10:58:30.227452+0000","last_fullsized":"2024-09-14T10:58:30.227452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.227364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:25.413050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.060577+0000","last_change":"2024-09-14T10:59:03.060577+0000","last_active":"2024-09-14T10:59:03.060577+0000","last_peered":"2024-09-14T10:59:03.060577+0000","last_clean":"2024-09-14T10:59:03.060577+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:59:03.060577+0000","last_undegraded":"2024-09-14T10:59:03.060577+0000","last_fullsized":"2024-09-14T10:59:03.060577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.060457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:28.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.892946+0000","last_change":"2024-09-14T10:59:12.892946+0000","last_active":"2024-09-14T10:59:12.892946+0000","last_peered":"2024-09-14T10:59:12.892946+0000","last_clean":"2024-09-14T10:59:12.892946+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:59:12.892946+0000","last_undegraded":"2024-09-14T10:59:12.892946+0000","last_fullsized":"2024-09-14T10:59:12.892946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.892842+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:40.674758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.465590+0000","last_change":"2024-09-14T10:59:17.465590+0000","last_active":"2024-09-14T10:59:17.465590+0000","last_peered":"2024-09-14T10:59:17.465590+0000","last_clean":"2024-09-14T10:59:17.465590+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:59:17.465590+0000","last_undegraded":"2024-09-14T10:59:17.465590+0000","last_fullsized":"2024-09-14T10:59:17.465590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.465512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:34.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:56:28.881534+0000","last_change":"2024-09-14T10:55:14.727371+0000","last_active":"2024-09-14T10:56:28.881534+0000","last_peered":"2024-09-14T10:56:28.881534+0000","last_clean":"2024-09-14T10:56:28.881534+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:56:28.881534+0000","last_undegraded":"2024-09-14T10:56:28.881534+0000","last_fullsized":"2024-09-14T10:56:28.881534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:33.510780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.735243+0000","last_change":"2024-09-14T10:58:44.735243+0000","last_active":"2024-09-14T10:58:44.735243+0000","last_peered":"2024-09-14T10:58:44.735243+0000","last_clean":"2024-09-14T10:58:44.735243+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:44.735243+0000","last_undegraded":"2024-09-14T10:58:44.735243+0000","last_fullsized":"2024-09-14T10:58:44.735243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.735157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:39.920842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.246127+0000","last_change":"2024-09-14T10:58:43.246127+0000","last_active":"2024-09-14T10:58:43.246127+0000","last_peered":"2024-09-14T10:58:43.246127+0000","last_clean":"2024-09-14T10:58:43.246127+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:58:43.246127+0000","last_undegraded":"2024-09-14T10:58:43.246127+0000","last_fullsized":"2024-09-14T10:58:43.246127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.246039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.703082+0000","last_change":"2024-09-14T10:58:55.703082+0000","last_active":"2024-09-14T10:58:55.703082+0000","last_peered":"2024-09-14T10:58:55.703082+0000","last_clean":"2024-09-14T10:58:55.703082+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:58:55.703082+0000","last_undegraded":"2024-09-14T10:58:55.703082+0000","last_fullsized":"2024-09-14T10:58:55.703082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.702997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:50.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.446674+0000","last_change":"2024-09-14T10:59:09.446674+0000","last_active":"2024-09-14T10:59:09.446674+0000","last_peered":"2024-09-14T10:59:09.446674+0000","last_clean":"2024-09-14T10:59:09.446674+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:59:09.446674+0000","last_undegraded":"2024-09-14T10:59:09.446674+0000","last_fullsized":"2024-09-14T10:59:09.446674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.446576+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:39.202271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741355+0000","last_change":"2024-09-14T10:55:12.721976+0000","last_active":"2024-09-14T10:55:41.741355+0000","last_peered":"2024-09-14T10:55:41.741355+0000","last_clean":"2024-09-14T10:55:41.741355+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:55:41.741355+0000","last_undegraded":"2024-09-14T10:55:41.741355+0000","last_fullsized":"2024-09-14T10:55:41.741355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:09.750476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.309250+0000","last_change":"2024-09-14T10:59:01.309250+0000","last_active":"2024-09-14T10:59:01.309250+0000","last_peered":"2024-09-14T10:59:01.309250+0000","last_clean":"2024-09-14T10:59:01.309250+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:59:01.309250+0000","last_undegraded":"2024-09-14T10:59:01.309250+0000","last_fullsized":"2024-09-14T10:59:01.309250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.309130+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.220911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.633930+0000","last_change":"2024-09-14T10:58:28.633837+0000","last_active":"2024-09-14T10:58:28.633930+0000","last_peered":"2024-09-14T10:58:28.633930+0000","last_clean":"2024-09-14T10:58:28.633930+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:58:28.633930+0000","last_undegraded":"2024-09-14T10:58:28.633930+0000","last_fullsized":"2024-09-14T10:58:28.633930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.633728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:50.487848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.057121+0000","last_change":"2024-09-14T10:59:02.057121+0000","last_active":"2024-09-14T10:59:02.057121+0000","last_peered":"2024-09-14T10:59:02.057121+0000","last_clean":"2024-09-14T10:59:02.057121+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:59:02.057121+0000","last_undegraded":"2024-09-14T10:59:02.057121+0000","last_fullsized":"2024-09-14T10:59:02.057121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.057026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:06.578087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.959227+0000","last_change":"2024-09-14T10:55:10.713668+0000","last_active":"2024-09-14T10:58:19.959227+0000","last_peered":"2024-09-14T10:58:19.959227+0000","last_clean":"2024-09-14T10:58:19.959227+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:58:19.959227+0000","last_undegraded":"2024-09-14T10:58:19.959227+0000","last_fullsized":"2024-09-14T10:58:19.959227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:35.685472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.742516+0000","last_change":"2024-09-14T10:55:12.720640+0000","last_active":"2024-09-14T10:55:41.742516+0000","last_peered":"2024-09-14T10:55:41.742516+0000","last_clean":"2024-09-14T10:55:41.742516+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:55:41.742516+0000","last_undegraded":"2024-09-14T10:55:41.742516+0000","last_fullsized":"2024-09-14T10:55:41.742516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:11.693361+0000","last_clean_scrub_stamp":"2024-09-14T10:55:11.693361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:15.343038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.678256+0000","last_change":"2024-09-14T10:58:47.678256+0000","last_active":"2024-09-14T10:58:47.678256+0000","last_peered":"2024-09-14T10:58:47.678256+0000","last_clean":"2024-09-14T10:58:47.678256+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:47.678256+0000","last_undegraded":"2024-09-14T10:58:47.678256+0000","last_fullsized":"2024-09-14T10:58:47.678256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.678157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:56.701033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.188047+0000","last_change":"2024-09-14T10:58:31.187976+0000","last_active":"2024-09-14T10:58:31.188047+0000","last_peered":"2024-09-14T10:58:31.188047+0000","last_clean":"2024-09-14T10:58:31.188047+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:31.188047+0000","last_undegraded":"2024-09-14T10:58:31.188047+0000","last_fullsized":"2024-09-14T10:58:31.188047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.187893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:06.988528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'5","reported_seq":233,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.025603+0000","last_change":"2024-09-14T10:59:01.025603+0000","last_active":"2024-09-14T10:59:01.025603+0000","last_peered":"2024-09-14T10:59:01.025603+0000","last_clean":"2024-09-14T10:59:01.025603+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:59:01.025603+0000","last_undegraded":"2024-09-14T10:59:01.025603+0000","last_fullsized":"2024-09-14T10:59:01.025603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.025515+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:21.372068+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'35","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:19.968171+0000","last_change":"2024-09-14T10:55:10.713983+0000","last_active":"2024-09-14T10:58:19.968171+0000","last_peered":"2024-09-14T10:58:19.968171+0000","last_clean":"2024-09-14T10:58:19.968171+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:58:19.968171+0000","last_undegraded":"2024-09-14T10:58:19.968171+0000","last_fullsized":"2024-09-14T10:58:19.968171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:09.685955+0000","last_clean_scrub_stamp":"2024-09-14T10:55:09.685955+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:59.399380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.531591+0000","last_change":"2024-09-14T10:59:19.531591+0000","last_active":"2024-09-14T10:59:19.531591+0000","last_peered":"2024-09-14T10:59:19.531591+0000","last_clean":"2024-09-14T10:59:19.531591+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:59:19.531591+0000","last_undegraded":"2024-09-14T10:59:19.531591+0000","last_fullsized":"2024-09-14T10:59:19.531591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.531495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.999761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.049274+0000","last_change":"2024-09-14T10:58:44.049274+0000","last_active":"2024-09-14T10:58:44.049274+0000","last_peered":"2024-09-14T10:58:44.049274+0000","last_clean":"2024-09-14T10:58:44.049274+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:44.049274+0000","last_undegraded":"2024-09-14T10:58:44.049274+0000","last_fullsized":"2024-09-14T10:58:44.049274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.049194+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:59.063252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.769190+0000","last_change":"2024-09-14T10:58:32.769098+0000","last_active":"2024-09-14T10:58:32.769190+0000","last_peered":"2024-09-14T10:58:32.769190+0000","last_clean":"2024-09-14T10:58:32.769190+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:58:32.769190+0000","last_undegraded":"2024-09-14T10:58:32.769190+0000","last_fullsized":"2024-09-14T10:58:32.769190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.768987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:20.659652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.498479+0000","last_change":"2024-09-14T10:58:48.498479+0000","last_active":"2024-09-14T10:58:48.498479+0000","last_peered":"2024-09-14T10:58:48.498479+0000","last_clean":"2024-09-14T10:58:48.498479+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:48.498479+0000","last_undegraded":"2024-09-14T10:58:48.498479+0000","last_fullsized":"2024-09-14T10:58:48.498479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.498391+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.696592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.646736+0000","last_change":"2024-09-14T10:58:30.646671+0000","last_active":"2024-09-14T10:58:30.646736+0000","last_peered":"2024-09-14T10:58:30.646736+0000","last_clean":"2024-09-14T10:58:30.646736+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:58:30.646736+0000","last_undegraded":"2024-09-14T10:58:30.646736+0000","last_fullsized":"2024-09-14T10:58:30.646736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.646582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:28.625565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'10","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.230667+0000","last_change":"2024-09-14T10:59:07.230667+0000","last_active":"2024-09-14T10:59:07.230667+0000","last_peered":"2024-09-14T10:59:07.230667+0000","last_clean":"2024-09-14T10:59:07.230667+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:59:07.230667+0000","last_undegraded":"2024-09-14T10:59:07.230667+0000","last_fullsized":"2024-09-14T10:59:07.230667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.230577+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.596269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.225399+0000","last_change":"2024-09-14T10:58:42.225339+0000","last_active":"2024-09-14T10:58:42.225399+0000","last_peered":"2024-09-14T10:58:42.225399+0000","last_clean":"2024-09-14T10:58:42.225399+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:58:42.225399+0000","last_undegraded":"2024-09-14T10:58:42.225399+0000","last_fullsized":"2024-09-14T10:58:42.225399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.225249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:35.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.540121+0000","last_change":"2024-09-14T10:58:47.540121+0000","last_active":"2024-09-14T10:58:47.540121+0000","last_peered":"2024-09-14T10:58:47.540121+0000","last_clean":"2024-09-14T10:58:47.540121+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:47.540121+0000","last_undegraded":"2024-09-14T10:58:47.540121+0000","last_fullsized":"2024-09-14T10:58:47.540121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.540036+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:13.554682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.620604+0000","last_change":"2024-09-14T10:58:31.620545+0000","last_active":"2024-09-14T10:58:31.620604+0000","last_peered":"2024-09-14T10:58:31.620604+0000","last_clean":"2024-09-14T10:58:31.620604+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:31.620604+0000","last_undegraded":"2024-09-14T10:58:31.620604+0000","last_fullsized":"2024-09-14T10:58:31.620604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.620459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.184499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.510605+0000","last_change":"2024-09-14T10:58:45.510519+0000","last_active":"2024-09-14T10:58:45.510605+0000","last_peered":"2024-09-14T10:58:45.510605+0000","last_clean":"2024-09-14T10:58:45.510605+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:58:45.510605+0000","last_undegraded":"2024-09-14T10:58:45.510605+0000","last_fullsized":"2024-09-14T10:58:45.510605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.510404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:33.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.632337+0000","last_change":"2024-09-14T10:58:32.632337+0000","last_active":"2024-09-14T10:58:32.632337+0000","last_peered":"2024-09-14T10:58:32.632337+0000","last_clean":"2024-09-14T10:58:32.632337+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:58:32.632337+0000","last_undegraded":"2024-09-14T10:58:32.632337+0000","last_fullsized":"2024-09-14T10:58:32.632337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.632202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:15.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.056890+0000","last_change":"2024-09-14T10:58:46.056837+0000","last_active":"2024-09-14T10:58:46.056890+0000","last_peered":"2024-09-14T10:58:46.056890+0000","last_clean":"2024-09-14T10:58:46.056890+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:58:46.056890+0000","last_undegraded":"2024-09-14T10:58:46.056890+0000","last_fullsized":"2024-09-14T10:58:46.056890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.056739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:40.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.181486+0000","last_change":"2024-09-14T10:58:33.181486+0000","last_active":"2024-09-14T10:58:33.181486+0000","last_peered":"2024-09-14T10:58:33.181486+0000","last_clean":"2024-09-14T10:58:33.181486+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:58:33.181486+0000","last_undegraded":"2024-09-14T10:58:33.181486+0000","last_fullsized":"2024-09-14T10:58:33.181486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.181378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:00.642621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.491356+0000","last_change":"2024-09-14T10:58:46.491300+0000","last_active":"2024-09-14T10:58:46.491356+0000","last_peered":"2024-09-14T10:58:46.491356+0000","last_clean":"2024-09-14T10:58:46.491356+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:46.491356+0000","last_undegraded":"2024-09-14T10:58:46.491356+0000","last_fullsized":"2024-09-14T10:58:46.491356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.491200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:00.231388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.729483+0000","last_change":"2024-09-14T10:58:31.729483+0000","last_active":"2024-09-14T10:58:31.729483+0000","last_peered":"2024-09-14T10:58:31.729483+0000","last_clean":"2024-09-14T10:58:31.729483+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:58:31.729483+0000","last_undegraded":"2024-09-14T10:58:31.729483+0000","last_fullsized":"2024-09-14T10:58:31.729483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.729382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:17.181102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.085731+0000","last_change":"2024-09-14T10:58:45.085631+0000","last_active":"2024-09-14T10:58:45.085731+0000","last_peered":"2024-09-14T10:58:45.085731+0000","last_clean":"2024-09-14T10:58:45.085731+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:58:45.085731+0000","last_undegraded":"2024-09-14T10:58:45.085731+0000","last_fullsized":"2024-09-14T10:58:45.085731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.085504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:36.257221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.607227+0000","last_change":"2024-09-14T10:58:33.607227+0000","last_active":"2024-09-14T10:58:33.607227+0000","last_peered":"2024-09-14T10:58:33.607227+0000","last_clean":"2024-09-14T10:58:33.607227+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:58:33.607227+0000","last_undegraded":"2024-09-14T10:58:33.607227+0000","last_fullsized":"2024-09-14T10:58:33.607227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.607100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:52.664954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.160075+0000","last_change":"2024-09-14T10:58:51.160075+0000","last_active":"2024-09-14T10:58:51.160075+0000","last_peered":"2024-09-14T10:58:51.160075+0000","last_clean":"2024-09-14T10:58:51.160075+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:51.160075+0000","last_undegraded":"2024-09-14T10:58:51.160075+0000","last_fullsized":"2024-09-14T10:58:51.160075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.159979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:22.667198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.212687+0000","last_change":"2024-09-14T10:58:48.212687+0000","last_active":"2024-09-14T10:58:48.212687+0000","last_peered":"2024-09-14T10:58:48.212687+0000","last_clean":"2024-09-14T10:58:48.212687+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:58:48.212687+0000","last_undegraded":"2024-09-14T10:58:48.212687+0000","last_fullsized":"2024-09-14T10:58:48.212687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.212580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:27.361696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.257000+0000","last_change":"2024-09-14T10:59:06.257000+0000","last_active":"2024-09-14T10:59:06.257000+0000","last_peered":"2024-09-14T10:59:06.257000+0000","last_clean":"2024-09-14T10:59:06.257000+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:59:06.257000+0000","last_undegraded":"2024-09-14T10:59:06.257000+0000","last_fullsized":"2024-09-14T10:59:06.257000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.256919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:16.287230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.649901+0000","last_change":"2024-09-14T10:58:34.649901+0000","last_active":"2024-09-14T10:58:34.649901+0000","last_peered":"2024-09-14T10:58:34.649901+0000","last_clean":"2024-09-14T10:58:34.649901+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:34.649901+0000","last_undegraded":"2024-09-14T10:58:34.649901+0000","last_fullsized":"2024-09-14T10:58:34.649901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.649810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:05.982892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.483078+0000","last_change":"2024-09-14T10:58:49.483078+0000","last_active":"2024-09-14T10:58:49.483078+0000","last_peered":"2024-09-14T10:58:49.483078+0000","last_clean":"2024-09-14T10:58:49.483078+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:58:49.483078+0000","last_undegraded":"2024-09-14T10:58:49.483078+0000","last_fullsized":"2024-09-14T10:58:49.483078+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.482969+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.100489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.215888+0000","last_change":"2024-09-14T10:58:32.215888+0000","last_active":"2024-09-14T10:58:32.215888+0000","last_peered":"2024-09-14T10:58:32.215888+0000","last_clean":"2024-09-14T10:58:32.215888+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:58:32.215888+0000","last_undegraded":"2024-09-14T10:58:32.215888+0000","last_fullsized":"2024-09-14T10:58:32.215888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.215791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.184022+0000","last_change":"2024-09-14T10:58:50.184022+0000","last_active":"2024-09-14T10:58:50.184022+0000","last_peered":"2024-09-14T10:58:50.184022+0000","last_clean":"2024-09-14T10:58:50.184022+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:58:50.184022+0000","last_undegraded":"2024-09-14T10:58:50.184022+0000","last_fullsized":"2024-09-14T10:58:50.184022+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.183944+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:41.356134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.123439+0000","last_change":"2024-09-14T10:58:35.123439+0000","last_active":"2024-09-14T10:58:35.123439+0000","last_peered":"2024-09-14T10:58:35.123439+0000","last_clean":"2024-09-14T10:58:35.123439+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:58:35.123439+0000","last_undegraded":"2024-09-14T10:58:35.123439+0000","last_fullsized":"2024-09-14T10:58:35.123439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.123338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:26.005173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.179766+0000","last_change":"2024-09-14T10:58:49.179766+0000","last_active":"2024-09-14T10:58:49.179766+0000","last_peered":"2024-09-14T10:58:49.179766+0000","last_clean":"2024-09-14T10:58:49.179766+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:49.179766+0000","last_undegraded":"2024-09-14T10:58:49.179766+0000","last_fullsized":"2024-09-14T10:58:49.179766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.179681+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.816048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.266002+0000","last_change":"2024-09-14T10:58:45.266002+0000","last_active":"2024-09-14T10:58:45.266002+0000","last_peered":"2024-09-14T10:58:45.266002+0000","last_clean":"2024-09-14T10:58:45.266002+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:58:45.266002+0000","last_undegraded":"2024-09-14T10:58:45.266002+0000","last_fullsized":"2024-09-14T10:58:45.266002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.265914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.079568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.131536+0000","last_change":"2024-09-14T10:58:48.131536+0000","last_active":"2024-09-14T10:58:48.131536+0000","last_peered":"2024-09-14T10:58:48.131536+0000","last_clean":"2024-09-14T10:58:48.131536+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:48.131536+0000","last_undegraded":"2024-09-14T10:58:48.131536+0000","last_fullsized":"2024-09-14T10:58:48.131536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.131427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:07.192316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.286543+0000","last_change":"2024-09-14T10:58:44.286543+0000","last_active":"2024-09-14T10:58:44.286543+0000","last_peered":"2024-09-14T10:58:44.286543+0000","last_clean":"2024-09-14T10:58:44.286543+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:58:44.286543+0000","last_undegraded":"2024-09-14T10:58:44.286543+0000","last_fullsized":"2024-09-14T10:58:44.286543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.286454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.534792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.301521+0000","last_change":"2024-09-14T10:59:05.301521+0000","last_active":"2024-09-14T10:59:05.301521+0000","last_peered":"2024-09-14T10:59:05.301521+0000","last_clean":"2024-09-14T10:59:05.301521+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:59:05.301521+0000","last_undegraded":"2024-09-14T10:59:05.301521+0000","last_fullsized":"2024-09-14T10:59:05.301521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.301439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:07.827525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.750129+0000","last_change":"2024-09-14T10:58:33.750129+0000","last_active":"2024-09-14T10:58:33.750129+0000","last_peered":"2024-09-14T10:58:33.750129+0000","last_clean":"2024-09-14T10:58:33.750129+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:33.750129+0000","last_undegraded":"2024-09-14T10:58:33.750129+0000","last_fullsized":"2024-09-14T10:58:33.750129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.750046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:41.673497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.083486+0000","last_change":"2024-09-14T10:58:47.083486+0000","last_active":"2024-09-14T10:58:47.083486+0000","last_peered":"2024-09-14T10:58:47.083486+0000","last_clean":"2024-09-14T10:58:47.083486+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:47.083486+0000","last_undegraded":"2024-09-14T10:58:47.083486+0000","last_fullsized":"2024-09-14T10:58:47.083486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.083386+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:48.862348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.225553+0000","last_change":"2024-09-14T10:58:46.225553+0000","last_active":"2024-09-14T10:58:46.225553+0000","last_peered":"2024-09-14T10:58:46.225553+0000","last_clean":"2024-09-14T10:58:46.225553+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:58:46.225553+0000","last_undegraded":"2024-09-14T10:58:46.225553+0000","last_fullsized":"2024-09-14T10:58:46.225553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.225471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.589934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.182383+0000","last_change":"2024-09-14T10:58:47.182383+0000","last_active":"2024-09-14T10:58:47.182383+0000","last_peered":"2024-09-14T10:58:47.182383+0000","last_clean":"2024-09-14T10:58:47.182383+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:58:47.182383+0000","last_undegraded":"2024-09-14T10:58:47.182383+0000","last_fullsized":"2024-09-14T10:58:47.182383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.182295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.861086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.410163+0000","last_change":"2024-09-14T10:58:51.410163+0000","last_active":"2024-09-14T10:58:51.410163+0000","last_peered":"2024-09-14T10:58:51.410163+0000","last_clean":"2024-09-14T10:58:51.410163+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:51.410163+0000","last_undegraded":"2024-09-14T10:58:51.410163+0000","last_fullsized":"2024-09-14T10:58:51.410163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.410073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:45.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.601919+0000","last_change":"2024-09-14T10:58:35.601919+0000","last_active":"2024-09-14T10:58:35.601919+0000","last_peered":"2024-09-14T10:58:35.601919+0000","last_clean":"2024-09-14T10:58:35.601919+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:35.601919+0000","last_undegraded":"2024-09-14T10:58:35.601919+0000","last_fullsized":"2024-09-14T10:58:35.601919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.601827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:44.673365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.139091+0000","last_change":"2024-09-14T10:58:57.139091+0000","last_active":"2024-09-14T10:58:57.139091+0000","last_peered":"2024-09-14T10:58:57.139091+0000","last_clean":"2024-09-14T10:58:57.139091+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:57.139091+0000","last_undegraded":"2024-09-14T10:58:57.139091+0000","last_fullsized":"2024-09-14T10:58:57.139091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.139001+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.477286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1503,"ondisk_log_size":1503,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640314,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640315,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:59:25.505 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.506 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.506 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.506 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.506 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.507 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.507 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.507 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.507 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.508 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.508 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.508 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.508 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.508 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.509 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.509 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.509 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.509 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.510 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.511 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.511 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.511 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.511 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.511 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.512 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.512 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:55:11.693361+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:55:09.685955+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.513 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:25.514 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T10:59:45.515 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:59:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.628+0000 7f665b7ad640 1 Processor -- start 2024-09-14T10:59:45.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.628+0000 7f665b7ad640 1 -- start start 2024-09-14T10:59:45.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f665b7ad640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f665412cba0 0x7f66541315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f665b7ad640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665409a290 con 0x7f665412c0b0 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f665b7ad640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f6654071860 con 0x7f665412cba0 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f6658d48640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f665412cba0 0x7f66541315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f6659549640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f665412c0b0 0x7f665412c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:54976/0 (socket says 172.21.15.116:54976) 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f6659549640 1 -- 172.21.15.116:0/496282198 learned_addr learned my addr 172.21.15.116:0/496282198 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f6658d48640 1 -- 172.21.15.116:0/496282198 >> v1:172.21.15.116:6789/0 conn(0x7f665412c0b0 legacy=0x7f665412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f664bfff640 1 -- 172.21.15.116:0/496282198 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713672187 0 0) 0x7f665409a290 con 0x7f665412c0b0 2024-09-14T10:59:45.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.629+0000 7f6658d48640 1 -- 172.21.15.116:0/496282198 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6654099e20 con 0x7f665412cba0 2024-09-14T10:59:45.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.630+0000 7f6658d48640 1 --2- 172.21.15.116:0/496282198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412cba0 0x7f66541315e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6644009750 tx=0x7f664402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85f506591b4febe server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:45.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.630+0000 7f664bfff640 1 -- 172.21.15.116:0/496282198 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6644037070 con 0x7f665412cba0 2024-09-14T10:59:45.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.630+0000 7f664bfff640 1 -- 172.21.15.116:0/496282198 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664402ad80 con 0x7f665412cba0 2024-09-14T10:59:45.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.630+0000 7f664bfff640 1 -- 172.21.15.116:0/496282198 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6644032590 con 0x7f665412cba0 2024-09-14T10:59:45.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 -- 172.21.15.116:0/496282198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412cba0 msgr2=0x7f66541315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 --2- 172.21.15.116:0/496282198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412cba0 0x7f66541315e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6644009750 tx=0x7f664402a140 comp rx=0 tx=0).stop 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 -- 172.21.15.116:0/496282198 shutdown_connections 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 --2- 172.21.15.116:0/496282198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412cba0 0x7f66541315e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 -- 172.21.15.116:0/496282198 >> 172.21.15.116:0/496282198 conn(0x7f665409abc0 msgr2=0x7f6654098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 -- 172.21.15.116:0/496282198 shutdown_connections 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.631+0000 7f665b7ad640 1 -- 172.21.15.116:0/496282198 wait complete. 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f665b7ad640 1 Processor -- start 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f665b7ad640 1 -- start start 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f665b7ad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f665b7ad640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f6654070c40 con 0x7f665412c0b0 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f6659549640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:45.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f6659549640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:43916/0 (socket says 172.21.15.116:43916) 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f6659549640 1 -- 172.21.15.116:0/2832533898 learned_addr learned my addr 172.21.15.116:0/2832533898 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.632+0000 7f6659549640 1 -- 172.21.15.116:0/2832533898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66541283e0 con 0x7f665412c0b0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f6659549640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f665000c3d0 tx=0x7f665000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66500074d0 con 0x7f665412c0b0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66500047e0 con 0x7f665412c0b0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6654126750 con 0x7f665412c0b0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6650007670 con 0x7f665412c0b0 2024-09-14T10:59:45.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.633+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6654074090 con 0x7f665412c0b0 2024-09-14T10:59:45.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.634+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f6650011070 con 0x7f665412c0b0 2024-09-14T10:59:45.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.634+0000 7f6649ffb640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 0x7f6638040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T10:59:45.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.634+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665412c490 con 0x7f665412c0b0 2024-09-14T10:59:45.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.634+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f6650053220 con 0x7f665412c0b0 2024-09-14T10:59:45.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.634+0000 7f6658d48640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 0x7f6638040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T10:59:45.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.635+0000 7f6658d48640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 0x7f6638040a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6644034000 tx=0x7f664402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T10:59:45.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.639+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f66541283e0 con 0x7f665412c0b0 2024-09-14T10:59:45.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.809+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6654050ee0 con 0x7f663803e570 2024-09-14T10:59:45.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.819+0000 7f6649ffb640 1 -- 172.21.15.116:0/2832533898 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666143 (secure 0 0 0) 0x7f6654050ee0 con 0x7f663803e570 2024-09-14T10:59:45.824 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T10:59:45.829 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T10:59:45.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 msgr2=0x7f6638040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:45.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 0x7f6638040a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6644034000 tx=0x7f664402e000 comp rx=0 tx=0).stop 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 msgr2=0x7f6654128d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f665000c3d0 tx=0x7f665000c890 comp rx=0 tx=0).stop 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 shutdown_connections 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f663803e570 0x7f6638040a30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 --2- 172.21.15.116:0/2832533898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f665412c0b0 0x7f6654128d10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 >> 172.21.15.116:0/2832533898 conn(0x7f665409abc0 msgr2=0x7f665406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 shutdown_connections 2024-09-14T10:59:45.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T10:59:45.824+0000 7f665b7ad640 1 -- 172.21.15.116:0/2832533898 wait complete. 2024-09-14T10:59:45.833 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-14T10:59:44.147666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156864,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330496,"statfs":{"total":386547056640,"available":386386427904,"internally_reserved":0,"allocated":3080192,"data_stored":1819780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004005"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.768980+0000","last_change":"2024-09-14T10:58:37.768923+0000","last_active":"2024-09-14T10:58:37.768980+0000","last_peered":"2024-09-14T10:58:37.768980+0000","last_clean":"2024-09-14T10:58:37.768980+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:58:37.768980+0000","last_undegraded":"2024-09-14T10:58:37.768980+0000","last_fullsized":"2024-09-14T10:58:37.768980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.768838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:59.090598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.199300+0000","last_change":"2024-09-14T10:58:55.199300+0000","last_active":"2024-09-14T10:58:55.199300+0000","last_peered":"2024-09-14T10:58:55.199300+0000","last_clean":"2024-09-14T10:58:55.199300+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:58:55.199300+0000","last_undegraded":"2024-09-14T10:58:55.199300+0000","last_fullsized":"2024-09-14T10:58:55.199300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.199194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.549583+0000","last_change":"2024-09-14T10:58:38.549485+0000","last_active":"2024-09-14T10:58:38.549583+0000","last_peered":"2024-09-14T10:58:38.549583+0000","last_clean":"2024-09-14T10:58:38.549583+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:58:38.549583+0000","last_undegraded":"2024-09-14T10:58:38.549583+0000","last_fullsized":"2024-09-14T10:58:38.549583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.549386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.035874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.450785+0000","last_change":"2024-09-14T10:58:52.450785+0000","last_active":"2024-09-14T10:58:52.450785+0000","last_peered":"2024-09-14T10:58:52.450785+0000","last_clean":"2024-09-14T10:58:52.450785+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:58:52.450785+0000","last_undegraded":"2024-09-14T10:58:52.450785+0000","last_fullsized":"2024-09-14T10:58:52.450785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.450685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:49.376289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.232878+0000","last_change":"2024-09-14T10:58:52.232804+0000","last_active":"2024-09-14T10:58:52.232878+0000","last_peered":"2024-09-14T10:58:52.232878+0000","last_clean":"2024-09-14T10:58:52.232878+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:58:52.232878+0000","last_undegraded":"2024-09-14T10:58:52.232878+0000","last_fullsized":"2024-09-14T10:58:52.232878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.232718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:22.618318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.211047+0000","last_change":"2024-09-14T10:59:08.211047+0000","last_active":"2024-09-14T10:59:08.211047+0000","last_peered":"2024-09-14T10:59:08.211047+0000","last_clean":"2024-09-14T10:59:08.211047+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:59:08.211047+0000","last_undegraded":"2024-09-14T10:59:08.211047+0000","last_fullsized":"2024-09-14T10:59:08.211047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.210952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:36.569390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.746604+0000","last_change":"2024-09-14T10:58:36.746554+0000","last_active":"2024-09-14T10:58:36.746604+0000","last_peered":"2024-09-14T10:58:36.746604+0000","last_clean":"2024-09-14T10:58:36.746604+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:58:36.746604+0000","last_undegraded":"2024-09-14T10:58:36.746604+0000","last_fullsized":"2024-09-14T10:58:36.746604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.746473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:56.987213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.647611+0000","last_change":"2024-09-14T10:58:46.647611+0000","last_active":"2024-09-14T10:58:46.647611+0000","last_peered":"2024-09-14T10:58:46.647611+0000","last_clean":"2024-09-14T10:58:46.647611+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:46.647611+0000","last_undegraded":"2024-09-14T10:58:46.647611+0000","last_fullsized":"2024-09-14T10:58:46.647611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.647534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.998212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.210331+0000","last_change":"2024-09-14T10:58:51.210331+0000","last_active":"2024-09-14T10:58:51.210331+0000","last_peered":"2024-09-14T10:58:51.210331+0000","last_clean":"2024-09-14T10:58:51.210331+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:51.210331+0000","last_undegraded":"2024-09-14T10:58:51.210331+0000","last_fullsized":"2024-09-14T10:58:51.210331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.210239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:23.207843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.157380+0000","last_change":"2024-09-14T10:58:56.157322+0000","last_active":"2024-09-14T10:58:56.157380+0000","last_peered":"2024-09-14T10:58:56.157380+0000","last_clean":"2024-09-14T10:58:56.157380+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:56.157380+0000","last_undegraded":"2024-09-14T10:58:56.157380+0000","last_fullsized":"2024-09-14T10:58:56.157380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.157235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:11.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.781933+0000","last_change":"2024-09-14T10:58:35.781933+0000","last_active":"2024-09-14T10:58:35.781933+0000","last_peered":"2024-09-14T10:58:35.781933+0000","last_clean":"2024-09-14T10:58:35.781933+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:58:35.781933+0000","last_undegraded":"2024-09-14T10:58:35.781933+0000","last_fullsized":"2024-09-14T10:58:35.781933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.781832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.948433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.236407+0000","last_change":"2024-09-14T10:59:09.236343+0000","last_active":"2024-09-14T10:59:09.236407+0000","last_peered":"2024-09-14T10:59:09.236407+0000","last_clean":"2024-09-14T10:59:09.236407+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:59:09.236407+0000","last_undegraded":"2024-09-14T10:59:09.236407+0000","last_fullsized":"2024-09-14T10:59:09.236407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.236262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:20.332076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.229232+0000","last_change":"2024-09-14T10:58:50.229232+0000","last_active":"2024-09-14T10:58:50.229232+0000","last_peered":"2024-09-14T10:58:50.229232+0000","last_clean":"2024-09-14T10:58:50.229232+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:50.229232+0000","last_undegraded":"2024-09-14T10:58:50.229232+0000","last_fullsized":"2024-09-14T10:58:50.229232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.229092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:49.980838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.696564+0000","last_change":"2024-09-14T10:58:49.696483+0000","last_active":"2024-09-14T10:58:49.696564+0000","last_peered":"2024-09-14T10:58:49.696564+0000","last_clean":"2024-09-14T10:58:49.696564+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:58:49.696564+0000","last_undegraded":"2024-09-14T10:58:49.696564+0000","last_fullsized":"2024-09-14T10:58:49.696564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.696365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:27.219012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.557545+0000","last_change":"2024-09-14T10:58:36.557545+0000","last_active":"2024-09-14T10:58:36.557545+0000","last_peered":"2024-09-14T10:58:36.557545+0000","last_clean":"2024-09-14T10:58:36.557545+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:58:36.557545+0000","last_undegraded":"2024-09-14T10:58:36.557545+0000","last_fullsized":"2024-09-14T10:58:36.557545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:19.674856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.655955+0000","last_change":"2024-09-14T10:58:48.655853+0000","last_active":"2024-09-14T10:58:48.655955+0000","last_peered":"2024-09-14T10:58:48.655955+0000","last_clean":"2024-09-14T10:58:48.655955+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:58:48.655955+0000","last_undegraded":"2024-09-14T10:58:48.655955+0000","last_fullsized":"2024-09-14T10:58:48.655955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.655753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:09.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.204128+0000","last_change":"2024-09-14T10:59:10.204128+0000","last_active":"2024-09-14T10:59:10.204128+0000","last_peered":"2024-09-14T10:59:10.204128+0000","last_clean":"2024-09-14T10:59:10.204128+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:59:10.204128+0000","last_undegraded":"2024-09-14T10:59:10.204128+0000","last_fullsized":"2024-09-14T10:59:10.204128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.204034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.143862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.116444+0000","last_change":"2024-09-14T10:58:41.116444+0000","last_active":"2024-09-14T10:58:41.116444+0000","last_peered":"2024-09-14T10:58:41.116444+0000","last_clean":"2024-09-14T10:58:41.116444+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:41.116444+0000","last_undegraded":"2024-09-14T10:58:41.116444+0000","last_fullsized":"2024-09-14T10:58:41.116444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.116320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.336574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.131032+0000","last_change":"2024-09-14T10:58:52.131032+0000","last_active":"2024-09-14T10:58:52.131032+0000","last_peered":"2024-09-14T10:58:52.131032+0000","last_clean":"2024-09-14T10:58:52.131032+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:52.131032+0000","last_undegraded":"2024-09-14T10:58:52.131032+0000","last_fullsized":"2024-09-14T10:58:52.131032+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.130944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:47.420179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.762283+0000","last_change":"2024-09-14T10:58:34.762283+0000","last_active":"2024-09-14T10:58:34.762283+0000","last_peered":"2024-09-14T10:58:34.762283+0000","last_clean":"2024-09-14T10:58:34.762283+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:58:34.762283+0000","last_undegraded":"2024-09-14T10:58:34.762283+0000","last_fullsized":"2024-09-14T10:58:34.762283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.762201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:32.819316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.205330+0000","last_change":"2024-09-14T10:58:54.205330+0000","last_active":"2024-09-14T10:58:54.205330+0000","last_peered":"2024-09-14T10:58:54.205330+0000","last_clean":"2024-09-14T10:58:54.205330+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:58:54.205330+0000","last_undegraded":"2024-09-14T10:58:54.205330+0000","last_fullsized":"2024-09-14T10:58:54.205330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.205219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:44.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.125124+0000","last_change":"2024-09-14T10:58:36.125124+0000","last_active":"2024-09-14T10:58:36.125124+0000","last_peered":"2024-09-14T10:58:36.125124+0000","last_clean":"2024-09-14T10:58:36.125124+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:58:36.125124+0000","last_undegraded":"2024-09-14T10:58:36.125124+0000","last_fullsized":"2024-09-14T10:58:36.125124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.125007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:02.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.433757+0000","last_change":"2024-09-14T10:58:50.433757+0000","last_active":"2024-09-14T10:58:50.433757+0000","last_peered":"2024-09-14T10:58:50.433757+0000","last_clean":"2024-09-14T10:58:50.433757+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:50.433757+0000","last_undegraded":"2024-09-14T10:58:50.433757+0000","last_fullsized":"2024-09-14T10:58:50.433757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.433642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:12.306523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.151676+0000","last_change":"2024-09-14T10:58:34.151676+0000","last_active":"2024-09-14T10:58:34.151676+0000","last_peered":"2024-09-14T10:58:34.151676+0000","last_clean":"2024-09-14T10:58:34.151676+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:58:34.151676+0000","last_undegraded":"2024-09-14T10:58:34.151676+0000","last_fullsized":"2024-09-14T10:58:34.151676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.151591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.433519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.688675+0000","last_change":"2024-09-14T10:58:45.688675+0000","last_active":"2024-09-14T10:58:45.688675+0000","last_peered":"2024-09-14T10:58:45.688675+0000","last_clean":"2024-09-14T10:58:45.688675+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:58:45.688675+0000","last_undegraded":"2024-09-14T10:58:45.688675+0000","last_fullsized":"2024-09-14T10:58:45.688675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.688582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:29.115809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.579906+0000","last_change":"2024-09-14T10:58:37.579906+0000","last_active":"2024-09-14T10:58:37.579906+0000","last_peered":"2024-09-14T10:58:37.579906+0000","last_clean":"2024-09-14T10:58:37.579906+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:58:37.579906+0000","last_undegraded":"2024-09-14T10:58:37.579906+0000","last_fullsized":"2024-09-14T10:58:37.579906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.579809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:06.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.168366+0000","last_change":"2024-09-14T10:58:53.168366+0000","last_active":"2024-09-14T10:58:53.168366+0000","last_peered":"2024-09-14T10:58:53.168366+0000","last_clean":"2024-09-14T10:58:53.168366+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:58:53.168366+0000","last_undegraded":"2024-09-14T10:58:53.168366+0000","last_fullsized":"2024-09-14T10:58:53.168366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.168255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:30.421815+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.259070+0000","last_change":"2024-09-14T10:58:49.259070+0000","last_active":"2024-09-14T10:58:49.259070+0000","last_peered":"2024-09-14T10:58:49.259070+0000","last_clean":"2024-09-14T10:58:49.259070+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:49.259070+0000","last_undegraded":"2024-09-14T10:58:49.259070+0000","last_fullsized":"2024-09-14T10:58:49.259070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.258968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.093328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'38","reported_seq":114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.825610+0000","last_change":"2024-09-14T10:59:22.825610+0000","last_active":"2024-09-14T10:59:22.825610+0000","last_peered":"2024-09-14T10:59:22.825610+0000","last_clean":"2024-09-14T10:59:22.825610+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:59:22.825610+0000","last_undegraded":"2024-09-14T10:59:22.825610+0000","last_fullsized":"2024-09-14T10:59:22.825610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:22.825512+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:22.825512+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.825512+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:05.533943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.304557+0000","last_change":"2024-09-14T10:58:59.304557+0000","last_active":"2024-09-14T10:58:59.304557+0000","last_peered":"2024-09-14T10:58:59.304557+0000","last_clean":"2024-09-14T10:58:59.304557+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:58:59.304557+0000","last_undegraded":"2024-09-14T10:58:59.304557+0000","last_fullsized":"2024-09-14T10:58:59.304557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.304438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.011910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.122467+0000","last_change":"2024-09-14T10:58:38.122467+0000","last_active":"2024-09-14T10:58:38.122467+0000","last_peered":"2024-09-14T10:58:38.122467+0000","last_clean":"2024-09-14T10:58:38.122467+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:58:38.122467+0000","last_undegraded":"2024-09-14T10:58:38.122467+0000","last_fullsized":"2024-09-14T10:58:38.122467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.122377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.370779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.287297+0000","last_change":"2024-09-14T10:59:18.287297+0000","last_active":"2024-09-14T10:59:18.287297+0000","last_peered":"2024-09-14T10:59:18.287297+0000","last_clean":"2024-09-14T10:59:18.287297+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:59:18.287297+0000","last_undegraded":"2024-09-14T10:59:18.287297+0000","last_fullsized":"2024-09-14T10:59:18.287297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.287174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.835680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:27.461151+0000","last_change":"2024-09-14T10:59:27.461151+0000","last_active":"2024-09-14T10:59:27.461151+0000","last_peered":"2024-09-14T10:59:27.461151+0000","last_clean":"2024-09-14T10:59:27.461151+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:59:27.461151+0000","last_undegraded":"2024-09-14T10:59:27.461151+0000","last_fullsized":"2024-09-14T10:59:27.461151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-14T10:59:27.461060+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-14T10:59:27.461060+0000","last_clean_scrub_stamp":"2024-09-14T10:59:27.461060+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:44.608102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.828449+0000","last_change":"2024-09-14T10:59:15.828449+0000","last_active":"2024-09-14T10:59:15.828449+0000","last_peered":"2024-09-14T10:59:15.828449+0000","last_clean":"2024-09-14T10:59:15.828449+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:59:15.828449+0000","last_undegraded":"2024-09-14T10:59:15.828449+0000","last_fullsized":"2024-09-14T10:59:15.828449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.828352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:20.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.797875+0000","last_change":"2024-09-14T10:59:24.797875+0000","last_active":"2024-09-14T10:59:24.797875+0000","last_peered":"2024-09-14T10:59:24.797875+0000","last_clean":"2024-09-14T10:59:24.797875+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:59:24.797875+0000","last_undegraded":"2024-09-14T10:59:24.797875+0000","last_fullsized":"2024-09-14T10:59:24.797875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:24.797774+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:24.797774+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.797774+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.341862+0000","last_change":"2024-09-14T10:59:00.341862+0000","last_active":"2024-09-14T10:59:00.341862+0000","last_peered":"2024-09-14T10:59:00.341862+0000","last_clean":"2024-09-14T10:59:00.341862+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:59:00.341862+0000","last_undegraded":"2024-09-14T10:59:00.341862+0000","last_fullsized":"2024-09-14T10:59:00.341862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.341770+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:16.361583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.833117+0000","last_change":"2024-09-14T10:58:28.833117+0000","last_active":"2024-09-14T10:58:28.833117+0000","last_peered":"2024-09-14T10:58:28.833117+0000","last_clean":"2024-09-14T10:58:28.833117+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:58:28.833117+0000","last_undegraded":"2024-09-14T10:58:28.833117+0000","last_fullsized":"2024-09-14T10:58:28.833117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.833024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.803836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.423501+0000","last_change":"2024-09-14T10:58:58.423501+0000","last_active":"2024-09-14T10:58:58.423501+0000","last_peered":"2024-09-14T10:58:58.423501+0000","last_clean":"2024-09-14T10:58:58.423501+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:58:58.423501+0000","last_undegraded":"2024-09-14T10:58:58.423501+0000","last_fullsized":"2024-09-14T10:58:58.423501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.423413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:14.071911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.903992+0000","last_change":"2024-09-14T10:59:11.903992+0000","last_active":"2024-09-14T10:59:11.903992+0000","last_peered":"2024-09-14T10:59:11.903992+0000","last_clean":"2024-09-14T10:59:11.903992+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:59:11.903992+0000","last_undegraded":"2024-09-14T10:59:11.903992+0000","last_fullsized":"2024-09-14T10:59:11.903992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.903906+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:21.118231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.838078+0000","last_change":"2024-09-14T10:59:14.838078+0000","last_active":"2024-09-14T10:59:14.838078+0000","last_peered":"2024-09-14T10:59:14.838078+0000","last_clean":"2024-09-14T10:59:14.838078+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:59:14.838078+0000","last_undegraded":"2024-09-14T10:59:14.838078+0000","last_fullsized":"2024-09-14T10:59:14.838078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.837975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:00.387583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.657708+0000","last_change":"2024-09-14T10:59:24.657708+0000","last_active":"2024-09-14T10:59:24.657708+0000","last_peered":"2024-09-14T10:59:24.657708+0000","last_clean":"2024-09-14T10:59:24.657708+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:59:24.657708+0000","last_undegraded":"2024-09-14T10:59:24.657708+0000","last_fullsized":"2024-09-14T10:59:24.657708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:59:24.657621+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:59:24.657621+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.657621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:49.691139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.301344+0000","last_change":"2024-09-14T10:59:02.301344+0000","last_active":"2024-09-14T10:59:02.301344+0000","last_peered":"2024-09-14T10:59:02.301344+0000","last_clean":"2024-09-14T10:59:02.301344+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:59:02.301344+0000","last_undegraded":"2024-09-14T10:59:02.301344+0000","last_fullsized":"2024-09-14T10:59:02.301344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.301206+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:42.934531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.134905+0000","last_change":"2024-09-14T10:58:37.134905+0000","last_active":"2024-09-14T10:58:37.134905+0000","last_peered":"2024-09-14T10:58:37.134905+0000","last_clean":"2024-09-14T10:58:37.134905+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:58:37.134905+0000","last_undegraded":"2024-09-14T10:58:37.134905+0000","last_fullsized":"2024-09-14T10:58:37.134905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.134801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:19.758122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.426312+0000","last_change":"2024-09-14T10:58:59.426312+0000","last_active":"2024-09-14T10:58:59.426312+0000","last_peered":"2024-09-14T10:58:59.426312+0000","last_clean":"2024-09-14T10:58:59.426312+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:58:59.426312+0000","last_undegraded":"2024-09-14T10:58:59.426312+0000","last_fullsized":"2024-09-14T10:58:59.426312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.426181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.700362+0000","last_change":"2024-09-14T10:59:03.700362+0000","last_active":"2024-09-14T10:59:03.700362+0000","last_peered":"2024-09-14T10:59:03.700362+0000","last_clean":"2024-09-14T10:59:03.700362+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:59:03.700362+0000","last_undegraded":"2024-09-14T10:59:03.700362+0000","last_fullsized":"2024-09-14T10:59:03.700362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.700267+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:35.207485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":416,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:37.486146+0000","last_change":"2024-09-14T10:59:37.486146+0000","last_active":"2024-09-14T10:59:37.486146+0000","last_peered":"2024-09-14T10:59:37.486146+0000","last_clean":"2024-09-14T10:59:37.486146+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:59:37.486146+0000","last_undegraded":"2024-09-14T10:59:37.486146+0000","last_fullsized":"2024-09-14T10:59:37.486146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:37.486016+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:37.486016+0000","last_clean_scrub_stamp":"2024-09-14T10:59:37.486016+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:42.702385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.846165+0000","last_change":"2024-09-14T10:59:15.846165+0000","last_active":"2024-09-14T10:59:15.846165+0000","last_peered":"2024-09-14T10:59:15.846165+0000","last_clean":"2024-09-14T10:59:15.846165+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:59:15.846165+0000","last_undegraded":"2024-09-14T10:59:15.846165+0000","last_fullsized":"2024-09-14T10:59:15.846165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.846039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:36.510986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.509476+0000","last_change":"2024-09-14T10:58:42.509476+0000","last_active":"2024-09-14T10:58:42.509476+0000","last_peered":"2024-09-14T10:58:42.509476+0000","last_clean":"2024-09-14T10:58:42.509476+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:58:42.509476+0000","last_undegraded":"2024-09-14T10:58:42.509476+0000","last_fullsized":"2024-09-14T10:58:42.509476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.509389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:30.236260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.293841+0000","last_change":"2024-09-14T10:58:25.293841+0000","last_active":"2024-09-14T10:58:25.293841+0000","last_peered":"2024-09-14T10:58:25.293841+0000","last_clean":"2024-09-14T10:58:25.293841+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:58:25.293841+0000","last_undegraded":"2024-09-14T10:58:25.293841+0000","last_fullsized":"2024-09-14T10:58:25.293841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.293744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:40.765776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.327074+0000","last_change":"2024-09-14T10:59:19.327074+0000","last_active":"2024-09-14T10:59:19.327074+0000","last_peered":"2024-09-14T10:59:19.327074+0000","last_clean":"2024-09-14T10:59:19.327074+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:59:19.327074+0000","last_undegraded":"2024-09-14T10:59:19.327074+0000","last_fullsized":"2024-09-14T10:59:19.327074+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.326990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:03.623781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.698812+0000","last_change":"2024-09-14T10:59:02.698812+0000","last_active":"2024-09-14T10:59:02.698812+0000","last_peered":"2024-09-14T10:59:02.698812+0000","last_clean":"2024-09-14T10:59:02.698812+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:59:02.698812+0000","last_undegraded":"2024-09-14T10:59:02.698812+0000","last_fullsized":"2024-09-14T10:59:02.698812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.698703+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:35.538644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":447,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.491953+0000","last_change":"2024-09-14T10:59:11.491953+0000","last_active":"2024-09-14T10:59:11.491953+0000","last_peered":"2024-09-14T10:59:11.491953+0000","last_clean":"2024-09-14T10:59:11.491953+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:59:11.491953+0000","last_undegraded":"2024-09-14T10:59:11.491953+0000","last_fullsized":"2024-09-14T10:59:11.491953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.491837+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:50.595963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.265073+0000","last_change":"2024-09-14T10:58:57.265017+0000","last_active":"2024-09-14T10:58:57.265073+0000","last_peered":"2024-09-14T10:58:57.265073+0000","last_clean":"2024-09-14T10:58:57.265073+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:57.265073+0000","last_undegraded":"2024-09-14T10:58:57.265073+0000","last_fullsized":"2024-09-14T10:58:57.265073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.264932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.108926+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.849997+0000","last_change":"2024-09-14T10:58:27.849928+0000","last_active":"2024-09-14T10:58:27.849997+0000","last_peered":"2024-09-14T10:58:27.849997+0000","last_clean":"2024-09-14T10:58:27.849997+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:58:27.849997+0000","last_undegraded":"2024-09-14T10:58:27.849997+0000","last_fullsized":"2024-09-14T10:58:27.849997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.849846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:39.863957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.114589+0000","last_change":"2024-09-14T10:58:59.114524+0000","last_active":"2024-09-14T10:58:59.114589+0000","last_peered":"2024-09-14T10:58:59.114589+0000","last_clean":"2024-09-14T10:58:59.114589+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:58:59.114589+0000","last_undegraded":"2024-09-14T10:58:59.114589+0000","last_fullsized":"2024-09-14T10:58:59.114589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.114437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:51.358552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.680979+0000","last_change":"2024-09-14T10:58:59.680885+0000","last_active":"2024-09-14T10:58:59.680979+0000","last_peered":"2024-09-14T10:58:59.680979+0000","last_clean":"2024-09-14T10:58:59.680979+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:59.680979+0000","last_undegraded":"2024-09-14T10:58:59.680979+0000","last_fullsized":"2024-09-14T10:58:59.680979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.680755+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:54.152021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.503094+0000","last_change":"2024-09-14T10:59:18.503094+0000","last_active":"2024-09-14T10:59:18.503094+0000","last_peered":"2024-09-14T10:59:18.503094+0000","last_clean":"2024-09-14T10:59:18.503094+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:59:18.503094+0000","last_undegraded":"2024-09-14T10:59:18.503094+0000","last_fullsized":"2024-09-14T10:59:18.503094+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.503011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:17.545714+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.738511+0000","last_change":"2024-09-14T10:59:12.738448+0000","last_active":"2024-09-14T10:59:12.738511+0000","last_peered":"2024-09-14T10:59:12.738511+0000","last_clean":"2024-09-14T10:59:12.738511+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:59:12.738511+0000","last_undegraded":"2024-09-14T10:59:12.738511+0000","last_fullsized":"2024-09-14T10:59:12.738511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.738366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.547524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.142384+0000","last_change":"2024-09-14T10:58:38.142295+0000","last_active":"2024-09-14T10:58:38.142384+0000","last_peered":"2024-09-14T10:58:38.142384+0000","last_clean":"2024-09-14T10:58:38.142384+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:58:38.142384+0000","last_undegraded":"2024-09-14T10:58:38.142384+0000","last_fullsized":"2024-09-14T10:58:38.142384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.142187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:18.412057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.853432+0000","last_change":"2024-09-14T10:58:25.853379+0000","last_active":"2024-09-14T10:58:25.853432+0000","last_peered":"2024-09-14T10:58:25.853432+0000","last_clean":"2024-09-14T10:58:25.853432+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:58:25.853432+0000","last_undegraded":"2024-09-14T10:58:25.853432+0000","last_fullsized":"2024-09-14T10:58:25.853432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.853290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.774127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.503593+0000","last_change":"2024-09-14T10:58:55.503539+0000","last_active":"2024-09-14T10:58:55.503593+0000","last_peered":"2024-09-14T10:58:55.503593+0000","last_clean":"2024-09-14T10:58:55.503593+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:58:55.503593+0000","last_undegraded":"2024-09-14T10:58:55.503593+0000","last_fullsized":"2024-09-14T10:58:55.503593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.503455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.311229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'38","reported_seq":94,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:25.456229+0000","last_change":"2024-09-14T10:59:25.456167+0000","last_active":"2024-09-14T10:59:25.456229+0000","last_peered":"2024-09-14T10:59:25.456229+0000","last_clean":"2024-09-14T10:59:25.456229+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:59:25.456229+0000","last_undegraded":"2024-09-14T10:59:25.456229+0000","last_fullsized":"2024-09-14T10:59:25.456229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:25.456055+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:25.456055+0000","last_clean_scrub_stamp":"2024-09-14T10:59:25.456055+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:02.091072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.469274+0000","last_change":"2024-09-14T10:59:10.469166+0000","last_active":"2024-09-14T10:59:10.469274+0000","last_peered":"2024-09-14T10:59:10.469274+0000","last_clean":"2024-09-14T10:59:10.469274+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:59:10.469274+0000","last_undegraded":"2024-09-14T10:59:10.469274+0000","last_fullsized":"2024-09-14T10:59:10.469274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.469058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:25.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.803979+0000","last_change":"2024-09-14T10:59:18.803897+0000","last_active":"2024-09-14T10:59:18.803979+0000","last_peered":"2024-09-14T10:59:18.803979+0000","last_clean":"2024-09-14T10:59:18.803979+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:59:18.803979+0000","last_undegraded":"2024-09-14T10:59:18.803979+0000","last_fullsized":"2024-09-14T10:59:18.803979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.803791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:35.021908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.752075+0000","last_change":"2024-09-14T10:58:39.751967+0000","last_active":"2024-09-14T10:58:39.752075+0000","last_peered":"2024-09-14T10:58:39.752075+0000","last_clean":"2024-09-14T10:58:39.752075+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:39.752075+0000","last_undegraded":"2024-09-14T10:58:39.752075+0000","last_fullsized":"2024-09-14T10:58:39.752075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.751871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:01.585910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.127010+0000","last_change":"2024-09-14T10:58:36.126916+0000","last_active":"2024-09-14T10:58:36.127010+0000","last_peered":"2024-09-14T10:58:36.127010+0000","last_clean":"2024-09-14T10:58:36.127010+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:58:36.127010+0000","last_undegraded":"2024-09-14T10:58:36.127010+0000","last_fullsized":"2024-09-14T10:58:36.127010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.126801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.157003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.469017+0000","last_change":"2024-09-14T10:58:56.468948+0000","last_active":"2024-09-14T10:58:56.469017+0000","last_peered":"2024-09-14T10:58:56.469017+0000","last_clean":"2024-09-14T10:58:56.469017+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:58:56.469017+0000","last_undegraded":"2024-09-14T10:58:56.469017+0000","last_fullsized":"2024-09-14T10:58:56.469017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.468851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:39.048237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.441759+0000","last_change":"2024-09-14T10:59:23.441696+0000","last_active":"2024-09-14T10:59:23.441759+0000","last_peered":"2024-09-14T10:59:23.441759+0000","last_clean":"2024-09-14T10:59:23.441759+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:59:23.441759+0000","last_undegraded":"2024-09-14T10:59:23.441759+0000","last_fullsized":"2024-09-14T10:59:23.441759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:23.441596+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:23.441596+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.441596+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:41.533118+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":410,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.491156+0000","last_change":"2024-09-14T10:59:15.491089+0000","last_active":"2024-09-14T10:59:15.491156+0000","last_peered":"2024-09-14T10:59:15.491156+0000","last_clean":"2024-09-14T10:59:15.491156+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:59:15.491156+0000","last_undegraded":"2024-09-14T10:59:15.491156+0000","last_fullsized":"2024-09-14T10:59:15.491156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.490991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:43.901316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.599034+0000","last_change":"2024-09-14T10:59:21.598958+0000","last_active":"2024-09-14T10:59:21.599034+0000","last_peered":"2024-09-14T10:59:21.599034+0000","last_clean":"2024-09-14T10:59:21.599034+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:59:21.599034+0000","last_undegraded":"2024-09-14T10:59:21.599034+0000","last_fullsized":"2024-09-14T10:59:21.599034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:21.598835+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:21.598835+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.598835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:59.656682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.763026+0000","last_change":"2024-09-14T10:58:41.762964+0000","last_active":"2024-09-14T10:58:41.763026+0000","last_peered":"2024-09-14T10:58:41.763026+0000","last_clean":"2024-09-14T10:58:41.763026+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:58:41.763026+0000","last_undegraded":"2024-09-14T10:58:41.763026+0000","last_fullsized":"2024-09-14T10:58:41.763026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.762874+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:35.049658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.164604+0000","last_change":"2024-09-14T10:58:35.164518+0000","last_active":"2024-09-14T10:58:35.164604+0000","last_peered":"2024-09-14T10:58:35.164604+0000","last_clean":"2024-09-14T10:58:35.164604+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:58:35.164604+0000","last_undegraded":"2024-09-14T10:58:35.164604+0000","last_fullsized":"2024-09-14T10:58:35.164604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.164436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:54.849680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.647837+0000","last_change":"2024-09-14T10:58:50.647837+0000","last_active":"2024-09-14T10:58:50.647837+0000","last_peered":"2024-09-14T10:58:50.647837+0000","last_clean":"2024-09-14T10:58:50.647837+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:58:50.647837+0000","last_undegraded":"2024-09-14T10:58:50.647837+0000","last_fullsized":"2024-09-14T10:58:50.647837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.647749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.851323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'65","reported_seq":139,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.412318+0000","last_change":"2024-09-14T10:59:24.412251+0000","last_active":"2024-09-14T10:59:24.412318+0000","last_peered":"2024-09-14T10:59:24.412318+0000","last_clean":"2024-09-14T10:59:24.412318+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:59:24.412318+0000","last_undegraded":"2024-09-14T10:59:24.412318+0000","last_fullsized":"2024-09-14T10:59:24.412318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-09-14T10:59:24.412155+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-09-14T10:59:24.412155+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.412155+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:47.835966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.461031+0000","last_change":"2024-09-14T10:59:12.460959+0000","last_active":"2024-09-14T10:59:12.461031+0000","last_peered":"2024-09-14T10:59:12.461031+0000","last_clean":"2024-09-14T10:59:12.461031+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:59:12.461031+0000","last_undegraded":"2024-09-14T10:59:12.461031+0000","last_fullsized":"2024-09-14T10:59:12.461031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.460863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:01.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'21","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.555378+0000","last_change":"2024-09-14T10:59:20.555284+0000","last_active":"2024-09-14T10:59:20.555378+0000","last_peered":"2024-09-14T10:59:20.555378+0000","last_clean":"2024-09-14T10:59:20.555378+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:59:20.555378+0000","last_undegraded":"2024-09-14T10:59:20.555378+0000","last_fullsized":"2024-09-14T10:59:20.555378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-14T10:59:20.555183+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-14T10:59:20.555183+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.555183+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:19.564304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.145316+0000","last_change":"2024-09-14T10:58:40.145252+0000","last_active":"2024-09-14T10:58:40.145316+0000","last_peered":"2024-09-14T10:58:40.145316+0000","last_clean":"2024-09-14T10:58:40.145316+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:58:40.145316+0000","last_undegraded":"2024-09-14T10:58:40.145316+0000","last_fullsized":"2024-09-14T10:58:40.145316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.145160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:03.438344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.623875+0000","last_change":"2024-09-14T10:58:29.623781+0000","last_active":"2024-09-14T10:58:29.623875+0000","last_peered":"2024-09-14T10:58:29.623875+0000","last_clean":"2024-09-14T10:58:29.623875+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:58:29.623875+0000","last_undegraded":"2024-09-14T10:58:29.623875+0000","last_fullsized":"2024-09-14T10:58:29.623875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.623676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:28.939281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.719586+0000","last_change":"2024-09-14T10:58:57.719508+0000","last_active":"2024-09-14T10:58:57.719586+0000","last_peered":"2024-09-14T10:58:57.719586+0000","last_clean":"2024-09-14T10:58:57.719586+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:58:57.719586+0000","last_undegraded":"2024-09-14T10:58:57.719586+0000","last_fullsized":"2024-09-14T10:58:57.719586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.719407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:05.463897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'43","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.937148+0000","last_change":"2024-09-14T10:59:09.937066+0000","last_active":"2024-09-14T10:59:09.937148+0000","last_peered":"2024-09-14T10:59:09.937148+0000","last_clean":"2024-09-14T10:59:09.937148+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:59:09.937148+0000","last_undegraded":"2024-09-14T10:59:09.937148+0000","last_fullsized":"2024-09-14T10:59:09.937148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'43","last_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_deep_scrub":"37'43","last_deep_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.936931+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:22.882495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:35.479703+0000","last_change":"2024-09-14T10:59:35.479635+0000","last_active":"2024-09-14T10:59:35.479703+0000","last_peered":"2024-09-14T10:59:35.479703+0000","last_clean":"2024-09-14T10:59:35.479703+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:59:35.479703+0000","last_undegraded":"2024-09-14T10:59:35.479703+0000","last_fullsized":"2024-09-14T10:59:35.479703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:35.479545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:35.479545+0000","last_clean_scrub_stamp":"2024-09-14T10:59:35.479545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:19.915394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:41.419462+0000","last_change":"2024-09-14T10:59:41.419462+0000","last_active":"2024-09-14T10:59:41.419462+0000","last_peered":"2024-09-14T10:59:41.419462+0000","last_clean":"2024-09-14T10:59:41.419462+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:59:41.419462+0000","last_undegraded":"2024-09-14T10:59:41.419462+0000","last_fullsized":"2024-09-14T10:59:41.419462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:41.419369+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:41.419369+0000","last_clean_scrub_stamp":"2024-09-14T10:59:41.419369+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.710147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.260956+0000","last_change":"2024-09-14T10:58:56.260882+0000","last_active":"2024-09-14T10:58:56.260956+0000","last_peered":"2024-09-14T10:58:56.260956+0000","last_clean":"2024-09-14T10:58:56.260956+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:58:56.260956+0000","last_undegraded":"2024-09-14T10:58:56.260956+0000","last_fullsized":"2024-09-14T10:58:56.260956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.260781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.142012+0000","last_change":"2024-09-14T10:58:34.141947+0000","last_active":"2024-09-14T10:58:34.142012+0000","last_peered":"2024-09-14T10:58:34.142012+0000","last_clean":"2024-09-14T10:58:34.142012+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:58:34.142012+0000","last_undegraded":"2024-09-14T10:58:34.142012+0000","last_fullsized":"2024-09-14T10:58:34.142012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.141859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:14.978632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.429107+0000","last_change":"2024-09-14T10:58:57.429031+0000","last_active":"2024-09-14T10:58:57.429107+0000","last_peered":"2024-09-14T10:58:57.429107+0000","last_clean":"2024-09-14T10:58:57.429107+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:58:57.429107+0000","last_undegraded":"2024-09-14T10:58:57.429107+0000","last_fullsized":"2024-09-14T10:58:57.429107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.428941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:25.714161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'49","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.636618+0000","last_change":"2024-09-14T10:59:00.636564+0000","last_active":"2024-09-14T10:59:00.636618+0000","last_peered":"2024-09-14T10:59:00.636618+0000","last_clean":"2024-09-14T10:59:00.636618+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:59:00.636618+0000","last_undegraded":"2024-09-14T10:59:00.636618+0000","last_fullsized":"2024-09-14T10:59:00.636618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.636458+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.391010+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":416,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.675970+0000","last_change":"2024-09-14T10:59:06.675897+0000","last_active":"2024-09-14T10:59:06.675970+0000","last_peered":"2024-09-14T10:59:06.675970+0000","last_clean":"2024-09-14T10:59:06.675970+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:59:06.675970+0000","last_undegraded":"2024-09-14T10:59:06.675970+0000","last_fullsized":"2024-09-14T10:59:06.675970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.675797+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:04.953299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'13","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.452228+0000","last_change":"2024-09-14T10:59:16.452175+0000","last_active":"2024-09-14T10:59:16.452228+0000","last_peered":"2024-09-14T10:59:16.452228+0000","last_clean":"2024-09-14T10:59:16.452228+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:59:16.452228+0000","last_undegraded":"2024-09-14T10:59:16.452228+0000","last_fullsized":"2024-09-14T10:59:16.452228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'13","last_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_deep_scrub":"37'13","last_deep_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.452083+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:31.073850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.764616+0000","last_change":"2024-09-14T10:58:40.764524+0000","last_active":"2024-09-14T10:58:40.764616+0000","last_peered":"2024-09-14T10:58:40.764616+0000","last_clean":"2024-09-14T10:58:40.764616+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:40.764616+0000","last_undegraded":"2024-09-14T10:58:40.764616+0000","last_fullsized":"2024-09-14T10:58:40.764616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.764431+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:57.754237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.139922+0000","last_change":"2024-09-14T10:58:33.139853+0000","last_active":"2024-09-14T10:58:33.139922+0000","last_peered":"2024-09-14T10:58:33.139922+0000","last_clean":"2024-09-14T10:58:33.139922+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:58:33.139922+0000","last_undegraded":"2024-09-14T10:58:33.139922+0000","last_fullsized":"2024-09-14T10:58:33.139922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.139755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.454102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.097340+0000","last_change":"2024-09-14T10:59:04.097284+0000","last_active":"2024-09-14T10:59:04.097340+0000","last_peered":"2024-09-14T10:59:04.097340+0000","last_clean":"2024-09-14T10:59:04.097340+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:59:04.097340+0000","last_undegraded":"2024-09-14T10:59:04.097340+0000","last_fullsized":"2024-09-14T10:59:04.097340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.097190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:24.762136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'16","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:28.462805+0000","last_change":"2024-09-14T10:59:28.462740+0000","last_active":"2024-09-14T10:59:28.462805+0000","last_peered":"2024-09-14T10:59:28.462805+0000","last_clean":"2024-09-14T10:59:28.462805+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:59:28.462805+0000","last_undegraded":"2024-09-14T10:59:28.462805+0000","last_fullsized":"2024-09-14T10:59:28.462805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:59:28.462636+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:59:28.462636+0000","last_clean_scrub_stamp":"2024-09-14T10:59:28.462636+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:45.927925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":472,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.979912+0000","last_change":"2024-09-14T10:59:08.979812+0000","last_active":"2024-09-14T10:59:08.979912+0000","last_peered":"2024-09-14T10:59:08.979912+0000","last_clean":"2024-09-14T10:59:08.979912+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:59:08.979912+0000","last_undegraded":"2024-09-14T10:59:08.979912+0000","last_fullsized":"2024-09-14T10:59:08.979912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.979700+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:04.708361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.696173+0000","last_change":"2024-09-14T10:59:11.696117+0000","last_active":"2024-09-14T10:59:11.696173+0000","last_peered":"2024-09-14T10:59:11.696173+0000","last_clean":"2024-09-14T10:59:11.696173+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:59:11.696173+0000","last_undegraded":"2024-09-14T10:59:11.696173+0000","last_fullsized":"2024-09-14T10:59:11.696173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.696028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.462538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.122369+0000","last_change":"2024-09-14T10:58:42.122287+0000","last_active":"2024-09-14T10:58:42.122369+0000","last_peered":"2024-09-14T10:58:42.122369+0000","last_clean":"2024-09-14T10:58:42.122369+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:58:42.122369+0000","last_undegraded":"2024-09-14T10:58:42.122369+0000","last_fullsized":"2024-09-14T10:58:42.122369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.122178+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:54.680983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.154655+0000","last_change":"2024-09-14T10:58:32.154586+0000","last_active":"2024-09-14T10:58:32.154655+0000","last_peered":"2024-09-14T10:58:32.154655+0000","last_clean":"2024-09-14T10:58:32.154655+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:58:32.154655+0000","last_undegraded":"2024-09-14T10:58:32.154655+0000","last_fullsized":"2024-09-14T10:58:32.154655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.154493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.858878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.211461+0000","last_change":"2024-09-14T10:59:14.211383+0000","last_active":"2024-09-14T10:59:14.211461+0000","last_peered":"2024-09-14T10:59:14.211461+0000","last_clean":"2024-09-14T10:59:14.211461+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:59:14.211461+0000","last_undegraded":"2024-09-14T10:59:14.211461+0000","last_fullsized":"2024-09-14T10:59:14.211461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.211298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:33.896220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.008193+0000","last_change":"2024-09-14T10:59:08.008101+0000","last_active":"2024-09-14T10:59:08.008193+0000","last_peered":"2024-09-14T10:59:08.008193+0000","last_clean":"2024-09-14T10:59:08.008193+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:59:08.008193+0000","last_undegraded":"2024-09-14T10:59:08.008193+0000","last_fullsized":"2024-09-14T10:59:08.008193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.007987+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:18.101895+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.667016+0000","last_change":"2024-09-14T10:59:05.666964+0000","last_active":"2024-09-14T10:59:05.667016+0000","last_peered":"2024-09-14T10:59:05.667016+0000","last_clean":"2024-09-14T10:59:05.667016+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:59:05.667016+0000","last_undegraded":"2024-09-14T10:59:05.667016+0000","last_fullsized":"2024-09-14T10:59:05.667016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.666866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:58.215776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.813422+0000","last_change":"2024-09-14T10:59:17.813354+0000","last_active":"2024-09-14T10:59:17.813422+0000","last_peered":"2024-09-14T10:59:17.813422+0000","last_clean":"2024-09-14T10:59:17.813422+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:59:17.813422+0000","last_undegraded":"2024-09-14T10:59:17.813422+0000","last_fullsized":"2024-09-14T10:59:17.813422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.813268+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.517653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.270136+0000","last_change":"2024-09-14T10:58:54.270045+0000","last_active":"2024-09-14T10:58:54.270136+0000","last_peered":"2024-09-14T10:58:54.270136+0000","last_clean":"2024-09-14T10:58:54.270136+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:58:54.270136+0000","last_undegraded":"2024-09-14T10:58:54.270136+0000","last_fullsized":"2024-09-14T10:58:54.270136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.269944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:15.040276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.259271+0000","last_change":"2024-09-14T10:58:24.259197+0000","last_active":"2024-09-14T10:58:24.259271+0000","last_peered":"2024-09-14T10:58:24.259271+0000","last_clean":"2024-09-14T10:58:24.259271+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:58:24.259271+0000","last_undegraded":"2024-09-14T10:58:24.259271+0000","last_fullsized":"2024-09-14T10:58:24.259271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.259102+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:48.731970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.056067+0000","last_change":"2024-09-14T10:58:28.055953+0000","last_active":"2024-09-14T10:58:28.056067+0000","last_peered":"2024-09-14T10:58:28.056067+0000","last_clean":"2024-09-14T10:58:28.056067+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:58:28.056067+0000","last_undegraded":"2024-09-14T10:58:28.056067+0000","last_fullsized":"2024-09-14T10:58:28.056067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.055847+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:09.084414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.127724+0000","last_change":"2024-09-14T10:58:30.127641+0000","last_active":"2024-09-14T10:58:30.127724+0000","last_peered":"2024-09-14T10:58:30.127724+0000","last_clean":"2024-09-14T10:58:30.127724+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:30.127724+0000","last_undegraded":"2024-09-14T10:58:30.127724+0000","last_fullsized":"2024-09-14T10:58:30.127724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.127553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.604808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.100990+0000","last_change":"2024-09-14T10:58:58.100923+0000","last_active":"2024-09-14T10:58:58.100990+0000","last_peered":"2024-09-14T10:58:58.100990+0000","last_clean":"2024-09-14T10:58:58.100990+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:58:58.100990+0000","last_undegraded":"2024-09-14T10:58:58.100990+0000","last_fullsized":"2024-09-14T10:58:58.100990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.100810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:42.350681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'90","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.412553+0000","last_change":"2024-09-14T10:59:22.412474+0000","last_active":"2024-09-14T10:59:22.412553+0000","last_peered":"2024-09-14T10:59:22.412553+0000","last_clean":"2024-09-14T10:59:22.412553+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:59:22.412553+0000","last_undegraded":"2024-09-14T10:59:22.412553+0000","last_fullsized":"2024-09-14T10:59:22.412553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-14T10:59:22.412384+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-14T10:59:22.412384+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.412384+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:07.564079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.416049+0000","last_change":"2024-09-14T10:59:08.415993+0000","last_active":"2024-09-14T10:59:08.416049+0000","last_peered":"2024-09-14T10:59:08.416049+0000","last_clean":"2024-09-14T10:59:08.416049+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:59:08.416049+0000","last_undegraded":"2024-09-14T10:59:08.416049+0000","last_fullsized":"2024-09-14T10:59:08.416049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.415907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.088717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.788427+0000","last_change":"2024-09-14T10:59:13.788337+0000","last_active":"2024-09-14T10:59:13.788427+0000","last_peered":"2024-09-14T10:59:13.788427+0000","last_clean":"2024-09-14T10:59:13.788427+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:59:13.788427+0000","last_undegraded":"2024-09-14T10:59:13.788427+0000","last_fullsized":"2024-09-14T10:59:13.788427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'81","last_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_deep_scrub":"37'81","last_deep_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.788216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:53.195658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.286512+0000","last_change":"2024-09-14T10:58:55.286417+0000","last_active":"2024-09-14T10:58:55.286512+0000","last_peered":"2024-09-14T10:58:55.286512+0000","last_clean":"2024-09-14T10:58:55.286512+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:55.286512+0000","last_undegraded":"2024-09-14T10:58:55.286512+0000","last_fullsized":"2024-09-14T10:58:55.286512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.286296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.817177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.090047+0000","last_change":"2024-09-14T10:58:25.089983+0000","last_active":"2024-09-14T10:58:25.090047+0000","last_peered":"2024-09-14T10:58:25.090047+0000","last_clean":"2024-09-14T10:58:25.090047+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:58:25.090047+0000","last_undegraded":"2024-09-14T10:58:25.090047+0000","last_fullsized":"2024-09-14T10:58:25.090047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:47.106405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.587614+0000","last_change":"2024-09-14T10:58:26.587548+0000","last_active":"2024-09-14T10:58:26.587614+0000","last_peered":"2024-09-14T10:58:26.587614+0000","last_clean":"2024-09-14T10:58:26.587614+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:58:26.587614+0000","last_undegraded":"2024-09-14T10:58:26.587614+0000","last_fullsized":"2024-09-14T10:58:26.587614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.587449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:17.118474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.240845+0000","last_change":"2024-09-14T10:59:15.240769+0000","last_active":"2024-09-14T10:59:15.240845+0000","last_peered":"2024-09-14T10:59:15.240845+0000","last_clean":"2024-09-14T10:59:15.240845+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:59:15.240845+0000","last_undegraded":"2024-09-14T10:59:15.240845+0000","last_fullsized":"2024-09-14T10:59:15.240845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.240678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:15.558925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":519,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.015481+0000","last_change":"2024-09-14T10:59:07.015417+0000","last_active":"2024-09-14T10:59:07.015481+0000","last_peered":"2024-09-14T10:59:07.015481+0000","last_clean":"2024-09-14T10:59:07.015481+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:59:07.015481+0000","last_undegraded":"2024-09-14T10:59:07.015481+0000","last_fullsized":"2024-09-14T10:59:07.015481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.015303+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:51.782594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:33.470292+0000","last_change":"2024-09-14T10:59:33.470292+0000","last_active":"2024-09-14T10:59:33.470292+0000","last_peered":"2024-09-14T10:59:33.470292+0000","last_clean":"2024-09-14T10:59:33.470292+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:59:33.470292+0000","last_undegraded":"2024-09-14T10:59:33.470292+0000","last_fullsized":"2024-09-14T10:59:33.470292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:33.470187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:33.470187+0000","last_clean_scrub_stamp":"2024-09-14T10:59:33.470187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.859012+0000","last_change":"2024-09-14T10:59:20.858942+0000","last_active":"2024-09-14T10:59:20.859012+0000","last_peered":"2024-09-14T10:59:20.859012+0000","last_clean":"2024-09-14T10:59:20.859012+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:59:20.859012+0000","last_undegraded":"2024-09-14T10:59:20.859012+0000","last_fullsized":"2024-09-14T10:59:20.859012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.858844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.544088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.557754+0000","last_change":"2024-09-14T10:58:40.557700+0000","last_active":"2024-09-14T10:58:40.557754+0000","last_peered":"2024-09-14T10:58:40.557754+0000","last_clean":"2024-09-14T10:58:40.557754+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:40.557754+0000","last_undegraded":"2024-09-14T10:58:40.557754+0000","last_fullsized":"2024-09-14T10:58:40.557754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.557602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:10.950855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.791361+0000","last_change":"2024-09-14T10:58:23.791275+0000","last_active":"2024-09-14T10:58:23.791361+0000","last_peered":"2024-09-14T10:58:23.791361+0000","last_clean":"2024-09-14T10:58:23.791361+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:58:23.791361+0000","last_undegraded":"2024-09-14T10:58:23.791361+0000","last_fullsized":"2024-09-14T10:58:23.791361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.791189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:54.211244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.586979+0000","last_change":"2024-09-14T10:58:25.586908+0000","last_active":"2024-09-14T10:58:25.586979+0000","last_peered":"2024-09-14T10:58:25.586979+0000","last_clean":"2024-09-14T10:58:25.586979+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:25.586979+0000","last_undegraded":"2024-09-14T10:58:25.586979+0000","last_fullsized":"2024-09-14T10:58:25.586979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.586807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:59.791741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.694637+0000","last_change":"2024-09-14T10:58:51.694574+0000","last_active":"2024-09-14T10:58:51.694637+0000","last_peered":"2024-09-14T10:58:51.694637+0000","last_clean":"2024-09-14T10:58:51.694637+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:58:51.694637+0000","last_undegraded":"2024-09-14T10:58:51.694637+0000","last_fullsized":"2024-09-14T10:58:51.694637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.694493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:32.029523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.679036+0000","last_change":"2024-09-14T10:58:58.678947+0000","last_active":"2024-09-14T10:58:58.679036+0000","last_peered":"2024-09-14T10:58:58.679036+0000","last_clean":"2024-09-14T10:58:58.679036+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:58.679036+0000","last_undegraded":"2024-09-14T10:58:58.679036+0000","last_fullsized":"2024-09-14T10:58:58.679036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.678809+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:42.184294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.385391+0000","last_change":"2024-09-14T10:59:07.385340+0000","last_active":"2024-09-14T10:59:07.385391+0000","last_peered":"2024-09-14T10:59:07.385391+0000","last_clean":"2024-09-14T10:59:07.385391+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:59:07.385391+0000","last_undegraded":"2024-09-14T10:59:07.385391+0000","last_fullsized":"2024-09-14T10:59:07.385391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.385243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:37.754783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:40.453629+0000","last_change":"2024-09-14T10:59:40.453629+0000","last_active":"2024-09-14T10:59:40.453629+0000","last_peered":"2024-09-14T10:59:40.453629+0000","last_clean":"2024-09-14T10:59:40.453629+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:59:40.453629+0000","last_undegraded":"2024-09-14T10:59:40.453629+0000","last_fullsized":"2024-09-14T10:59:40.453629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:40.453526+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:40.453526+0000","last_clean_scrub_stamp":"2024-09-14T10:59:40.453526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:00.279035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.572976+0000","last_change":"2024-09-14T10:58:39.572915+0000","last_active":"2024-09-14T10:58:39.572976+0000","last_peered":"2024-09-14T10:58:39.572976+0000","last_clean":"2024-09-14T10:58:39.572976+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:39.572976+0000","last_undegraded":"2024-09-14T10:58:39.572976+0000","last_fullsized":"2024-09-14T10:58:39.572976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.572821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.045575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.107071+0000","last_change":"2024-09-14T10:58:26.106994+0000","last_active":"2024-09-14T10:58:26.107071+0000","last_peered":"2024-09-14T10:58:26.107071+0000","last_clean":"2024-09-14T10:58:26.107071+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:58:26.107071+0000","last_undegraded":"2024-09-14T10:58:26.107071+0000","last_fullsized":"2024-09-14T10:58:26.107071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.106908+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:54.967192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.820671+0000","last_change":"2024-09-14T10:58:24.820612+0000","last_active":"2024-09-14T10:58:24.820671+0000","last_peered":"2024-09-14T10:58:24.820671+0000","last_clean":"2024-09-14T10:58:24.820671+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:58:24.820671+0000","last_undegraded":"2024-09-14T10:58:24.820671+0000","last_fullsized":"2024-09-14T10:58:24.820671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.820510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:45.492993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.499164+0000","last_change":"2024-09-14T10:58:54.499067+0000","last_active":"2024-09-14T10:58:54.499164+0000","last_peered":"2024-09-14T10:58:54.499164+0000","last_clean":"2024-09-14T10:58:54.499164+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:58:54.499164+0000","last_undegraded":"2024-09-14T10:58:54.499164+0000","last_fullsized":"2024-09-14T10:58:54.499164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.498961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.100542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.388177+0000","last_change":"2024-09-14T10:59:21.388113+0000","last_active":"2024-09-14T10:59:21.388177+0000","last_peered":"2024-09-14T10:59:21.388177+0000","last_clean":"2024-09-14T10:59:21.388177+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:59:21.388177+0000","last_undegraded":"2024-09-14T10:59:21.388177+0000","last_fullsized":"2024-09-14T10:59:21.388177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.388025+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:27.387659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:34.442046+0000","last_change":"2024-09-14T10:59:34.442046+0000","last_active":"2024-09-14T10:59:34.442046+0000","last_peered":"2024-09-14T10:59:34.442046+0000","last_clean":"2024-09-14T10:59:34.442046+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:59:34.442046+0000","last_undegraded":"2024-09-14T10:59:34.442046+0000","last_fullsized":"2024-09-14T10:59:34.442046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:34.441956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:34.441956+0000","last_clean_scrub_stamp":"2024-09-14T10:59:34.441956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:53.077150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.826590+0000","last_change":"2024-09-14T10:59:19.826528+0000","last_active":"2024-09-14T10:59:19.826590+0000","last_peered":"2024-09-14T10:59:19.826590+0000","last_clean":"2024-09-14T10:59:19.826590+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:59:19.826590+0000","last_undegraded":"2024-09-14T10:59:19.826590+0000","last_fullsized":"2024-09-14T10:59:19.826590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.826448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:56.627240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.173116+0000","last_change":"2024-09-14T10:58:37.173058+0000","last_active":"2024-09-14T10:58:37.173116+0000","last_peered":"2024-09-14T10:58:37.173116+0000","last_clean":"2024-09-14T10:58:37.173116+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:37.173116+0000","last_undegraded":"2024-09-14T10:58:37.173116+0000","last_fullsized":"2024-09-14T10:58:37.173116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.172972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:17.508002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.859776+0000","last_change":"2024-09-14T10:58:26.859668+0000","last_active":"2024-09-14T10:58:26.859776+0000","last_peered":"2024-09-14T10:58:26.859776+0000","last_clean":"2024-09-14T10:58:26.859776+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:58:26.859776+0000","last_undegraded":"2024-09-14T10:58:26.859776+0000","last_fullsized":"2024-09-14T10:58:26.859776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.859576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:53.447405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.568697+0000","last_change":"2024-09-14T10:58:23.568609+0000","last_active":"2024-09-14T10:58:23.568697+0000","last_peered":"2024-09-14T10:58:23.568697+0000","last_clean":"2024-09-14T10:58:23.568697+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:58:23.568697+0000","last_undegraded":"2024-09-14T10:58:23.568697+0000","last_fullsized":"2024-09-14T10:58:23.568697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.568525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:01.283682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.462335+0000","last_change":"2024-09-14T10:58:53.462273+0000","last_active":"2024-09-14T10:58:53.462335+0000","last_peered":"2024-09-14T10:58:53.462335+0000","last_clean":"2024-09-14T10:58:53.462335+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:53.462335+0000","last_undegraded":"2024-09-14T10:58:53.462335+0000","last_fullsized":"2024-09-14T10:58:53.462335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.462186+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:08.865241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'76","reported_seq":153,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.436010+0000","last_change":"2024-09-14T10:59:01.435949+0000","last_active":"2024-09-14T10:59:01.436010+0000","last_peered":"2024-09-14T10:59:01.436010+0000","last_clean":"2024-09-14T10:59:01.436010+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:59:01.436010+0000","last_undegraded":"2024-09-14T10:59:01.436010+0000","last_fullsized":"2024-09-14T10:59:01.436010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'76","last_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_deep_scrub":"37'76","last_deep_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.435845+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:19.503768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.681206+0000","last_change":"2024-09-14T10:59:04.681154+0000","last_active":"2024-09-14T10:59:04.681206+0000","last_peered":"2024-09-14T10:59:04.681206+0000","last_clean":"2024-09-14T10:59:04.681206+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:59:04.681206+0000","last_undegraded":"2024-09-14T10:59:04.681206+0000","last_fullsized":"2024-09-14T10:59:04.681206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.681068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:31.995348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.644778+0000","last_change":"2024-09-14T10:59:22.644778+0000","last_active":"2024-09-14T10:59:22.644778+0000","last_peered":"2024-09-14T10:59:22.644778+0000","last_clean":"2024-09-14T10:59:22.644778+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:59:22.644778+0000","last_undegraded":"2024-09-14T10:59:22.644778+0000","last_fullsized":"2024-09-14T10:59:22.644778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-14T10:59:22.644682+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-14T10:59:22.644682+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.644682+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:53.409623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.116613+0000","last_change":"2024-09-14T10:58:39.116558+0000","last_active":"2024-09-14T10:58:39.116613+0000","last_peered":"2024-09-14T10:58:39.116613+0000","last_clean":"2024-09-14T10:58:39.116613+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:39.116613+0000","last_undegraded":"2024-09-14T10:58:39.116613+0000","last_fullsized":"2024-09-14T10:58:39.116613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.116455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:06.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.594205+0000","last_change":"2024-09-14T10:58:27.594149+0000","last_active":"2024-09-14T10:58:27.594205+0000","last_peered":"2024-09-14T10:58:27.594205+0000","last_clean":"2024-09-14T10:58:27.594205+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:27.594205+0000","last_undegraded":"2024-09-14T10:58:27.594205+0000","last_fullsized":"2024-09-14T10:58:27.594205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.594048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:09.026037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.081677+0000","last_change":"2024-09-14T10:58:27.081564+0000","last_active":"2024-09-14T10:58:27.081677+0000","last_peered":"2024-09-14T10:58:27.081677+0000","last_clean":"2024-09-14T10:58:27.081677+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:58:27.081677+0000","last_undegraded":"2024-09-14T10:58:27.081677+0000","last_fullsized":"2024-09-14T10:58:27.081677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.081459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.187198+0000","last_change":"2024-09-14T10:59:13.187086+0000","last_active":"2024-09-14T10:59:13.187198+0000","last_peered":"2024-09-14T10:59:13.187198+0000","last_clean":"2024-09-14T10:59:13.187198+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:59:13.187198+0000","last_undegraded":"2024-09-14T10:59:13.187198+0000","last_fullsized":"2024-09-14T10:59:13.187198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.186988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:15.867651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.059645+0000","last_change":"2024-09-14T10:59:06.059580+0000","last_active":"2024-09-14T10:59:06.059645+0000","last_peered":"2024-09-14T10:59:06.059645+0000","last_clean":"2024-09-14T10:59:06.059645+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:59:06.059645+0000","last_undegraded":"2024-09-14T10:59:06.059645+0000","last_fullsized":"2024-09-14T10:59:06.059645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.059473+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:52.359073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.929779+0000","last_change":"2024-09-14T10:59:10.929681+0000","last_active":"2024-09-14T10:59:10.929779+0000","last_peered":"2024-09-14T10:59:10.929779+0000","last_clean":"2024-09-14T10:59:10.929779+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:59:10.929779+0000","last_undegraded":"2024-09-14T10:59:10.929779+0000","last_fullsized":"2024-09-14T10:59:10.929779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.929558+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:32.946072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746149+0000","last_change":"2024-09-14T10:55:14.730483+0000","last_active":"2024-09-14T10:55:41.746149+0000","last_peered":"2024-09-14T10:55:41.746149+0000","last_clean":"2024-09-14T10:55:41.746149+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:55:41.746149+0000","last_undegraded":"2024-09-14T10:55:41.746149+0000","last_fullsized":"2024-09-14T10:55:41.746149+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:31.056507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.238769+0000","last_change":"2024-09-14T10:58:53.238709+0000","last_active":"2024-09-14T10:58:53.238769+0000","last_peered":"2024-09-14T10:58:53.238769+0000","last_clean":"2024-09-14T10:58:53.238769+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:58:53.238769+0000","last_undegraded":"2024-09-14T10:58:53.238769+0000","last_fullsized":"2024-09-14T10:58:53.238769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.238622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.890586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.116649+0000","last_change":"2024-09-14T10:58:31.116581+0000","last_active":"2024-09-14T10:58:31.116649+0000","last_peered":"2024-09-14T10:58:31.116649+0000","last_clean":"2024-09-14T10:58:31.116649+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:58:31.116649+0000","last_undegraded":"2024-09-14T10:58:31.116649+0000","last_fullsized":"2024-09-14T10:58:31.116649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.116494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.643323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.589321+0000","last_change":"2024-09-14T10:58:24.589271+0000","last_active":"2024-09-14T10:58:24.589321+0000","last_peered":"2024-09-14T10:58:24.589321+0000","last_clean":"2024-09-14T10:58:24.589321+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:58:24.589321+0000","last_undegraded":"2024-09-14T10:58:24.589321+0000","last_fullsized":"2024-09-14T10:58:24.589321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.589189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:10.074498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.205725+0000","last_change":"2024-09-14T10:59:12.205661+0000","last_active":"2024-09-14T10:59:12.205725+0000","last_peered":"2024-09-14T10:59:12.205725+0000","last_clean":"2024-09-14T10:59:12.205725+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:59:12.205725+0000","last_undegraded":"2024-09-14T10:59:12.205725+0000","last_fullsized":"2024-09-14T10:59:12.205725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.205517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.359398+0000","last_change":"2024-09-14T10:59:20.359321+0000","last_active":"2024-09-14T10:59:20.359398+0000","last_peered":"2024-09-14T10:59:20.359398+0000","last_clean":"2024-09-14T10:59:20.359398+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:59:20.359398+0000","last_undegraded":"2024-09-14T10:59:20.359398+0000","last_fullsized":"2024-09-14T10:59:20.359398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.359218+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:25.021682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":402,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.493282+0000","last_change":"2024-09-14T10:59:13.493228+0000","last_active":"2024-09-14T10:59:13.493282+0000","last_peered":"2024-09-14T10:59:13.493282+0000","last_clean":"2024-09-14T10:59:13.493282+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:59:13.493282+0000","last_undegraded":"2024-09-14T10:59:13.493282+0000","last_fullsized":"2024-09-14T10:59:13.493282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.493141+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:03.120118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'8","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.843260+0000","last_change":"2024-09-14T10:59:21.843260+0000","last_active":"2024-09-14T10:59:21.843260+0000","last_peered":"2024-09-14T10:59:21.843260+0000","last_clean":"2024-09-14T10:59:21.843260+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:59:21.843260+0000","last_undegraded":"2024-09-14T10:59:21.843260+0000","last_fullsized":"2024-09-14T10:59:21.843260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.843177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:05.873379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.746067+0000","last_change":"2024-09-14T10:58:38.745965+0000","last_active":"2024-09-14T10:58:38.746067+0000","last_peered":"2024-09-14T10:58:38.746067+0000","last_clean":"2024-09-14T10:58:38.746067+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:38.746067+0000","last_undegraded":"2024-09-14T10:58:38.746067+0000","last_fullsized":"2024-09-14T10:58:38.746067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.745855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.592315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.289716+0000","last_change":"2024-09-14T10:58:26.289652+0000","last_active":"2024-09-14T10:58:26.289716+0000","last_peered":"2024-09-14T10:58:26.289716+0000","last_clean":"2024-09-14T10:58:26.289716+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:58:26.289716+0000","last_undegraded":"2024-09-14T10:58:26.289716+0000","last_fullsized":"2024-09-14T10:58:26.289716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.289566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.279373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.103763+0000","last_change":"2024-09-14T10:58:29.103701+0000","last_active":"2024-09-14T10:58:29.103763+0000","last_peered":"2024-09-14T10:58:29.103763+0000","last_clean":"2024-09-14T10:58:29.103763+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:58:29.103763+0000","last_undegraded":"2024-09-14T10:58:29.103763+0000","last_fullsized":"2024-09-14T10:58:29.103763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.103624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:04.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.222060+0000","last_change":"2024-09-14T10:59:11.221996+0000","last_active":"2024-09-14T10:59:11.222060+0000","last_peered":"2024-09-14T10:59:11.222060+0000","last_clean":"2024-09-14T10:59:11.222060+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:59:11.222060+0000","last_undegraded":"2024-09-14T10:59:11.222060+0000","last_fullsized":"2024-09-14T10:59:11.222060+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.221910+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:56.327449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'101","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.691560+0000","last_change":"2024-09-14T10:58:56.691503+0000","last_active":"2024-09-14T10:58:56.691560+0000","last_peered":"2024-09-14T10:58:56.691560+0000","last_clean":"2024-09-14T10:58:56.691560+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:56.691560+0000","last_undegraded":"2024-09-14T10:58:56.691560+0000","last_fullsized":"2024-09-14T10:58:56.691560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'101","last_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_deep_scrub":"37'101","last_deep_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.691401+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:40.292482+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.423604+0000","last_change":"2024-09-14T10:59:06.423553+0000","last_active":"2024-09-14T10:59:06.423604+0000","last_peered":"2024-09-14T10:59:06.423604+0000","last_clean":"2024-09-14T10:59:06.423604+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:59:06.423604+0000","last_undegraded":"2024-09-14T10:59:06.423604+0000","last_fullsized":"2024-09-14T10:59:06.423604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.423468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:55.849051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.824478+0000","last_change":"2024-09-14T10:59:14.824478+0000","last_active":"2024-09-14T10:59:14.824478+0000","last_peered":"2024-09-14T10:59:14.824478+0000","last_clean":"2024-09-14T10:59:14.824478+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:59:14.824478+0000","last_undegraded":"2024-09-14T10:59:14.824478+0000","last_fullsized":"2024-09-14T10:59:14.824478+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.824378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:39.981806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.895503+0000","last_change":"2024-09-14T10:59:16.895449+0000","last_active":"2024-09-14T10:59:16.895503+0000","last_peered":"2024-09-14T10:59:16.895503+0000","last_clean":"2024-09-14T10:59:16.895503+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:59:16.895503+0000","last_undegraded":"2024-09-14T10:59:16.895503+0000","last_fullsized":"2024-09-14T10:59:16.895503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.895366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.067531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.732352+0000","last_change":"2024-09-14T10:58:42.732352+0000","last_active":"2024-09-14T10:58:42.732352+0000","last_peered":"2024-09-14T10:58:42.732352+0000","last_clean":"2024-09-14T10:58:42.732352+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:58:42.732352+0000","last_undegraded":"2024-09-14T10:58:42.732352+0000","last_fullsized":"2024-09-14T10:58:42.732352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.732246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:14.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.177563+0000","last_change":"2024-09-14T10:58:41.177563+0000","last_active":"2024-09-14T10:58:41.177563+0000","last_peered":"2024-09-14T10:58:41.177563+0000","last_clean":"2024-09-14T10:58:41.177563+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:58:41.177563+0000","last_undegraded":"2024-09-14T10:58:41.177563+0000","last_fullsized":"2024-09-14T10:58:41.177563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.177454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:25.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.069060+0000","last_change":"2024-09-14T10:59:00.069060+0000","last_active":"2024-09-14T10:59:00.069060+0000","last_peered":"2024-09-14T10:59:00.069060+0000","last_clean":"2024-09-14T10:59:00.069060+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:59:00.069060+0000","last_undegraded":"2024-09-14T10:59:00.069060+0000","last_fullsized":"2024-09-14T10:59:00.069060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.068976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:01.384012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'40","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:26.415749+0000","last_change":"2024-09-14T10:59:26.415749+0000","last_active":"2024-09-14T10:59:26.415749+0000","last_peered":"2024-09-14T10:59:26.415749+0000","last_clean":"2024-09-14T10:59:26.415749+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:59:26.415749+0000","last_undegraded":"2024-09-14T10:59:26.415749+0000","last_fullsized":"2024-09-14T10:59:26.415749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:26.415644+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:26.415644+0000","last_clean_scrub_stamp":"2024-09-14T10:59:26.415644+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:05.731325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:36.496725+0000","last_change":"2024-09-14T10:59:36.496725+0000","last_active":"2024-09-14T10:59:36.496725+0000","last_peered":"2024-09-14T10:59:36.496725+0000","last_clean":"2024-09-14T10:59:36.496725+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:59:36.496725+0000","last_undegraded":"2024-09-14T10:59:36.496725+0000","last_fullsized":"2024-09-14T10:59:36.496725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:36.496614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:36.496614+0000","last_clean_scrub_stamp":"2024-09-14T10:59:36.496614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:54.201020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:26.682919+0000","last_change":"2024-09-14T10:59:26.682919+0000","last_active":"2024-09-14T10:59:26.682919+0000","last_peered":"2024-09-14T10:59:26.682919+0000","last_clean":"2024-09-14T10:59:26.682919+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:59:26.682919+0000","last_undegraded":"2024-09-14T10:59:26.682919+0000","last_fullsized":"2024-09-14T10:59:26.682919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:26.682791+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:26.682791+0000","last_clean_scrub_stamp":"2024-09-14T10:59:26.682791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:33.070183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.081008+0000","last_change":"2024-09-14T10:58:43.081008+0000","last_active":"2024-09-14T10:58:43.081008+0000","last_peered":"2024-09-14T10:58:43.081008+0000","last_clean":"2024-09-14T10:58:43.081008+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:58:43.081008+0000","last_undegraded":"2024-09-14T10:58:43.081008+0000","last_fullsized":"2024-09-14T10:58:43.081008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.080921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:50.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.775299+0000","last_change":"2024-09-14T10:58:30.775299+0000","last_active":"2024-09-14T10:58:30.775299+0000","last_peered":"2024-09-14T10:58:30.775299+0000","last_clean":"2024-09-14T10:58:30.775299+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:58:30.775299+0000","last_undegraded":"2024-09-14T10:58:30.775299+0000","last_fullsized":"2024-09-14T10:58:30.775299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.775211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:47.614898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.294422+0000","last_change":"2024-09-14T10:59:17.294422+0000","last_active":"2024-09-14T10:59:17.294422+0000","last_peered":"2024-09-14T10:59:17.294422+0000","last_clean":"2024-09-14T10:59:17.294422+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:59:17.294422+0000","last_undegraded":"2024-09-14T10:59:17.294422+0000","last_fullsized":"2024-09-14T10:59:17.294422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.294339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:41.287665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.450923+0000","last_change":"2024-09-14T10:59:05.450923+0000","last_active":"2024-09-14T10:59:05.450923+0000","last_peered":"2024-09-14T10:59:05.450923+0000","last_clean":"2024-09-14T10:59:05.450923+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:59:05.450923+0000","last_undegraded":"2024-09-14T10:59:05.450923+0000","last_fullsized":"2024-09-14T10:59:05.450923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.450828+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.547681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.721772+0000","last_change":"2024-09-14T10:59:07.721772+0000","last_active":"2024-09-14T10:59:07.721772+0000","last_peered":"2024-09-14T10:59:07.721772+0000","last_clean":"2024-09-14T10:59:07.721772+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:59:07.721772+0000","last_undegraded":"2024-09-14T10:59:07.721772+0000","last_fullsized":"2024-09-14T10:59:07.721772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.721683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:53.356436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:25.658476+0000","last_change":"2024-09-14T10:59:25.658476+0000","last_active":"2024-09-14T10:59:25.658476+0000","last_peered":"2024-09-14T10:59:25.658476+0000","last_clean":"2024-09-14T10:59:25.658476+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:59:25.658476+0000","last_undegraded":"2024-09-14T10:59:25.658476+0000","last_fullsized":"2024-09-14T10:59:25.658476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:25.658402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:25.658402+0000","last_clean_scrub_stamp":"2024-09-14T10:59:25.658402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:22.419520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.535431+0000","last_change":"2024-09-14T10:58:41.535431+0000","last_active":"2024-09-14T10:58:41.535431+0000","last_peered":"2024-09-14T10:58:41.535431+0000","last_clean":"2024-09-14T10:58:41.535431+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:41.535431+0000","last_undegraded":"2024-09-14T10:58:41.535431+0000","last_fullsized":"2024-09-14T10:58:41.535431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.535348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:23.024244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.788388+0000","last_change":"2024-09-14T10:58:29.788388+0000","last_active":"2024-09-14T10:58:29.788388+0000","last_peered":"2024-09-14T10:58:29.788388+0000","last_clean":"2024-09-14T10:58:29.788388+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:58:29.788388+0000","last_undegraded":"2024-09-14T10:58:29.788388+0000","last_fullsized":"2024-09-14T10:58:29.788388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.788303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:32.833510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.684626+0000","last_change":"2024-09-14T10:58:52.684626+0000","last_active":"2024-09-14T10:58:52.684626+0000","last_peered":"2024-09-14T10:58:52.684626+0000","last_clean":"2024-09-14T10:58:52.684626+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:58:52.684626+0000","last_undegraded":"2024-09-14T10:58:52.684626+0000","last_fullsized":"2024-09-14T10:58:52.684626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.684528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.491610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'49","reported_seq":121,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.435649+0000","last_change":"2024-09-14T10:59:02.435649+0000","last_active":"2024-09-14T10:59:02.435649+0000","last_peered":"2024-09-14T10:59:02.435649+0000","last_clean":"2024-09-14T10:59:02.435649+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:59:02.435649+0000","last_undegraded":"2024-09-14T10:59:02.435649+0000","last_fullsized":"2024-09-14T10:59:02.435649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.435554+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:13.499863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.855092+0000","last_change":"2024-09-14T10:59:13.855092+0000","last_active":"2024-09-14T10:59:13.855092+0000","last_peered":"2024-09-14T10:59:13.855092+0000","last_clean":"2024-09-14T10:59:13.855092+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:59:13.855092+0000","last_undegraded":"2024-09-14T10:59:13.855092+0000","last_fullsized":"2024-09-14T10:59:13.855092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.855007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.983456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.746350+0000","last_change":"2024-09-14T10:55:14.730790+0000","last_active":"2024-09-14T10:55:41.746350+0000","last_peered":"2024-09-14T10:55:41.746350+0000","last_clean":"2024-09-14T10:55:41.746350+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:55:41.746350+0000","last_undegraded":"2024-09-14T10:55:41.746350+0000","last_fullsized":"2024-09-14T10:55:41.746350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:57.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.289056+0000","last_change":"2024-09-14T10:58:58.289056+0000","last_active":"2024-09-14T10:58:58.289056+0000","last_peered":"2024-09-14T10:58:58.289056+0000","last_clean":"2024-09-14T10:58:58.289056+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:58:58.289056+0000","last_undegraded":"2024-09-14T10:58:58.289056+0000","last_fullsized":"2024-09-14T10:58:58.289056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.288955+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.787124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.206920+0000","last_change":"2024-09-14T10:58:29.206920+0000","last_active":"2024-09-14T10:58:29.206920+0000","last_peered":"2024-09-14T10:58:29.206920+0000","last_clean":"2024-09-14T10:58:29.206920+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:58:29.206920+0000","last_undegraded":"2024-09-14T10:58:29.206920+0000","last_fullsized":"2024-09-14T10:58:29.206920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.206835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:53.545366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.247242+0000","last_change":"2024-09-14T10:59:16.247242+0000","last_active":"2024-09-14T10:59:16.247242+0000","last_peered":"2024-09-14T10:59:16.247242+0000","last_clean":"2024-09-14T10:59:16.247242+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:59:16.247242+0000","last_undegraded":"2024-09-14T10:59:16.247242+0000","last_fullsized":"2024-09-14T10:59:16.247242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.247150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:52.172918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.665776+0000","last_change":"2024-09-14T10:59:01.665776+0000","last_active":"2024-09-14T10:59:01.665776+0000","last_peered":"2024-09-14T10:59:01.665776+0000","last_clean":"2024-09-14T10:59:01.665776+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:59:01.665776+0000","last_undegraded":"2024-09-14T10:59:01.665776+0000","last_fullsized":"2024-09-14T10:59:01.665776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.665619+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:22.301986+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.686929+0000","last_change":"2024-09-14T10:59:08.686929+0000","last_active":"2024-09-14T10:59:08.686929+0000","last_peered":"2024-09-14T10:59:08.686929+0000","last_clean":"2024-09-14T10:59:08.686929+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:59:08.686929+0000","last_undegraded":"2024-09-14T10:59:08.686929+0000","last_fullsized":"2024-09-14T10:59:08.686929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.686815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:37.922629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.311192+0000","last_change":"2024-09-14T10:59:03.311089+0000","last_active":"2024-09-14T10:59:03.311192+0000","last_peered":"2024-09-14T10:59:03.311192+0000","last_clean":"2024-09-14T10:59:03.311192+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:59:03.311192+0000","last_undegraded":"2024-09-14T10:59:03.311192+0000","last_fullsized":"2024-09-14T10:59:03.311192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.310960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:15.706209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.107566+0000","last_change":"2024-09-14T10:58:39.107566+0000","last_active":"2024-09-14T10:58:39.107566+0000","last_peered":"2024-09-14T10:58:39.107566+0000","last_clean":"2024-09-14T10:58:39.107566+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:58:39.107566+0000","last_undegraded":"2024-09-14T10:58:39.107566+0000","last_fullsized":"2024-09-14T10:58:39.107566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.107454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:43.832399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.451636+0000","last_change":"2024-09-14T10:59:00.451569+0000","last_active":"2024-09-14T10:59:00.451636+0000","last_peered":"2024-09-14T10:59:00.451636+0000","last_clean":"2024-09-14T10:59:00.451636+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:59:00.451636+0000","last_undegraded":"2024-09-14T10:59:00.451636+0000","last_fullsized":"2024-09-14T10:59:00.451636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.451469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:40.073007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'65","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.484527+0000","last_change":"2024-09-14T10:59:03.484527+0000","last_active":"2024-09-14T10:59:03.484527+0000","last_peered":"2024-09-14T10:59:03.484527+0000","last_clean":"2024-09-14T10:59:03.484527+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:59:03.484527+0000","last_undegraded":"2024-09-14T10:59:03.484527+0000","last_fullsized":"2024-09-14T10:59:03.484527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.484426+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.066126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.696165+0000","last_change":"2024-09-14T10:59:09.696165+0000","last_active":"2024-09-14T10:59:09.696165+0000","last_peered":"2024-09-14T10:59:09.696165+0000","last_clean":"2024-09-14T10:59:09.696165+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:59:09.696165+0000","last_undegraded":"2024-09-14T10:59:09.696165+0000","last_fullsized":"2024-09-14T10:59:09.696165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.696077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:53.945948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.650298+0000","last_change":"2024-09-14T10:59:23.650298+0000","last_active":"2024-09-14T10:59:23.650298+0000","last_peered":"2024-09-14T10:59:23.650298+0000","last_clean":"2024-09-14T10:59:23.650298+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:59:23.650298+0000","last_undegraded":"2024-09-14T10:59:23.650298+0000","last_fullsized":"2024-09-14T10:59:23.650298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:23.650194+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:23.650194+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.650194+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:09.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.518559+0000","last_change":"2024-09-14T10:58:43.518493+0000","last_active":"2024-09-14T10:58:43.518559+0000","last_peered":"2024-09-14T10:58:43.518559+0000","last_clean":"2024-09-14T10:58:43.518559+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:43.518559+0000","last_undegraded":"2024-09-14T10:58:43.518559+0000","last_fullsized":"2024-09-14T10:58:43.518559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.518393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:29.224226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.217001+0000","last_change":"2024-09-14T10:58:28.217001+0000","last_active":"2024-09-14T10:58:28.217001+0000","last_peered":"2024-09-14T10:58:28.217001+0000","last_clean":"2024-09-14T10:58:28.217001+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:58:28.217001+0000","last_undegraded":"2024-09-14T10:58:28.217001+0000","last_fullsized":"2024-09-14T10:58:28.217001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.216899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:59.951004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.664202+0000","last_change":"2024-09-14T10:58:54.664147+0000","last_active":"2024-09-14T10:58:54.664202+0000","last_peered":"2024-09-14T10:58:54.664202+0000","last_clean":"2024-09-14T10:58:54.664202+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:58:54.664202+0000","last_undegraded":"2024-09-14T10:58:54.664202+0000","last_fullsized":"2024-09-14T10:58:54.664202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.664065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:15.688027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:31.476206+0000","last_change":"2024-09-14T10:59:31.476206+0000","last_active":"2024-09-14T10:59:31.476206+0000","last_peered":"2024-09-14T10:59:31.476206+0000","last_clean":"2024-09-14T10:59:31.476206+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:59:31.476206+0000","last_undegraded":"2024-09-14T10:59:31.476206+0000","last_fullsized":"2024-09-14T10:59:31.476206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:31.476106+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:31.476106+0000","last_clean_scrub_stamp":"2024-09-14T10:59:31.476106+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:39.449223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.854224+0000","last_change":"2024-09-14T10:59:16.854224+0000","last_active":"2024-09-14T10:59:16.854224+0000","last_peered":"2024-09-14T10:59:16.854224+0000","last_clean":"2024-09-14T10:59:16.854224+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:59:16.854224+0000","last_undegraded":"2024-09-14T10:59:16.854224+0000","last_fullsized":"2024-09-14T10:59:16.854224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.854142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:20.380972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:12.678213+0000","last_change":"2024-09-14T10:55:14.728997+0000","last_active":"2024-09-14T10:58:12.678213+0000","last_peered":"2024-09-14T10:58:12.678213+0000","last_clean":"2024-09-14T10:58:12.678213+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:58:12.678213+0000","last_undegraded":"2024-09-14T10:58:12.678213+0000","last_fullsized":"2024-09-14T10:58:12.678213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:25.904148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.344968+0000","last_change":"2024-09-14T10:59:04.344968+0000","last_active":"2024-09-14T10:59:04.344968+0000","last_peered":"2024-09-14T10:59:04.344968+0000","last_clean":"2024-09-14T10:59:04.344968+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:59:04.344968+0000","last_undegraded":"2024-09-14T10:59:04.344968+0000","last_fullsized":"2024-09-14T10:59:04.344968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.344883+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.737716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.239940+0000","last_change":"2024-09-14T10:58:27.239940+0000","last_active":"2024-09-14T10:58:27.239940+0000","last_peered":"2024-09-14T10:58:27.239940+0000","last_clean":"2024-09-14T10:58:27.239940+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:58:27.239940+0000","last_undegraded":"2024-09-14T10:58:27.239940+0000","last_fullsized":"2024-09-14T10:58:27.239940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.239835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:20.526619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.649814+0000","last_change":"2024-09-14T10:58:53.649814+0000","last_active":"2024-09-14T10:58:53.649814+0000","last_peered":"2024-09-14T10:58:53.649814+0000","last_clean":"2024-09-14T10:58:53.649814+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:58:53.649814+0000","last_undegraded":"2024-09-14T10:58:53.649814+0000","last_fullsized":"2024-09-14T10:58:53.649814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.649710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:50.909366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.477299+0000","last_change":"2024-09-14T10:59:04.477244+0000","last_active":"2024-09-14T10:59:04.477299+0000","last_peered":"2024-09-14T10:59:04.477299+0000","last_clean":"2024-09-14T10:59:04.477299+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:59:04.477299+0000","last_undegraded":"2024-09-14T10:59:04.477299+0000","last_fullsized":"2024-09-14T10:59:04.477299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.477125+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:02.058047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.497609+0000","last_change":"2024-09-14T10:59:14.497556+0000","last_active":"2024-09-14T10:59:14.497609+0000","last_peered":"2024-09-14T10:59:14.497609+0000","last_clean":"2024-09-14T10:59:14.497609+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:59:14.497609+0000","last_undegraded":"2024-09-14T10:59:14.497609+0000","last_fullsized":"2024-09-14T10:59:14.497609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.497472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:22.192393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:12.579985+0000","last_change":"2024-09-14T10:55:14.731759+0000","last_active":"2024-09-14T10:57:12.579985+0000","last_peered":"2024-09-14T10:57:12.579985+0000","last_clean":"2024-09-14T10:57:12.579985+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:57:12.579985+0000","last_undegraded":"2024-09-14T10:57:12.579985+0000","last_fullsized":"2024-09-14T10:57:12.579985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:41.437751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.487050+0000","last_change":"2024-09-14T10:58:44.487050+0000","last_active":"2024-09-14T10:58:44.487050+0000","last_peered":"2024-09-14T10:58:44.487050+0000","last_clean":"2024-09-14T10:58:44.487050+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:44.487050+0000","last_undegraded":"2024-09-14T10:58:44.487050+0000","last_fullsized":"2024-09-14T10:58:44.487050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.486941+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:33.241927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.153933+0000","last_change":"2024-09-14T10:58:40.153933+0000","last_active":"2024-09-14T10:58:40.153933+0000","last_peered":"2024-09-14T10:58:40.153933+0000","last_clean":"2024-09-14T10:58:40.153933+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:58:40.153933+0000","last_undegraded":"2024-09-14T10:58:40.153933+0000","last_fullsized":"2024-09-14T10:58:40.153933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.153809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.058987+0000","last_change":"2024-09-14T10:59:05.058987+0000","last_active":"2024-09-14T10:59:05.058987+0000","last_peered":"2024-09-14T10:59:05.058987+0000","last_clean":"2024-09-14T10:59:05.058987+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:59:05.058987+0000","last_undegraded":"2024-09-14T10:59:05.058987+0000","last_fullsized":"2024-09-14T10:59:05.058987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.058900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:57.231065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:32.500655+0000","last_change":"2024-09-14T10:59:32.500655+0000","last_active":"2024-09-14T10:59:32.500655+0000","last_peered":"2024-09-14T10:59:32.500655+0000","last_clean":"2024-09-14T10:59:32.500655+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:59:32.500655+0000","last_undegraded":"2024-09-14T10:59:32.500655+0000","last_fullsized":"2024-09-14T10:59:32.500655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-14T10:59:32.500550+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-14T10:59:32.500550+0000","last_clean_scrub_stamp":"2024-09-14T10:59:32.500550+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:57.728843+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.656144+0000","last_change":"2024-09-14T10:59:10.656083+0000","last_active":"2024-09-14T10:59:10.656144+0000","last_peered":"2024-09-14T10:59:10.656144+0000","last_clean":"2024-09-14T10:59:10.656144+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:59:10.656144+0000","last_undegraded":"2024-09-14T10:59:10.656144+0000","last_fullsized":"2024-09-14T10:59:10.656144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.655996+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:02.900112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:55:41.741094+0000","last_change":"2024-09-14T10:55:14.725076+0000","last_active":"2024-09-14T10:55:41.741094+0000","last_peered":"2024-09-14T10:55:41.741094+0000","last_clean":"2024-09-14T10:55:41.741094+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:55:41.741094+0000","last_undegraded":"2024-09-14T10:55:41.741094+0000","last_fullsized":"2024-09-14T10:55:41.741094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:34.890050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.766566+0000","last_change":"2024-09-14T10:58:43.766566+0000","last_active":"2024-09-14T10:58:43.766566+0000","last_peered":"2024-09-14T10:58:43.766566+0000","last_clean":"2024-09-14T10:58:43.766566+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:58:43.766566+0000","last_undegraded":"2024-09-14T10:58:43.766566+0000","last_fullsized":"2024-09-14T10:58:43.766566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.766463+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:32.340255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.227452+0000","last_change":"2024-09-14T10:58:30.227452+0000","last_active":"2024-09-14T10:58:30.227452+0000","last_peered":"2024-09-14T10:58:30.227452+0000","last_clean":"2024-09-14T10:58:30.227452+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:30.227452+0000","last_undegraded":"2024-09-14T10:58:30.227452+0000","last_fullsized":"2024-09-14T10:58:30.227452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.227364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:25.413050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.060577+0000","last_change":"2024-09-14T10:59:03.060577+0000","last_active":"2024-09-14T10:59:03.060577+0000","last_peered":"2024-09-14T10:59:03.060577+0000","last_clean":"2024-09-14T10:59:03.060577+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:59:03.060577+0000","last_undegraded":"2024-09-14T10:59:03.060577+0000","last_fullsized":"2024-09-14T10:59:03.060577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.060457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:28.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.892946+0000","last_change":"2024-09-14T10:59:12.892946+0000","last_active":"2024-09-14T10:59:12.892946+0000","last_peered":"2024-09-14T10:59:12.892946+0000","last_clean":"2024-09-14T10:59:12.892946+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:59:12.892946+0000","last_undegraded":"2024-09-14T10:59:12.892946+0000","last_fullsized":"2024-09-14T10:59:12.892946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.892842+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:40.674758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.465590+0000","last_change":"2024-09-14T10:59:17.465590+0000","last_active":"2024-09-14T10:59:17.465590+0000","last_peered":"2024-09-14T10:59:17.465590+0000","last_clean":"2024-09-14T10:59:17.465590+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:59:17.465590+0000","last_undegraded":"2024-09-14T10:59:17.465590+0000","last_fullsized":"2024-09-14T10:59:17.465590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.465512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:34.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.802685+0000","last_change":"2024-09-14T10:59:23.802685+0000","last_active":"2024-09-14T10:59:23.802685+0000","last_peered":"2024-09-14T10:59:23.802685+0000","last_clean":"2024-09-14T10:59:23.802685+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:59:23.802685+0000","last_undegraded":"2024-09-14T10:59:23.802685+0000","last_fullsized":"2024-09-14T10:59:23.802685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:23.802576+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:23.802576+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.802576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:31.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.735243+0000","last_change":"2024-09-14T10:58:44.735243+0000","last_active":"2024-09-14T10:58:44.735243+0000","last_peered":"2024-09-14T10:58:44.735243+0000","last_clean":"2024-09-14T10:58:44.735243+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:44.735243+0000","last_undegraded":"2024-09-14T10:58:44.735243+0000","last_fullsized":"2024-09-14T10:58:44.735243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.735157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:39.920842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.246127+0000","last_change":"2024-09-14T10:58:43.246127+0000","last_active":"2024-09-14T10:58:43.246127+0000","last_peered":"2024-09-14T10:58:43.246127+0000","last_clean":"2024-09-14T10:58:43.246127+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:58:43.246127+0000","last_undegraded":"2024-09-14T10:58:43.246127+0000","last_fullsized":"2024-09-14T10:58:43.246127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.246039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.703082+0000","last_change":"2024-09-14T10:58:55.703082+0000","last_active":"2024-09-14T10:58:55.703082+0000","last_peered":"2024-09-14T10:58:55.703082+0000","last_clean":"2024-09-14T10:58:55.703082+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:58:55.703082+0000","last_undegraded":"2024-09-14T10:58:55.703082+0000","last_fullsized":"2024-09-14T10:58:55.703082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.702997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:50.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.446674+0000","last_change":"2024-09-14T10:59:09.446674+0000","last_active":"2024-09-14T10:59:09.446674+0000","last_peered":"2024-09-14T10:59:09.446674+0000","last_clean":"2024-09-14T10:59:09.446674+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:59:09.446674+0000","last_undegraded":"2024-09-14T10:59:09.446674+0000","last_fullsized":"2024-09-14T10:59:09.446674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.446576+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:39.202271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:38.486051+0000","last_change":"2024-09-14T10:59:38.486051+0000","last_active":"2024-09-14T10:59:38.486051+0000","last_peered":"2024-09-14T10:59:38.486051+0000","last_clean":"2024-09-14T10:59:38.486051+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:59:38.486051+0000","last_undegraded":"2024-09-14T10:59:38.486051+0000","last_fullsized":"2024-09-14T10:59:38.486051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:38.485958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:38.485958+0000","last_clean_scrub_stamp":"2024-09-14T10:59:38.485958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:23.006097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:13.242291+0000","last_change":"2024-09-14T10:55:14.730407+0000","last_active":"2024-09-14T10:58:13.242291+0000","last_peered":"2024-09-14T10:58:13.242291+0000","last_clean":"2024-09-14T10:58:13.242291+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:58:13.242291+0000","last_undegraded":"2024-09-14T10:58:13.242291+0000","last_fullsized":"2024-09-14T10:58:13.242291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:01.920827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.309250+0000","last_change":"2024-09-14T10:59:01.309250+0000","last_active":"2024-09-14T10:59:01.309250+0000","last_peered":"2024-09-14T10:59:01.309250+0000","last_clean":"2024-09-14T10:59:01.309250+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:59:01.309250+0000","last_undegraded":"2024-09-14T10:59:01.309250+0000","last_fullsized":"2024-09-14T10:59:01.309250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.309130+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.220911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.633930+0000","last_change":"2024-09-14T10:58:28.633837+0000","last_active":"2024-09-14T10:58:28.633930+0000","last_peered":"2024-09-14T10:58:28.633930+0000","last_clean":"2024-09-14T10:58:28.633930+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:58:28.633930+0000","last_undegraded":"2024-09-14T10:58:28.633930+0000","last_fullsized":"2024-09-14T10:58:28.633930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.633728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:50.487848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.057121+0000","last_change":"2024-09-14T10:59:02.057121+0000","last_active":"2024-09-14T10:59:02.057121+0000","last_peered":"2024-09-14T10:59:02.057121+0000","last_clean":"2024-09-14T10:59:02.057121+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:59:02.057121+0000","last_undegraded":"2024-09-14T10:59:02.057121+0000","last_fullsized":"2024-09-14T10:59:02.057121+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.057026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:06.578087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'31","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:30.460209+0000","last_change":"2024-09-14T10:59:30.460209+0000","last_active":"2024-09-14T10:59:30.460209+0000","last_peered":"2024-09-14T10:59:30.460209+0000","last_clean":"2024-09-14T10:59:30.460209+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:59:30.460209+0000","last_undegraded":"2024-09-14T10:59:30.460209+0000","last_fullsized":"2024-09-14T10:59:30.460209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'31","last_scrub_stamp":"2024-09-14T10:59:30.460078+0000","last_deep_scrub":"37'31","last_deep_scrub_stamp":"2024-09-14T10:59:30.460078+0000","last_clean_scrub_stamp":"2024-09-14T10:59:30.460078+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:54.136403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:39.460002+0000","last_change":"2024-09-14T10:59:39.460002+0000","last_active":"2024-09-14T10:59:39.460002+0000","last_peered":"2024-09-14T10:59:39.460002+0000","last_clean":"2024-09-14T10:59:39.460002+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:59:39.460002+0000","last_undegraded":"2024-09-14T10:59:39.460002+0000","last_fullsized":"2024-09-14T10:59:39.460002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:39.459917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:39.459917+0000","last_clean_scrub_stamp":"2024-09-14T10:59:39.459917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.176936+0000","last_change":"2024-09-14T10:55:14.730648+0000","last_active":"2024-09-14T10:57:11.176936+0000","last_peered":"2024-09-14T10:57:11.176936+0000","last_clean":"2024-09-14T10:57:11.176936+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:57:11.176936+0000","last_undegraded":"2024-09-14T10:57:11.176936+0000","last_fullsized":"2024-09-14T10:57:11.176936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:36.993757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.678256+0000","last_change":"2024-09-14T10:58:47.678256+0000","last_active":"2024-09-14T10:58:47.678256+0000","last_peered":"2024-09-14T10:58:47.678256+0000","last_clean":"2024-09-14T10:58:47.678256+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:47.678256+0000","last_undegraded":"2024-09-14T10:58:47.678256+0000","last_fullsized":"2024-09-14T10:58:47.678256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.678157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:56.701033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.188047+0000","last_change":"2024-09-14T10:58:31.187976+0000","last_active":"2024-09-14T10:58:31.188047+0000","last_peered":"2024-09-14T10:58:31.188047+0000","last_clean":"2024-09-14T10:58:31.188047+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:31.188047+0000","last_undegraded":"2024-09-14T10:58:31.188047+0000","last_fullsized":"2024-09-14T10:58:31.188047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.187893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:06.988528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'5","reported_seq":233,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.025603+0000","last_change":"2024-09-14T10:59:01.025603+0000","last_active":"2024-09-14T10:59:01.025603+0000","last_peered":"2024-09-14T10:59:01.025603+0000","last_clean":"2024-09-14T10:59:01.025603+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:59:01.025603+0000","last_undegraded":"2024-09-14T10:59:01.025603+0000","last_fullsized":"2024-09-14T10:59:01.025603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.025515+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:21.372068+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:29.413544+0000","last_change":"2024-09-14T10:59:29.413544+0000","last_active":"2024-09-14T10:59:29.413544+0000","last_peered":"2024-09-14T10:59:29.413544+0000","last_clean":"2024-09-14T10:59:29.413544+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:59:29.413544+0000","last_undegraded":"2024-09-14T10:59:29.413544+0000","last_fullsized":"2024-09-14T10:59:29.413544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:29.413425+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:29.413425+0000","last_clean_scrub_stamp":"2024-09-14T10:59:29.413425+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:27.581992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.531591+0000","last_change":"2024-09-14T10:59:19.531591+0000","last_active":"2024-09-14T10:59:19.531591+0000","last_peered":"2024-09-14T10:59:19.531591+0000","last_clean":"2024-09-14T10:59:19.531591+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:59:19.531591+0000","last_undegraded":"2024-09-14T10:59:19.531591+0000","last_fullsized":"2024-09-14T10:59:19.531591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.531495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.999761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:57:11.179789+0000","last_change":"2024-09-14T10:55:14.731814+0000","last_active":"2024-09-14T10:57:11.179789+0000","last_peered":"2024-09-14T10:57:11.179789+0000","last_clean":"2024-09-14T10:57:11.179789+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:57:11.179789+0000","last_undegraded":"2024-09-14T10:57:11.179789+0000","last_fullsized":"2024-09-14T10:57:11.179789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:13.700573+0000","last_clean_scrub_stamp":"2024-09-14T10:55:13.700573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:54.035603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.049340+0000","last_change":"2024-09-14T10:58:44.049274+0000","last_active":"2024-09-14T10:58:44.049340+0000","last_peered":"2024-09-14T10:58:44.049340+0000","last_clean":"2024-09-14T10:58:44.049340+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:44.049340+0000","last_undegraded":"2024-09-14T10:58:44.049340+0000","last_fullsized":"2024-09-14T10:58:44.049340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.049194+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:59.063252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.769190+0000","last_change":"2024-09-14T10:58:32.769098+0000","last_active":"2024-09-14T10:58:32.769190+0000","last_peered":"2024-09-14T10:58:32.769190+0000","last_clean":"2024-09-14T10:58:32.769190+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:58:32.769190+0000","last_undegraded":"2024-09-14T10:58:32.769190+0000","last_fullsized":"2024-09-14T10:58:32.769190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.768987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:20.659652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.498532+0000","last_change":"2024-09-14T10:58:48.498479+0000","last_active":"2024-09-14T10:58:48.498532+0000","last_peered":"2024-09-14T10:58:48.498532+0000","last_clean":"2024-09-14T10:58:48.498532+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:48.498532+0000","last_undegraded":"2024-09-14T10:58:48.498532+0000","last_fullsized":"2024-09-14T10:58:48.498532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.498391+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.696592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.646736+0000","last_change":"2024-09-14T10:58:30.646671+0000","last_active":"2024-09-14T10:58:30.646736+0000","last_peered":"2024-09-14T10:58:30.646736+0000","last_clean":"2024-09-14T10:58:30.646736+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:58:30.646736+0000","last_undegraded":"2024-09-14T10:58:30.646736+0000","last_fullsized":"2024-09-14T10:58:30.646736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.646582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:28.625565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.230732+0000","last_change":"2024-09-14T10:59:07.230667+0000","last_active":"2024-09-14T10:59:07.230732+0000","last_peered":"2024-09-14T10:59:07.230732+0000","last_clean":"2024-09-14T10:59:07.230732+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:59:07.230732+0000","last_undegraded":"2024-09-14T10:59:07.230732+0000","last_fullsized":"2024-09-14T10:59:07.230732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.230577+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.596269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.225399+0000","last_change":"2024-09-14T10:58:42.225339+0000","last_active":"2024-09-14T10:58:42.225399+0000","last_peered":"2024-09-14T10:58:42.225399+0000","last_clean":"2024-09-14T10:58:42.225399+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:58:42.225399+0000","last_undegraded":"2024-09-14T10:58:42.225399+0000","last_fullsized":"2024-09-14T10:58:42.225399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.225249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:35.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.540201+0000","last_change":"2024-09-14T10:58:47.540121+0000","last_active":"2024-09-14T10:58:47.540201+0000","last_peered":"2024-09-14T10:58:47.540201+0000","last_clean":"2024-09-14T10:58:47.540201+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:47.540201+0000","last_undegraded":"2024-09-14T10:58:47.540201+0000","last_fullsized":"2024-09-14T10:58:47.540201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.540036+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:13.554682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.620604+0000","last_change":"2024-09-14T10:58:31.620545+0000","last_active":"2024-09-14T10:58:31.620604+0000","last_peered":"2024-09-14T10:58:31.620604+0000","last_clean":"2024-09-14T10:58:31.620604+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:31.620604+0000","last_undegraded":"2024-09-14T10:58:31.620604+0000","last_fullsized":"2024-09-14T10:58:31.620604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.620459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.184499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.510605+0000","last_change":"2024-09-14T10:58:45.510519+0000","last_active":"2024-09-14T10:58:45.510605+0000","last_peered":"2024-09-14T10:58:45.510605+0000","last_clean":"2024-09-14T10:58:45.510605+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:58:45.510605+0000","last_undegraded":"2024-09-14T10:58:45.510605+0000","last_fullsized":"2024-09-14T10:58:45.510605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.510404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:33.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.632421+0000","last_change":"2024-09-14T10:58:32.632337+0000","last_active":"2024-09-14T10:58:32.632421+0000","last_peered":"2024-09-14T10:58:32.632421+0000","last_clean":"2024-09-14T10:58:32.632421+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:58:32.632421+0000","last_undegraded":"2024-09-14T10:58:32.632421+0000","last_fullsized":"2024-09-14T10:58:32.632421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.632202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:15.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.056890+0000","last_change":"2024-09-14T10:58:46.056837+0000","last_active":"2024-09-14T10:58:46.056890+0000","last_peered":"2024-09-14T10:58:46.056890+0000","last_clean":"2024-09-14T10:58:46.056890+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:58:46.056890+0000","last_undegraded":"2024-09-14T10:58:46.056890+0000","last_fullsized":"2024-09-14T10:58:46.056890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.056739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:40.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.181570+0000","last_change":"2024-09-14T10:58:33.181486+0000","last_active":"2024-09-14T10:58:33.181570+0000","last_peered":"2024-09-14T10:58:33.181570+0000","last_clean":"2024-09-14T10:58:33.181570+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:58:33.181570+0000","last_undegraded":"2024-09-14T10:58:33.181570+0000","last_fullsized":"2024-09-14T10:58:33.181570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.181378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:00.642621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.491356+0000","last_change":"2024-09-14T10:58:46.491300+0000","last_active":"2024-09-14T10:58:46.491356+0000","last_peered":"2024-09-14T10:58:46.491356+0000","last_clean":"2024-09-14T10:58:46.491356+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:46.491356+0000","last_undegraded":"2024-09-14T10:58:46.491356+0000","last_fullsized":"2024-09-14T10:58:46.491356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.491200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:00.231388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.729549+0000","last_change":"2024-09-14T10:58:31.729483+0000","last_active":"2024-09-14T10:58:31.729549+0000","last_peered":"2024-09-14T10:58:31.729549+0000","last_clean":"2024-09-14T10:58:31.729549+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:58:31.729549+0000","last_undegraded":"2024-09-14T10:58:31.729549+0000","last_fullsized":"2024-09-14T10:58:31.729549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.729382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:17.181102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.085731+0000","last_change":"2024-09-14T10:58:45.085631+0000","last_active":"2024-09-14T10:58:45.085731+0000","last_peered":"2024-09-14T10:58:45.085731+0000","last_clean":"2024-09-14T10:58:45.085731+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:58:45.085731+0000","last_undegraded":"2024-09-14T10:58:45.085731+0000","last_fullsized":"2024-09-14T10:58:45.085731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.085504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:36.257221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.607296+0000","last_change":"2024-09-14T10:58:33.607227+0000","last_active":"2024-09-14T10:58:33.607296+0000","last_peered":"2024-09-14T10:58:33.607296+0000","last_clean":"2024-09-14T10:58:33.607296+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:58:33.607296+0000","last_undegraded":"2024-09-14T10:58:33.607296+0000","last_fullsized":"2024-09-14T10:58:33.607296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.607100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:52.664954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.160075+0000","last_change":"2024-09-14T10:58:51.160075+0000","last_active":"2024-09-14T10:58:51.160075+0000","last_peered":"2024-09-14T10:58:51.160075+0000","last_clean":"2024-09-14T10:58:51.160075+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:51.160075+0000","last_undegraded":"2024-09-14T10:58:51.160075+0000","last_fullsized":"2024-09-14T10:58:51.160075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.159979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:22.667198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.212771+0000","last_change":"2024-09-14T10:58:48.212687+0000","last_active":"2024-09-14T10:58:48.212771+0000","last_peered":"2024-09-14T10:58:48.212771+0000","last_clean":"2024-09-14T10:58:48.212771+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:58:48.212771+0000","last_undegraded":"2024-09-14T10:58:48.212771+0000","last_fullsized":"2024-09-14T10:58:48.212771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.212580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:27.361696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.257000+0000","last_change":"2024-09-14T10:59:06.257000+0000","last_active":"2024-09-14T10:59:06.257000+0000","last_peered":"2024-09-14T10:59:06.257000+0000","last_clean":"2024-09-14T10:59:06.257000+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:59:06.257000+0000","last_undegraded":"2024-09-14T10:59:06.257000+0000","last_fullsized":"2024-09-14T10:59:06.257000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.256919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:16.287230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.649980+0000","last_change":"2024-09-14T10:58:34.649901+0000","last_active":"2024-09-14T10:58:34.649980+0000","last_peered":"2024-09-14T10:58:34.649980+0000","last_clean":"2024-09-14T10:58:34.649980+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:34.649980+0000","last_undegraded":"2024-09-14T10:58:34.649980+0000","last_fullsized":"2024-09-14T10:58:34.649980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.649810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:05.982892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.483165+0000","last_change":"2024-09-14T10:58:49.483078+0000","last_active":"2024-09-14T10:58:49.483165+0000","last_peered":"2024-09-14T10:58:49.483165+0000","last_clean":"2024-09-14T10:58:49.483165+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:58:49.483165+0000","last_undegraded":"2024-09-14T10:58:49.483165+0000","last_fullsized":"2024-09-14T10:58:49.483165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.482969+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.100489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.215944+0000","last_change":"2024-09-14T10:58:32.215888+0000","last_active":"2024-09-14T10:58:32.215944+0000","last_peered":"2024-09-14T10:58:32.215944+0000","last_clean":"2024-09-14T10:58:32.215944+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:58:32.215944+0000","last_undegraded":"2024-09-14T10:58:32.215944+0000","last_fullsized":"2024-09-14T10:58:32.215944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.215791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.184095+0000","last_change":"2024-09-14T10:58:50.184022+0000","last_active":"2024-09-14T10:58:50.184095+0000","last_peered":"2024-09-14T10:58:50.184095+0000","last_clean":"2024-09-14T10:58:50.184095+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:58:50.184095+0000","last_undegraded":"2024-09-14T10:58:50.184095+0000","last_fullsized":"2024-09-14T10:58:50.184095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.183944+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:41.356134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.123508+0000","last_change":"2024-09-14T10:58:35.123439+0000","last_active":"2024-09-14T10:58:35.123508+0000","last_peered":"2024-09-14T10:58:35.123508+0000","last_clean":"2024-09-14T10:58:35.123508+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:58:35.123508+0000","last_undegraded":"2024-09-14T10:58:35.123508+0000","last_fullsized":"2024-09-14T10:58:35.123508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.123338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:26.005173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.179871+0000","last_change":"2024-09-14T10:58:49.179766+0000","last_active":"2024-09-14T10:58:49.179871+0000","last_peered":"2024-09-14T10:58:49.179871+0000","last_clean":"2024-09-14T10:58:49.179871+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:49.179871+0000","last_undegraded":"2024-09-14T10:58:49.179871+0000","last_fullsized":"2024-09-14T10:58:49.179871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.179681+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.816048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.266058+0000","last_change":"2024-09-14T10:58:45.266002+0000","last_active":"2024-09-14T10:58:45.266058+0000","last_peered":"2024-09-14T10:58:45.266058+0000","last_clean":"2024-09-14T10:58:45.266058+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:58:45.266058+0000","last_undegraded":"2024-09-14T10:58:45.266058+0000","last_fullsized":"2024-09-14T10:58:45.266058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.265914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.079568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.131630+0000","last_change":"2024-09-14T10:58:48.131536+0000","last_active":"2024-09-14T10:58:48.131630+0000","last_peered":"2024-09-14T10:58:48.131630+0000","last_clean":"2024-09-14T10:58:48.131630+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:48.131630+0000","last_undegraded":"2024-09-14T10:58:48.131630+0000","last_fullsized":"2024-09-14T10:58:48.131630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.131427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:07.192316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.286607+0000","last_change":"2024-09-14T10:58:44.286543+0000","last_active":"2024-09-14T10:58:44.286607+0000","last_peered":"2024-09-14T10:58:44.286607+0000","last_clean":"2024-09-14T10:58:44.286607+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:58:44.286607+0000","last_undegraded":"2024-09-14T10:58:44.286607+0000","last_fullsized":"2024-09-14T10:58:44.286607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.286454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.534792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.301595+0000","last_change":"2024-09-14T10:59:05.301521+0000","last_active":"2024-09-14T10:59:05.301595+0000","last_peered":"2024-09-14T10:59:05.301595+0000","last_clean":"2024-09-14T10:59:05.301595+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:59:05.301595+0000","last_undegraded":"2024-09-14T10:59:05.301595+0000","last_fullsized":"2024-09-14T10:59:05.301595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.301439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:07.827525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.750129+0000","last_change":"2024-09-14T10:58:33.750129+0000","last_active":"2024-09-14T10:58:33.750129+0000","last_peered":"2024-09-14T10:58:33.750129+0000","last_clean":"2024-09-14T10:58:33.750129+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:33.750129+0000","last_undegraded":"2024-09-14T10:58:33.750129+0000","last_fullsized":"2024-09-14T10:58:33.750129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.750046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:41.673497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.083573+0000","last_change":"2024-09-14T10:58:47.083486+0000","last_active":"2024-09-14T10:58:47.083573+0000","last_peered":"2024-09-14T10:58:47.083573+0000","last_clean":"2024-09-14T10:58:47.083573+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:47.083573+0000","last_undegraded":"2024-09-14T10:58:47.083573+0000","last_fullsized":"2024-09-14T10:58:47.083573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.083386+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:48.862348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.225553+0000","last_change":"2024-09-14T10:58:46.225553+0000","last_active":"2024-09-14T10:58:46.225553+0000","last_peered":"2024-09-14T10:58:46.225553+0000","last_clean":"2024-09-14T10:58:46.225553+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:58:46.225553+0000","last_undegraded":"2024-09-14T10:58:46.225553+0000","last_fullsized":"2024-09-14T10:58:46.225553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.225471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.589934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.182383+0000","last_change":"2024-09-14T10:58:47.182383+0000","last_active":"2024-09-14T10:58:47.182383+0000","last_peered":"2024-09-14T10:58:47.182383+0000","last_clean":"2024-09-14T10:58:47.182383+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:58:47.182383+0000","last_undegraded":"2024-09-14T10:58:47.182383+0000","last_fullsized":"2024-09-14T10:58:47.182383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.182295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.861086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.410163+0000","last_change":"2024-09-14T10:58:51.410163+0000","last_active":"2024-09-14T10:58:51.410163+0000","last_peered":"2024-09-14T10:58:51.410163+0000","last_clean":"2024-09-14T10:58:51.410163+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:51.410163+0000","last_undegraded":"2024-09-14T10:58:51.410163+0000","last_fullsized":"2024-09-14T10:58:51.410163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.410073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:45.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.601919+0000","last_change":"2024-09-14T10:58:35.601919+0000","last_active":"2024-09-14T10:58:35.601919+0000","last_peered":"2024-09-14T10:58:35.601919+0000","last_clean":"2024-09-14T10:58:35.601919+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:35.601919+0000","last_undegraded":"2024-09-14T10:58:35.601919+0000","last_fullsized":"2024-09-14T10:58:35.601919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.601827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:44.673365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.139091+0000","last_change":"2024-09-14T10:58:57.139091+0000","last_active":"2024-09-14T10:58:57.139091+0000","last_peered":"2024-09-14T10:58:57.139091+0000","last_clean":"2024-09-14T10:58:57.139091+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:57.139091+0000","last_undegraded":"2024-09-14T10:58:57.139091+0000","last_fullsized":"2024-09-14T10:58:57.139091+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.139001+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.477286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640318,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640319,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:59:45.845 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.845 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.846 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.846 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.846 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.846 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.847 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.847 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:55:13.700573+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=58, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T10:59:45.847 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:00:05.849 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:00:05.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8c616640 1 Processor -- start 2024-09-14T11:00:05.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8c616640 1 -- start start 2024-09-14T11:00:05.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8c616640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5a8412cba0 0x7f5a841315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8c616640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8409a290 con 0x7f5a8412c0b0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8c616640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7f5a84071860 con 0x7f5a8412cba0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8a3b2640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f5a8412c0b0 0x7f5a8412c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59726/0 (socket says 172.21.15.116:59726) 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.963+0000 7f5a8a3b2640 1 -- 172.21.15.116:0/222009117 learned_addr learned my addr 172.21.15.116:0/222009117 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.964+0000 7f5a89bb1640 1 --2- 172.21.15.116:0/222009117 >> v2:172.21.15.116:3300/0 conn(0x7f5a8412cba0 0x7f5a841315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.964+0000 7f5a893b0640 1 -- 172.21.15.116:0/222009117 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750094974 0 0) 0x7f5a8409a290 con 0x7f5a8412c0b0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.964+0000 7f5a893b0640 1 -- 172.21.15.116:0/222009117 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a70003520 con 0x7f5a8412c0b0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.964+0000 7f5a89bb1640 1 -- 172.21.15.116:0/222009117 >> v1:172.21.15.116:6789/0 conn(0x7f5a8412c0b0 legacy=0x7f5a8412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.964+0000 7f5a89bb1640 1 -- 172.21.15.116:0/222009117 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a84099e20 con 0x7f5a8412cba0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a89bb1640 1 --2- 172.21.15.116:0/222009117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412cba0 0x7f5a841315e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009750 tx=0x7f5a7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626003b911aa6ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a893b0640 1 -- 172.21.15.116:0/222009117 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74037070 con 0x7f5a8412cba0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a893b0640 1 -- 172.21.15.116:0/222009117 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7402ad80 con 0x7f5a8412cba0 2024-09-14T11:00:05.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a893b0640 1 -- 172.21.15.116:0/222009117 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74032590 con 0x7f5a8412cba0 2024-09-14T11:00:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 -- 172.21.15.116:0/222009117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412cba0 msgr2=0x7f5a841315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 --2- 172.21.15.116:0/222009117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412cba0 0x7f5a841315e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009750 tx=0x7f5a7402a140 comp rx=0 tx=0).stop 2024-09-14T11:00:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 -- 172.21.15.116:0/222009117 shutdown_connections 2024-09-14T11:00:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 --2- 172.21.15.116:0/222009117 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412cba0 0x7f5a841315e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:05.966 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 -- 172.21.15.116:0/222009117 >> 172.21.15.116:0/222009117 conn(0x7f5a8409abc0 msgr2=0x7f5a84098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 -- 172.21.15.116:0/222009117 shutdown_connections 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.965+0000 7f5a8c616640 1 -- 172.21.15.116:0/222009117 wait complete. 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.966+0000 7f5a8c616640 1 Processor -- start 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.966+0000 7f5a8c616640 1 -- start start 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8c616640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8c616640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7f5a84070c40 con 0x7f5a8412c0b0 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8a3b2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8a3b2640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40384/0 (socket says 172.21.15.116:40384) 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8a3b2640 1 -- 172.21.15.116:0/3967235306 learned_addr learned my addr 172.21.15.116:0/3967235306 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8a3b2640 1 -- 172.21.15.116:0/3967235306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8408c840 con 0x7f5a8412c0b0 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8a3b2640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c480 tx=0x7f5a8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:05.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a80017070 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a80005cd0 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a84129620 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a80007200 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.967+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8408cb00 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.968+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7f5a8001a070 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.968+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8412c490 con 0x7f5a8412c0b0 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.968+0000 7f5a7affd640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 0x7f5a68040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:05.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.968+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7f5a800529e0 con 0x7f5a8412c0b0 2024-09-14T11:00:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.969+0000 7f5a89bb1640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 0x7f5a68040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:05.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.969+0000 7f5a89bb1640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 0x7f5a68040a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a7402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:05.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:05.973+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7f5a8408c840 con 0x7f5a8412c0b0 2024-09-14T11:00:06.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.143+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 --> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a84096fb0 con 0x7f5a6803e570 2024-09-14T11:00:06.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.153+0000 7f5a7affd640 1 -- 172.21.15.116:0/3967235306 <== mgr.4102 v2:172.21.15.164:6824/1645614220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666155 (secure 0 0 0) 0x7f5a84096fb0 con 0x7f5a6803e570 2024-09-14T11:00:06.159 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-09-14T11:00:06.164 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 msgr2=0x7f5a68040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 0x7f5a68040a30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5a74034000 tx=0x7f5a7402e000 comp rx=0 tx=0).stop 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 msgr2=0x7f5a841c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5a8000c480 tx=0x7f5a8000c940 comp rx=0 tx=0).stop 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 shutdown_connections 2024-09-14T11:00:06.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7f5a6803e570 0x7f5a68040a30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 --2- 172.21.15.116:0/3967235306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5a8412c0b0 0x7f5a841c3e80 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 >> 172.21.15.116:0/3967235306 conn(0x7f5a8409abc0 msgr2=0x7f5a8406dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T11:00:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 shutdown_connections 2024-09-14T11:00:06.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.158+0000 7f5a8c616640 1 -- 172.21.15.116:0/3967235306 wait complete. 2024-09-14T11:00:06.168 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-14T11:00:04.154425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5147,"num_read_kb":4689,"num_write":2121,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156864,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330496,"statfs":{"total":386547056640,"available":386386427904,"internally_reserved":0,"allocated":3080192,"data_stored":1819780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004216"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.768980+0000","last_change":"2024-09-14T10:58:37.768923+0000","last_active":"2024-09-14T10:58:37.768980+0000","last_peered":"2024-09-14T10:58:37.768980+0000","last_clean":"2024-09-14T10:58:37.768980+0000","last_became_active":"2024-09-14T10:55:04.693660+0000","last_became_peered":"2024-09-14T10:55:04.693660+0000","last_unstale":"2024-09-14T10:58:37.768980+0000","last_undegraded":"2024-09-14T10:58:37.768980+0000","last_fullsized":"2024-09-14T10:58:37.768980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.768838+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.768838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:59.090598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.199300+0000","last_change":"2024-09-14T10:58:55.199300+0000","last_active":"2024-09-14T10:58:55.199300+0000","last_peered":"2024-09-14T10:58:55.199300+0000","last_clean":"2024-09-14T10:58:55.199300+0000","last_became_active":"2024-09-14T10:55:06.700056+0000","last_became_peered":"2024-09-14T10:55:06.700056+0000","last_unstale":"2024-09-14T10:58:55.199300+0000","last_undegraded":"2024-09-14T10:58:55.199300+0000","last_fullsized":"2024-09-14T10:58:55.199300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:55.199194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.199194+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.968338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.549583+0000","last_change":"2024-09-14T10:58:38.549485+0000","last_active":"2024-09-14T10:58:38.549583+0000","last_peered":"2024-09-14T10:58:38.549583+0000","last_clean":"2024-09-14T10:58:38.549583+0000","last_became_active":"2024-09-14T10:55:04.692725+0000","last_became_peered":"2024-09-14T10:55:04.692725+0000","last_unstale":"2024-09-14T10:58:38.549583+0000","last_undegraded":"2024-09-14T10:58:38.549583+0000","last_fullsized":"2024-09-14T10:58:38.549583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.549386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.549386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:46.035874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'4","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.450785+0000","last_change":"2024-09-14T10:58:52.450785+0000","last_active":"2024-09-14T10:58:52.450785+0000","last_peered":"2024-09-14T10:58:52.450785+0000","last_clean":"2024-09-14T10:58:52.450785+0000","last_became_active":"2024-09-14T10:55:41.751729+0000","last_became_peered":"2024-09-14T10:55:41.751729+0000","last_unstale":"2024-09-14T10:58:52.450785+0000","last_undegraded":"2024-09-14T10:58:52.450785+0000","last_fullsized":"2024-09-14T10:58:52.450785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.450685+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.450685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:49.376289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.232878+0000","last_change":"2024-09-14T10:58:52.232804+0000","last_active":"2024-09-14T10:58:52.232878+0000","last_peered":"2024-09-14T10:58:52.232878+0000","last_clean":"2024-09-14T10:58:52.232878+0000","last_became_active":"2024-09-14T10:55:04.709580+0000","last_became_peered":"2024-09-14T10:55:04.709580+0000","last_unstale":"2024-09-14T10:58:52.232878+0000","last_undegraded":"2024-09-14T10:58:52.232878+0000","last_fullsized":"2024-09-14T10:58:52.232878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:52.232718+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.232718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:22.618318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.211047+0000","last_change":"2024-09-14T10:59:08.211047+0000","last_active":"2024-09-14T10:59:08.211047+0000","last_peered":"2024-09-14T10:59:08.211047+0000","last_clean":"2024-09-14T10:59:08.211047+0000","last_became_active":"2024-09-14T10:55:06.701585+0000","last_became_peered":"2024-09-14T10:55:06.701585+0000","last_unstale":"2024-09-14T10:59:08.211047+0000","last_undegraded":"2024-09-14T10:59:08.211047+0000","last_fullsized":"2024-09-14T10:59:08.211047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.210952+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.210952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:36.569390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.746604+0000","last_change":"2024-09-14T10:58:36.746554+0000","last_active":"2024-09-14T10:58:36.746604+0000","last_peered":"2024-09-14T10:58:36.746604+0000","last_clean":"2024-09-14T10:58:36.746604+0000","last_became_active":"2024-09-14T10:55:04.691607+0000","last_became_peered":"2024-09-14T10:55:04.691607+0000","last_unstale":"2024-09-14T10:58:36.746604+0000","last_undegraded":"2024-09-14T10:58:36.746604+0000","last_fullsized":"2024-09-14T10:58:36.746604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.746473+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.746473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:56.987213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'4","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.647611+0000","last_change":"2024-09-14T10:58:46.647611+0000","last_active":"2024-09-14T10:58:46.647611+0000","last_peered":"2024-09-14T10:58:46.647611+0000","last_clean":"2024-09-14T10:58:46.647611+0000","last_became_active":"2024-09-14T10:55:41.752280+0000","last_became_peered":"2024-09-14T10:55:41.752280+0000","last_unstale":"2024-09-14T10:58:46.647611+0000","last_undegraded":"2024-09-14T10:58:46.647611+0000","last_fullsized":"2024-09-14T10:58:46.647611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:46.647534+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.647534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.998212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.210331+0000","last_change":"2024-09-14T10:58:51.210331+0000","last_active":"2024-09-14T10:58:51.210331+0000","last_peered":"2024-09-14T10:58:51.210331+0000","last_clean":"2024-09-14T10:58:51.210331+0000","last_became_active":"2024-09-14T10:55:04.693586+0000","last_became_peered":"2024-09-14T10:55:04.693586+0000","last_unstale":"2024-09-14T10:58:51.210331+0000","last_undegraded":"2024-09-14T10:58:51.210331+0000","last_fullsized":"2024-09-14T10:58:51.210331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.210239+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.210239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:23.207843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.157380+0000","last_change":"2024-09-14T10:58:56.157322+0000","last_active":"2024-09-14T10:58:56.157380+0000","last_peered":"2024-09-14T10:58:56.157380+0000","last_clean":"2024-09-14T10:58:56.157380+0000","last_became_active":"2024-09-14T10:55:06.693752+0000","last_became_peered":"2024-09-14T10:55:06.693752+0000","last_unstale":"2024-09-14T10:58:56.157380+0000","last_undegraded":"2024-09-14T10:58:56.157380+0000","last_fullsized":"2024-09-14T10:58:56.157380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:56.157235+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.157235+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:11.790691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.781933+0000","last_change":"2024-09-14T10:58:35.781933+0000","last_active":"2024-09-14T10:58:35.781933+0000","last_peered":"2024-09-14T10:58:35.781933+0000","last_clean":"2024-09-14T10:58:35.781933+0000","last_became_active":"2024-09-14T10:55:04.691185+0000","last_became_peered":"2024-09-14T10:55:04.691185+0000","last_unstale":"2024-09-14T10:58:35.781933+0000","last_undegraded":"2024-09-14T10:58:35.781933+0000","last_fullsized":"2024-09-14T10:58:35.781933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.781832+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.781832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.948433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.236407+0000","last_change":"2024-09-14T10:59:09.236343+0000","last_active":"2024-09-14T10:59:09.236407+0000","last_peered":"2024-09-14T10:59:09.236407+0000","last_clean":"2024-09-14T10:59:09.236407+0000","last_became_active":"2024-09-14T10:55:06.699694+0000","last_became_peered":"2024-09-14T10:55:06.699694+0000","last_unstale":"2024-09-14T10:59:09.236407+0000","last_undegraded":"2024-09-14T10:59:09.236407+0000","last_fullsized":"2024-09-14T10:59:09.236407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:09.236262+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.236262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:20.332076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.229232+0000","last_change":"2024-09-14T10:58:50.229232+0000","last_active":"2024-09-14T10:58:50.229232+0000","last_peered":"2024-09-14T10:58:50.229232+0000","last_clean":"2024-09-14T10:58:50.229232+0000","last_became_active":"2024-09-14T10:55:04.699379+0000","last_became_peered":"2024-09-14T10:55:04.699379+0000","last_unstale":"2024-09-14T10:58:50.229232+0000","last_undegraded":"2024-09-14T10:58:50.229232+0000","last_fullsized":"2024-09-14T10:58:50.229232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:50.229092+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.229092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:49.980838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.696564+0000","last_change":"2024-09-14T10:58:49.696483+0000","last_active":"2024-09-14T10:58:49.696564+0000","last_peered":"2024-09-14T10:58:49.696564+0000","last_clean":"2024-09-14T10:58:49.696564+0000","last_became_active":"2024-09-14T10:55:06.697958+0000","last_became_peered":"2024-09-14T10:55:06.697958+0000","last_unstale":"2024-09-14T10:58:49.696564+0000","last_undegraded":"2024-09-14T10:58:49.696564+0000","last_fullsized":"2024-09-14T10:58:49.696564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:49.696365+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.696365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:27.219012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.557545+0000","last_change":"2024-09-14T10:58:36.557545+0000","last_active":"2024-09-14T10:58:36.557545+0000","last_peered":"2024-09-14T10:58:36.557545+0000","last_clean":"2024-09-14T10:58:36.557545+0000","last_became_active":"2024-09-14T10:55:04.692125+0000","last_became_peered":"2024-09-14T10:55:04.692125+0000","last_unstale":"2024-09-14T10:58:36.557545+0000","last_undegraded":"2024-09-14T10:58:36.557545+0000","last_fullsized":"2024-09-14T10:58:36.557545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.557460+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.557460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:19.674856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.655955+0000","last_change":"2024-09-14T10:58:48.655853+0000","last_active":"2024-09-14T10:58:48.655955+0000","last_peered":"2024-09-14T10:58:48.655955+0000","last_clean":"2024-09-14T10:58:48.655955+0000","last_became_active":"2024-09-14T10:55:06.694947+0000","last_became_peered":"2024-09-14T10:55:06.694947+0000","last_unstale":"2024-09-14T10:58:48.655955+0000","last_undegraded":"2024-09-14T10:58:48.655955+0000","last_fullsized":"2024-09-14T10:58:48.655955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:48.655753+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.655753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:09.845230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.204192+0000","last_change":"2024-09-14T10:59:10.204128+0000","last_active":"2024-09-14T10:59:10.204192+0000","last_peered":"2024-09-14T10:59:10.204192+0000","last_clean":"2024-09-14T10:59:10.204192+0000","last_became_active":"2024-09-14T10:55:06.703476+0000","last_became_peered":"2024-09-14T10:55:06.703476+0000","last_unstale":"2024-09-14T10:59:10.204192+0000","last_undegraded":"2024-09-14T10:59:10.204192+0000","last_fullsized":"2024-09-14T10:59:10.204192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:10.204034+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.204034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.143862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.116530+0000","last_change":"2024-09-14T10:58:41.116444+0000","last_active":"2024-09-14T10:58:41.116530+0000","last_peered":"2024-09-14T10:58:41.116530+0000","last_clean":"2024-09-14T10:58:41.116530+0000","last_became_active":"2024-09-14T10:55:04.710018+0000","last_became_peered":"2024-09-14T10:55:04.710018+0000","last_unstale":"2024-09-14T10:58:41.116530+0000","last_undegraded":"2024-09-14T10:58:41.116530+0000","last_fullsized":"2024-09-14T10:58:41.116530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:41.116320+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.116320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:29.336574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":7,"num_write":24,"num_write_kb":4723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.131096+0000","last_change":"2024-09-14T10:58:52.131032+0000","last_active":"2024-09-14T10:58:52.131096+0000","last_peered":"2024-09-14T10:58:52.131096+0000","last_clean":"2024-09-14T10:58:52.131096+0000","last_became_active":"2024-09-14T10:55:06.699150+0000","last_became_peered":"2024-09-14T10:55:06.699150+0000","last_unstale":"2024-09-14T10:58:52.131096+0000","last_undegraded":"2024-09-14T10:58:52.131096+0000","last_fullsized":"2024-09-14T10:58:52.131096+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:52.130944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.130944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:47.420179+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.762346+0000","last_change":"2024-09-14T10:58:34.762283+0000","last_active":"2024-09-14T10:58:34.762346+0000","last_peered":"2024-09-14T10:58:34.762346+0000","last_clean":"2024-09-14T10:58:34.762346+0000","last_became_active":"2024-09-14T10:55:04.698103+0000","last_became_peered":"2024-09-14T10:55:04.698103+0000","last_unstale":"2024-09-14T10:58:34.762346+0000","last_undegraded":"2024-09-14T10:58:34.762346+0000","last_fullsized":"2024-09-14T10:58:34.762346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.762201+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.762201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:32.819316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"37'8","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.205424+0000","last_change":"2024-09-14T10:58:54.205330+0000","last_active":"2024-09-14T10:58:54.205424+0000","last_peered":"2024-09-14T10:58:54.205424+0000","last_clean":"2024-09-14T10:58:54.205424+0000","last_became_active":"2024-09-14T10:55:06.699162+0000","last_became_peered":"2024-09-14T10:55:06.699162+0000","last_unstale":"2024-09-14T10:58:54.205424+0000","last_undegraded":"2024-09-14T10:58:54.205424+0000","last_fullsized":"2024-09-14T10:58:54.205424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:54.205219+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.205219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:44.812683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.125183+0000","last_change":"2024-09-14T10:58:36.125124+0000","last_active":"2024-09-14T10:58:36.125183+0000","last_peered":"2024-09-14T10:58:36.125183+0000","last_clean":"2024-09-14T10:58:36.125183+0000","last_became_active":"2024-09-14T10:55:04.710178+0000","last_became_peered":"2024-09-14T10:55:04.710178+0000","last_unstale":"2024-09-14T10:58:36.125183+0000","last_undegraded":"2024-09-14T10:58:36.125183+0000","last_fullsized":"2024-09-14T10:58:36.125183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:36.125007+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.125007+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:39:02.613577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.433847+0000","last_change":"2024-09-14T10:58:50.433757+0000","last_active":"2024-09-14T10:58:50.433847+0000","last_peered":"2024-09-14T10:58:50.433847+0000","last_clean":"2024-09-14T10:58:50.433847+0000","last_became_active":"2024-09-14T10:55:06.703809+0000","last_became_peered":"2024-09-14T10:55:06.703809+0000","last_unstale":"2024-09-14T10:58:50.433847+0000","last_undegraded":"2024-09-14T10:58:50.433847+0000","last_fullsized":"2024-09-14T10:58:50.433847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:50.433642+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.433642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:12.306523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.151739+0000","last_change":"2024-09-14T10:58:34.151676+0000","last_active":"2024-09-14T10:58:34.151739+0000","last_peered":"2024-09-14T10:58:34.151739+0000","last_clean":"2024-09-14T10:58:34.151739+0000","last_became_active":"2024-09-14T10:55:04.696755+0000","last_became_peered":"2024-09-14T10:55:04.696755+0000","last_unstale":"2024-09-14T10:58:34.151739+0000","last_undegraded":"2024-09-14T10:58:34.151739+0000","last_fullsized":"2024-09-14T10:58:34.151739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.151591+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.151591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:51.433519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.688737+0000","last_change":"2024-09-14T10:58:45.688675+0000","last_active":"2024-09-14T10:58:45.688737+0000","last_peered":"2024-09-14T10:58:45.688737+0000","last_clean":"2024-09-14T10:58:45.688737+0000","last_became_active":"2024-09-14T10:55:06.694859+0000","last_became_peered":"2024-09-14T10:55:06.694859+0000","last_unstale":"2024-09-14T10:58:45.688737+0000","last_undegraded":"2024-09-14T10:58:45.688737+0000","last_fullsized":"2024-09-14T10:58:45.688737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.688582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.688582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:29.115809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.579975+0000","last_change":"2024-09-14T10:58:37.579906+0000","last_active":"2024-09-14T10:58:37.579975+0000","last_peered":"2024-09-14T10:58:37.579975+0000","last_clean":"2024-09-14T10:58:37.579975+0000","last_became_active":"2024-09-14T10:55:04.708287+0000","last_became_peered":"2024-09-14T10:55:04.708287+0000","last_unstale":"2024-09-14T10:58:37.579975+0000","last_undegraded":"2024-09-14T10:58:37.579975+0000","last_fullsized":"2024-09-14T10:58:37.579975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:37.579809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.579809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:06.182493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.168423+0000","last_change":"2024-09-14T10:58:53.168366+0000","last_active":"2024-09-14T10:58:53.168423+0000","last_peered":"2024-09-14T10:58:53.168423+0000","last_clean":"2024-09-14T10:58:53.168423+0000","last_became_active":"2024-09-14T10:55:06.696790+0000","last_became_peered":"2024-09-14T10:55:06.696790+0000","last_unstale":"2024-09-14T10:58:53.168423+0000","last_undegraded":"2024-09-14T10:58:53.168423+0000","last_fullsized":"2024-09-14T10:58:53.168423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:53.168255+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.168255+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:30.421815+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.259180+0000","last_change":"2024-09-14T10:58:49.259070+0000","last_active":"2024-09-14T10:58:49.259180+0000","last_peered":"2024-09-14T10:58:49.259180+0000","last_clean":"2024-09-14T10:58:49.259180+0000","last_became_active":"2024-09-14T10:55:04.700615+0000","last_became_peered":"2024-09-14T10:55:04.700615+0000","last_unstale":"2024-09-14T10:58:49.259180+0000","last_undegraded":"2024-09-14T10:58:49.259180+0000","last_fullsized":"2024-09-14T10:58:49.259180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.258968+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.258968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.093328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'38","reported_seq":114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.825610+0000","last_change":"2024-09-14T10:59:22.825610+0000","last_active":"2024-09-14T10:59:22.825610+0000","last_peered":"2024-09-14T10:59:22.825610+0000","last_clean":"2024-09-14T10:59:22.825610+0000","last_became_active":"2024-09-14T10:55:14.730010+0000","last_became_peered":"2024-09-14T10:55:14.730010+0000","last_unstale":"2024-09-14T10:59:22.825610+0000","last_undegraded":"2024-09-14T10:59:22.825610+0000","last_fullsized":"2024-09-14T10:59:22.825610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:22.825512+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:22.825512+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.825512+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:05.533943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.304638+0000","last_change":"2024-09-14T10:58:59.304557+0000","last_active":"2024-09-14T10:58:59.304638+0000","last_peered":"2024-09-14T10:58:59.304638+0000","last_clean":"2024-09-14T10:58:59.304638+0000","last_became_active":"2024-09-14T10:55:06.688959+0000","last_became_peered":"2024-09-14T10:55:06.688959+0000","last_unstale":"2024-09-14T10:58:59.304638+0000","last_undegraded":"2024-09-14T10:58:59.304638+0000","last_fullsized":"2024-09-14T10:58:59.304638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:59.304438+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.304438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:17.011910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.122536+0000","last_change":"2024-09-14T10:58:38.122467+0000","last_active":"2024-09-14T10:58:38.122536+0000","last_peered":"2024-09-14T10:58:38.122536+0000","last_clean":"2024-09-14T10:58:38.122536+0000","last_became_active":"2024-09-14T10:55:04.705398+0000","last_became_peered":"2024-09-14T10:55:04.705398+0000","last_unstale":"2024-09-14T10:58:38.122536+0000","last_undegraded":"2024-09-14T10:58:38.122536+0000","last_fullsized":"2024-09-14T10:58:38.122536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:38.122377+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.122377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.370779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.287362+0000","last_change":"2024-09-14T10:59:18.287297+0000","last_active":"2024-09-14T10:59:18.287362+0000","last_peered":"2024-09-14T10:59:18.287362+0000","last_clean":"2024-09-14T10:59:18.287362+0000","last_became_active":"2024-09-14T10:55:08.703226+0000","last_became_peered":"2024-09-14T10:55:08.703226+0000","last_unstale":"2024-09-14T10:59:18.287362+0000","last_undegraded":"2024-09-14T10:59:18.287362+0000","last_fullsized":"2024-09-14T10:59:18.287362+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.287174+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.287174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.835680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:27.461211+0000","last_change":"2024-09-14T10:59:27.461151+0000","last_active":"2024-09-14T10:59:27.461211+0000","last_peered":"2024-09-14T10:59:27.461211+0000","last_clean":"2024-09-14T10:59:27.461211+0000","last_became_active":"2024-09-14T10:55:10.714069+0000","last_became_peered":"2024-09-14T10:55:10.714069+0000","last_unstale":"2024-09-14T10:59:27.461211+0000","last_undegraded":"2024-09-14T10:59:27.461211+0000","last_fullsized":"2024-09-14T10:59:27.461211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-14T10:59:27.461060+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-14T10:59:27.461060+0000","last_clean_scrub_stamp":"2024-09-14T10:59:27.461060+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:44.608102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.828536+0000","last_change":"2024-09-14T10:59:15.828449+0000","last_active":"2024-09-14T10:59:15.828536+0000","last_peered":"2024-09-14T10:59:15.828536+0000","last_clean":"2024-09-14T10:59:15.828536+0000","last_became_active":"2024-09-14T10:55:12.713328+0000","last_became_peered":"2024-09-14T10:55:12.713328+0000","last_unstale":"2024-09-14T10:59:15.828536+0000","last_undegraded":"2024-09-14T10:59:15.828536+0000","last_fullsized":"2024-09-14T10:59:15.828536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.828352+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.828352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:20.305608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.797875+0000","last_change":"2024-09-14T10:59:24.797875+0000","last_active":"2024-09-14T10:59:24.797875+0000","last_peered":"2024-09-14T10:59:24.797875+0000","last_clean":"2024-09-14T10:59:24.797875+0000","last_became_active":"2024-09-14T10:55:14.730934+0000","last_became_peered":"2024-09-14T10:55:14.730934+0000","last_unstale":"2024-09-14T10:59:24.797875+0000","last_undegraded":"2024-09-14T10:59:24.797875+0000","last_fullsized":"2024-09-14T10:59:24.797875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:24.797774+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:24.797774+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.797774+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:31.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'18","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.341922+0000","last_change":"2024-09-14T10:59:00.341862+0000","last_active":"2024-09-14T10:59:00.341922+0000","last_peered":"2024-09-14T10:59:00.341922+0000","last_clean":"2024-09-14T10:59:00.341922+0000","last_became_active":"2024-09-14T10:55:06.692144+0000","last_became_peered":"2024-09-14T10:55:06.692144+0000","last_unstale":"2024-09-14T10:59:00.341922+0000","last_undegraded":"2024-09-14T10:59:00.341922+0000","last_fullsized":"2024-09-14T10:59:00.341922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:00.341770+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.341770+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:16.361583+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.833191+0000","last_change":"2024-09-14T10:58:28.833117+0000","last_active":"2024-09-14T10:58:28.833191+0000","last_peered":"2024-09-14T10:58:28.833191+0000","last_clean":"2024-09-14T10:58:28.833191+0000","last_became_active":"2024-09-14T10:55:04.701976+0000","last_became_peered":"2024-09-14T10:55:04.701976+0000","last_unstale":"2024-09-14T10:58:28.833191+0000","last_undegraded":"2024-09-14T10:58:28.833191+0000","last_fullsized":"2024-09-14T10:58:28.833191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:28.833024+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.833024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:02.803836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.423587+0000","last_change":"2024-09-14T10:58:58.423501+0000","last_active":"2024-09-14T10:58:58.423587+0000","last_peered":"2024-09-14T10:58:58.423587+0000","last_clean":"2024-09-14T10:58:58.423587+0000","last_became_active":"2024-09-14T10:55:08.697644+0000","last_became_peered":"2024-09-14T10:55:08.697644+0000","last_unstale":"2024-09-14T10:58:58.423587+0000","last_undegraded":"2024-09-14T10:58:58.423587+0000","last_fullsized":"2024-09-14T10:58:58.423587+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.423413+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.423413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:14.071911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.904053+0000","last_change":"2024-09-14T10:59:11.903992+0000","last_active":"2024-09-14T10:59:11.904053+0000","last_peered":"2024-09-14T10:59:11.904053+0000","last_clean":"2024-09-14T10:59:11.904053+0000","last_became_active":"2024-09-14T10:55:10.708758+0000","last_became_peered":"2024-09-14T10:55:10.708758+0000","last_unstale":"2024-09-14T10:59:11.904053+0000","last_undegraded":"2024-09-14T10:59:11.904053+0000","last_fullsized":"2024-09-14T10:59:11.904053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-14T10:59:11.903906+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.903906+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:21.118231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.838159+0000","last_change":"2024-09-14T10:59:14.838078+0000","last_active":"2024-09-14T10:59:14.838159+0000","last_peered":"2024-09-14T10:59:14.838159+0000","last_clean":"2024-09-14T10:59:14.838159+0000","last_became_active":"2024-09-14T10:55:12.717721+0000","last_became_peered":"2024-09-14T10:55:12.717721+0000","last_unstale":"2024-09-14T10:59:14.838159+0000","last_undegraded":"2024-09-14T10:59:14.838159+0000","last_fullsized":"2024-09-14T10:59:14.838159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.837975+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.837975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:00.387583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.657708+0000","last_change":"2024-09-14T10:59:24.657708+0000","last_active":"2024-09-14T10:59:24.657708+0000","last_peered":"2024-09-14T10:59:24.657708+0000","last_clean":"2024-09-14T10:59:24.657708+0000","last_became_active":"2024-09-14T10:55:14.721917+0000","last_became_peered":"2024-09-14T10:55:14.721917+0000","last_unstale":"2024-09-14T10:59:24.657708+0000","last_undegraded":"2024-09-14T10:59:24.657708+0000","last_fullsized":"2024-09-14T10:59:24.657708+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:59:24.657621+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:59:24.657621+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.657621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:49.691139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.301434+0000","last_change":"2024-09-14T10:59:02.301344+0000","last_active":"2024-09-14T10:59:02.301434+0000","last_peered":"2024-09-14T10:59:02.301434+0000","last_clean":"2024-09-14T10:59:02.301434+0000","last_became_active":"2024-09-14T10:55:06.700678+0000","last_became_peered":"2024-09-14T10:55:06.700678+0000","last_unstale":"2024-09-14T10:59:02.301434+0000","last_undegraded":"2024-09-14T10:59:02.301434+0000","last_fullsized":"2024-09-14T10:59:02.301434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:02.301206+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.301206+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:42.934531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.134970+0000","last_change":"2024-09-14T10:58:37.134905+0000","last_active":"2024-09-14T10:58:37.134970+0000","last_peered":"2024-09-14T10:58:37.134970+0000","last_clean":"2024-09-14T10:58:37.134970+0000","last_became_active":"2024-09-14T10:55:04.705080+0000","last_became_peered":"2024-09-14T10:55:04.705080+0000","last_unstale":"2024-09-14T10:58:37.134970+0000","last_undegraded":"2024-09-14T10:58:37.134970+0000","last_fullsized":"2024-09-14T10:58:37.134970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:37.134801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.134801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:19.758122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.426381+0000","last_change":"2024-09-14T10:58:59.426312+0000","last_active":"2024-09-14T10:58:59.426381+0000","last_peered":"2024-09-14T10:58:59.426381+0000","last_clean":"2024-09-14T10:58:59.426381+0000","last_became_active":"2024-09-14T10:55:08.703027+0000","last_became_peered":"2024-09-14T10:55:08.703027+0000","last_unstale":"2024-09-14T10:58:59.426381+0000","last_undegraded":"2024-09-14T10:58:59.426381+0000","last_fullsized":"2024-09-14T10:58:59.426381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.426181+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.426181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:11.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.700418+0000","last_change":"2024-09-14T10:59:03.700362+0000","last_active":"2024-09-14T10:59:03.700418+0000","last_peered":"2024-09-14T10:59:03.700418+0000","last_clean":"2024-09-14T10:59:03.700418+0000","last_became_active":"2024-09-14T10:55:10.704532+0000","last_became_peered":"2024-09-14T10:55:10.704532+0000","last_unstale":"2024-09-14T10:59:03.700418+0000","last_undegraded":"2024-09-14T10:59:03.700418+0000","last_fullsized":"2024-09-14T10:59:03.700418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:59:03.700267+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.700267+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:35.207485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":417,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:37.486249+0000","last_change":"2024-09-14T10:59:37.486146+0000","last_active":"2024-09-14T10:59:37.486249+0000","last_peered":"2024-09-14T10:59:37.486249+0000","last_clean":"2024-09-14T10:59:37.486249+0000","last_became_active":"2024-09-14T10:55:12.723239+0000","last_became_peered":"2024-09-14T10:55:12.723239+0000","last_unstale":"2024-09-14T10:59:37.486249+0000","last_undegraded":"2024-09-14T10:59:37.486249+0000","last_fullsized":"2024-09-14T10:59:37.486249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:37.486016+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:37.486016+0000","last_clean_scrub_stamp":"2024-09-14T10:59:37.486016+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:42.702385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.846165+0000","last_change":"2024-09-14T10:59:15.846165+0000","last_active":"2024-09-14T10:59:15.846165+0000","last_peered":"2024-09-14T10:59:15.846165+0000","last_clean":"2024-09-14T10:59:15.846165+0000","last_became_active":"2024-09-14T10:55:14.723368+0000","last_became_peered":"2024-09-14T10:55:14.723368+0000","last_unstale":"2024-09-14T10:59:15.846165+0000","last_undegraded":"2024-09-14T10:59:15.846165+0000","last_fullsized":"2024-09-14T10:59:15.846165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:15.846039+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.846039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:36.510986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.509564+0000","last_change":"2024-09-14T10:58:42.509476+0000","last_active":"2024-09-14T10:58:42.509564+0000","last_peered":"2024-09-14T10:58:42.509564+0000","last_clean":"2024-09-14T10:58:42.509564+0000","last_became_active":"2024-09-14T10:55:06.697342+0000","last_became_peered":"2024-09-14T10:55:06.697342+0000","last_unstale":"2024-09-14T10:58:42.509564+0000","last_undegraded":"2024-09-14T10:58:42.509564+0000","last_fullsized":"2024-09-14T10:58:42.509564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:42.509389+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.509389+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:30.236260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.293909+0000","last_change":"2024-09-14T10:58:25.293841+0000","last_active":"2024-09-14T10:58:25.293909+0000","last_peered":"2024-09-14T10:58:25.293909+0000","last_clean":"2024-09-14T10:58:25.293909+0000","last_became_active":"2024-09-14T10:55:04.697583+0000","last_became_peered":"2024-09-14T10:55:04.697583+0000","last_unstale":"2024-09-14T10:58:25.293909+0000","last_undegraded":"2024-09-14T10:58:25.293909+0000","last_fullsized":"2024-09-14T10:58:25.293909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:25.293744+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.293744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:40.765776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.327126+0000","last_change":"2024-09-14T10:59:19.327074+0000","last_active":"2024-09-14T10:59:19.327126+0000","last_peered":"2024-09-14T10:59:19.327126+0000","last_clean":"2024-09-14T10:59:19.327126+0000","last_became_active":"2024-09-14T10:55:08.701904+0000","last_became_peered":"2024-09-14T10:55:08.701904+0000","last_unstale":"2024-09-14T10:59:19.327126+0000","last_undegraded":"2024-09-14T10:59:19.327126+0000","last_fullsized":"2024-09-14T10:59:19.327126+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.326990+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.326990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:03.623781+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'38","reported_seq":94,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.698911+0000","last_change":"2024-09-14T10:59:02.698812+0000","last_active":"2024-09-14T10:59:02.698911+0000","last_peered":"2024-09-14T10:59:02.698911+0000","last_clean":"2024-09-14T10:59:02.698911+0000","last_became_active":"2024-09-14T10:55:10.706173+0000","last_became_peered":"2024-09-14T10:55:10.706173+0000","last_unstale":"2024-09-14T10:59:02.698911+0000","last_undegraded":"2024-09-14T10:59:02.698911+0000","last_fullsized":"2024-09-14T10:59:02.698911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:02.698703+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.698703+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:35.538644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":448,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.492042+0000","last_change":"2024-09-14T10:59:11.491953+0000","last_active":"2024-09-14T10:59:11.492042+0000","last_peered":"2024-09-14T10:59:11.492042+0000","last_clean":"2024-09-14T10:59:11.492042+0000","last_became_active":"2024-09-14T10:55:12.719447+0000","last_became_peered":"2024-09-14T10:55:12.719447+0000","last_unstale":"2024-09-14T10:59:11.492042+0000","last_undegraded":"2024-09-14T10:59:11.492042+0000","last_fullsized":"2024-09-14T10:59:11.492042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:11.491837+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.491837+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:50.595963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.265073+0000","last_change":"2024-09-14T10:58:57.265017+0000","last_active":"2024-09-14T10:58:57.265073+0000","last_peered":"2024-09-14T10:58:57.265073+0000","last_clean":"2024-09-14T10:58:57.265073+0000","last_became_active":"2024-09-14T10:55:06.699292+0000","last_became_peered":"2024-09-14T10:55:06.699292+0000","last_unstale":"2024-09-14T10:58:57.265073+0000","last_undegraded":"2024-09-14T10:58:57.265073+0000","last_fullsized":"2024-09-14T10:58:57.265073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:57.264932+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.264932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:19.108926+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.849997+0000","last_change":"2024-09-14T10:58:27.849928+0000","last_active":"2024-09-14T10:58:27.849997+0000","last_peered":"2024-09-14T10:58:27.849997+0000","last_clean":"2024-09-14T10:58:27.849997+0000","last_became_active":"2024-09-14T10:55:04.702882+0000","last_became_peered":"2024-09-14T10:55:04.702882+0000","last_unstale":"2024-09-14T10:58:27.849997+0000","last_undegraded":"2024-09-14T10:58:27.849997+0000","last_fullsized":"2024-09-14T10:58:27.849997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.849846+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.849846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:39.863957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.114589+0000","last_change":"2024-09-14T10:58:59.114524+0000","last_active":"2024-09-14T10:58:59.114589+0000","last_peered":"2024-09-14T10:58:59.114589+0000","last_clean":"2024-09-14T10:58:59.114589+0000","last_became_active":"2024-09-14T10:55:08.703320+0000","last_became_peered":"2024-09-14T10:55:08.703320+0000","last_unstale":"2024-09-14T10:58:59.114589+0000","last_undegraded":"2024-09-14T10:58:59.114589+0000","last_fullsized":"2024-09-14T10:58:59.114589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:59.114437+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.114437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:51.358552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:59.680979+0000","last_change":"2024-09-14T10:58:59.680885+0000","last_active":"2024-09-14T10:58:59.680979+0000","last_peered":"2024-09-14T10:58:59.680979+0000","last_clean":"2024-09-14T10:58:59.680979+0000","last_became_active":"2024-09-14T10:55:10.710861+0000","last_became_peered":"2024-09-14T10:55:10.710861+0000","last_unstale":"2024-09-14T10:58:59.680979+0000","last_undegraded":"2024-09-14T10:58:59.680979+0000","last_fullsized":"2024-09-14T10:58:59.680979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-14T10:58:59.680755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:59.680755+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:54.152021+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.503145+0000","last_change":"2024-09-14T10:59:18.503094+0000","last_active":"2024-09-14T10:59:18.503145+0000","last_peered":"2024-09-14T10:59:18.503145+0000","last_clean":"2024-09-14T10:59:18.503145+0000","last_became_active":"2024-09-14T10:55:12.718887+0000","last_became_peered":"2024-09-14T10:55:12.718887+0000","last_unstale":"2024-09-14T10:59:18.503145+0000","last_undegraded":"2024-09-14T10:59:18.503145+0000","last_fullsized":"2024-09-14T10:59:18.503145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:18.503011+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.503011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:17.545714+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.738511+0000","last_change":"2024-09-14T10:59:12.738448+0000","last_active":"2024-09-14T10:59:12.738511+0000","last_peered":"2024-09-14T10:59:12.738511+0000","last_clean":"2024-09-14T10:59:12.738511+0000","last_became_active":"2024-09-14T10:55:14.727324+0000","last_became_peered":"2024-09-14T10:55:14.727324+0000","last_unstale":"2024-09-14T10:59:12.738511+0000","last_undegraded":"2024-09-14T10:59:12.738511+0000","last_fullsized":"2024-09-14T10:59:12.738511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:12.738366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.738366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:17.547524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.142384+0000","last_change":"2024-09-14T10:58:38.142295+0000","last_active":"2024-09-14T10:58:38.142384+0000","last_peered":"2024-09-14T10:58:38.142384+0000","last_clean":"2024-09-14T10:58:38.142384+0000","last_became_active":"2024-09-14T10:55:06.692645+0000","last_became_peered":"2024-09-14T10:55:06.692645+0000","last_unstale":"2024-09-14T10:58:38.142384+0000","last_undegraded":"2024-09-14T10:58:38.142384+0000","last_fullsized":"2024-09-14T10:58:38.142384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:38.142187+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.142187+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:18.412057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.853432+0000","last_change":"2024-09-14T10:58:25.853379+0000","last_active":"2024-09-14T10:58:25.853432+0000","last_peered":"2024-09-14T10:58:25.853432+0000","last_clean":"2024-09-14T10:58:25.853432+0000","last_became_active":"2024-09-14T10:55:04.703000+0000","last_became_peered":"2024-09-14T10:55:04.703000+0000","last_unstale":"2024-09-14T10:58:25.853432+0000","last_undegraded":"2024-09-14T10:58:25.853432+0000","last_fullsized":"2024-09-14T10:58:25.853432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.853290+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.853290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:06.774127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.503593+0000","last_change":"2024-09-14T10:58:55.503539+0000","last_active":"2024-09-14T10:58:55.503593+0000","last_peered":"2024-09-14T10:58:55.503593+0000","last_clean":"2024-09-14T10:58:55.503593+0000","last_became_active":"2024-09-14T10:55:08.703089+0000","last_became_peered":"2024-09-14T10:55:08.703089+0000","last_unstale":"2024-09-14T10:58:55.503593+0000","last_undegraded":"2024-09-14T10:58:55.503593+0000","last_fullsized":"2024-09-14T10:58:55.503593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.503455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.503455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:04.311229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'38","reported_seq":94,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:25.456229+0000","last_change":"2024-09-14T10:59:25.456167+0000","last_active":"2024-09-14T10:59:25.456229+0000","last_peered":"2024-09-14T10:59:25.456229+0000","last_clean":"2024-09-14T10:59:25.456229+0000","last_became_active":"2024-09-14T10:55:10.715331+0000","last_became_peered":"2024-09-14T10:55:10.715331+0000","last_unstale":"2024-09-14T10:59:25.456229+0000","last_undegraded":"2024-09-14T10:59:25.456229+0000","last_fullsized":"2024-09-14T10:59:25.456229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:25.456055+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:25.456055+0000","last_clean_scrub_stamp":"2024-09-14T10:59:25.456055+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:02.091072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.469274+0000","last_change":"2024-09-14T10:59:10.469166+0000","last_active":"2024-09-14T10:59:10.469274+0000","last_peered":"2024-09-14T10:59:10.469274+0000","last_clean":"2024-09-14T10:59:10.469274+0000","last_became_active":"2024-09-14T10:55:12.713932+0000","last_became_peered":"2024-09-14T10:55:12.713932+0000","last_unstale":"2024-09-14T10:59:10.469274+0000","last_undegraded":"2024-09-14T10:59:10.469274+0000","last_fullsized":"2024-09-14T10:59:10.469274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:10.469058+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.469058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:25.633528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:18.803979+0000","last_change":"2024-09-14T10:59:18.803897+0000","last_active":"2024-09-14T10:59:18.803979+0000","last_peered":"2024-09-14T10:59:18.803979+0000","last_clean":"2024-09-14T10:59:18.803979+0000","last_became_active":"2024-09-14T10:55:14.726420+0000","last_became_peered":"2024-09-14T10:55:14.726420+0000","last_unstale":"2024-09-14T10:59:18.803979+0000","last_undegraded":"2024-09-14T10:59:18.803979+0000","last_fullsized":"2024-09-14T10:59:18.803979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:18.803791+0000","last_clean_scrub_stamp":"2024-09-14T10:59:18.803791+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:35.021908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.752075+0000","last_change":"2024-09-14T10:58:39.751967+0000","last_active":"2024-09-14T10:58:39.752075+0000","last_peered":"2024-09-14T10:58:39.752075+0000","last_clean":"2024-09-14T10:58:39.752075+0000","last_became_active":"2024-09-14T10:55:06.694845+0000","last_became_peered":"2024-09-14T10:55:06.694845+0000","last_unstale":"2024-09-14T10:58:39.752075+0000","last_undegraded":"2024-09-14T10:58:39.752075+0000","last_fullsized":"2024-09-14T10:58:39.752075+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:39.751871+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.751871+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:01.585910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:36.127010+0000","last_change":"2024-09-14T10:58:36.126916+0000","last_active":"2024-09-14T10:58:36.127010+0000","last_peered":"2024-09-14T10:58:36.127010+0000","last_clean":"2024-09-14T10:58:36.127010+0000","last_became_active":"2024-09-14T10:55:04.700317+0000","last_became_peered":"2024-09-14T10:55:04.700317+0000","last_unstale":"2024-09-14T10:58:36.127010+0000","last_undegraded":"2024-09-14T10:58:36.127010+0000","last_fullsized":"2024-09-14T10:58:36.127010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:36.126801+0000","last_clean_scrub_stamp":"2024-09-14T10:58:36.126801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.157003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.469017+0000","last_change":"2024-09-14T10:58:56.468948+0000","last_active":"2024-09-14T10:58:56.469017+0000","last_peered":"2024-09-14T10:58:56.469017+0000","last_clean":"2024-09-14T10:58:56.469017+0000","last_became_active":"2024-09-14T10:55:08.700668+0000","last_became_peered":"2024-09-14T10:55:08.700668+0000","last_unstale":"2024-09-14T10:58:56.469017+0000","last_undegraded":"2024-09-14T10:58:56.469017+0000","last_fullsized":"2024-09-14T10:58:56.469017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:56.468851+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.468851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:39.048237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.441759+0000","last_change":"2024-09-14T10:59:23.441696+0000","last_active":"2024-09-14T10:59:23.441759+0000","last_peered":"2024-09-14T10:59:23.441759+0000","last_clean":"2024-09-14T10:59:23.441759+0000","last_became_active":"2024-09-14T10:55:10.712431+0000","last_became_peered":"2024-09-14T10:55:10.712431+0000","last_unstale":"2024-09-14T10:59:23.441759+0000","last_undegraded":"2024-09-14T10:59:23.441759+0000","last_fullsized":"2024-09-14T10:59:23.441759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:23.441596+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:23.441596+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.441596+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:41.533118+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":410,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.491156+0000","last_change":"2024-09-14T10:59:15.491089+0000","last_active":"2024-09-14T10:59:15.491156+0000","last_peered":"2024-09-14T10:59:15.491156+0000","last_clean":"2024-09-14T10:59:15.491156+0000","last_became_active":"2024-09-14T10:55:12.713706+0000","last_became_peered":"2024-09-14T10:55:12.713706+0000","last_unstale":"2024-09-14T10:59:15.491156+0000","last_undegraded":"2024-09-14T10:59:15.491156+0000","last_fullsized":"2024-09-14T10:59:15.491156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:15.490991+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.490991+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:43.901316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.599034+0000","last_change":"2024-09-14T10:59:21.598958+0000","last_active":"2024-09-14T10:59:21.599034+0000","last_peered":"2024-09-14T10:59:21.599034+0000","last_clean":"2024-09-14T10:59:21.599034+0000","last_became_active":"2024-09-14T10:55:14.721807+0000","last_became_peered":"2024-09-14T10:55:14.721807+0000","last_unstale":"2024-09-14T10:59:21.599034+0000","last_undegraded":"2024-09-14T10:59:21.599034+0000","last_fullsized":"2024-09-14T10:59:21.599034+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:21.598835+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:21.598835+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.598835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:59.656682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.763026+0000","last_change":"2024-09-14T10:58:41.762964+0000","last_active":"2024-09-14T10:58:41.763026+0000","last_peered":"2024-09-14T10:58:41.763026+0000","last_clean":"2024-09-14T10:58:41.763026+0000","last_became_active":"2024-09-14T10:55:06.687092+0000","last_became_peered":"2024-09-14T10:55:06.687092+0000","last_unstale":"2024-09-14T10:58:41.763026+0000","last_undegraded":"2024-09-14T10:58:41.763026+0000","last_fullsized":"2024-09-14T10:58:41.763026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:41.762874+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.762874+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:35.049658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.164604+0000","last_change":"2024-09-14T10:58:35.164518+0000","last_active":"2024-09-14T10:58:35.164604+0000","last_peered":"2024-09-14T10:58:35.164604+0000","last_clean":"2024-09-14T10:58:35.164604+0000","last_became_active":"2024-09-14T10:55:04.707648+0000","last_became_peered":"2024-09-14T10:55:04.707648+0000","last_unstale":"2024-09-14T10:58:35.164604+0000","last_undegraded":"2024-09-14T10:58:35.164604+0000","last_fullsized":"2024-09-14T10:58:35.164604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:35.164436+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.164436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:54.849680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.647907+0000","last_change":"2024-09-14T10:58:50.647837+0000","last_active":"2024-09-14T10:58:50.647907+0000","last_peered":"2024-09-14T10:58:50.647907+0000","last_clean":"2024-09-14T10:58:50.647907+0000","last_became_active":"2024-09-14T10:55:41.752275+0000","last_became_peered":"2024-09-14T10:55:41.752275+0000","last_unstale":"2024-09-14T10:58:50.647907+0000","last_undegraded":"2024-09-14T10:58:50.647907+0000","last_fullsized":"2024-09-14T10:58:50.647907+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:50.647749+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.647749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.851323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"37'65","reported_seq":139,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:24.412318+0000","last_change":"2024-09-14T10:59:24.412251+0000","last_active":"2024-09-14T10:59:24.412318+0000","last_peered":"2024-09-14T10:59:24.412318+0000","last_clean":"2024-09-14T10:59:24.412318+0000","last_became_active":"2024-09-14T10:55:10.712618+0000","last_became_peered":"2024-09-14T10:55:10.712618+0000","last_unstale":"2024-09-14T10:59:24.412318+0000","last_undegraded":"2024-09-14T10:59:24.412318+0000","last_fullsized":"2024-09-14T10:59:24.412318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-09-14T10:59:24.412155+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-09-14T10:59:24.412155+0000","last_clean_scrub_stamp":"2024-09-14T10:59:24.412155+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:47.835966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.461031+0000","last_change":"2024-09-14T10:59:12.460959+0000","last_active":"2024-09-14T10:59:12.461031+0000","last_peered":"2024-09-14T10:59:12.461031+0000","last_clean":"2024-09-14T10:59:12.461031+0000","last_became_active":"2024-09-14T10:55:12.717630+0000","last_became_peered":"2024-09-14T10:55:12.717630+0000","last_unstale":"2024-09-14T10:59:12.461031+0000","last_undegraded":"2024-09-14T10:59:12.461031+0000","last_fullsized":"2024-09-14T10:59:12.461031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.460863+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.460863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:01.102618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'21","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.555378+0000","last_change":"2024-09-14T10:59:20.555284+0000","last_active":"2024-09-14T10:59:20.555378+0000","last_peered":"2024-09-14T10:59:20.555378+0000","last_clean":"2024-09-14T10:59:20.555378+0000","last_became_active":"2024-09-14T10:55:14.717334+0000","last_became_peered":"2024-09-14T10:55:14.717334+0000","last_unstale":"2024-09-14T10:59:20.555378+0000","last_undegraded":"2024-09-14T10:59:20.555378+0000","last_fullsized":"2024-09-14T10:59:20.555378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-14T10:59:20.555183+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-14T10:59:20.555183+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.555183+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:19.564304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.145316+0000","last_change":"2024-09-14T10:58:40.145252+0000","last_active":"2024-09-14T10:58:40.145316+0000","last_peered":"2024-09-14T10:58:40.145316+0000","last_clean":"2024-09-14T10:58:40.145316+0000","last_became_active":"2024-09-14T10:55:06.703447+0000","last_became_peered":"2024-09-14T10:55:06.703447+0000","last_unstale":"2024-09-14T10:58:40.145316+0000","last_undegraded":"2024-09-14T10:58:40.145316+0000","last_fullsized":"2024-09-14T10:58:40.145316+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.145160+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.145160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:03.438344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.623875+0000","last_change":"2024-09-14T10:58:29.623781+0000","last_active":"2024-09-14T10:58:29.623875+0000","last_peered":"2024-09-14T10:58:29.623875+0000","last_clean":"2024-09-14T10:58:29.623875+0000","last_became_active":"2024-09-14T10:55:04.690659+0000","last_became_peered":"2024-09-14T10:55:04.690659+0000","last_unstale":"2024-09-14T10:58:29.623875+0000","last_undegraded":"2024-09-14T10:58:29.623875+0000","last_fullsized":"2024-09-14T10:58:29.623875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.623676+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.623676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:28.939281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.719586+0000","last_change":"2024-09-14T10:58:57.719508+0000","last_active":"2024-09-14T10:58:57.719586+0000","last_peered":"2024-09-14T10:58:57.719586+0000","last_clean":"2024-09-14T10:58:57.719586+0000","last_became_active":"2024-09-14T10:55:08.698955+0000","last_became_peered":"2024-09-14T10:55:08.698955+0000","last_unstale":"2024-09-14T10:58:57.719586+0000","last_undegraded":"2024-09-14T10:58:57.719586+0000","last_fullsized":"2024-09-14T10:58:57.719586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.719407+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.719407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:05.463897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'43","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.937148+0000","last_change":"2024-09-14T10:59:09.937066+0000","last_active":"2024-09-14T10:59:09.937148+0000","last_peered":"2024-09-14T10:59:09.937148+0000","last_clean":"2024-09-14T10:59:09.937148+0000","last_became_active":"2024-09-14T10:55:10.705886+0000","last_became_peered":"2024-09-14T10:55:10.705886+0000","last_unstale":"2024-09-14T10:59:09.937148+0000","last_undegraded":"2024-09-14T10:59:09.937148+0000","last_fullsized":"2024-09-14T10:59:09.937148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'43","last_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_deep_scrub":"37'43","last_deep_scrub_stamp":"2024-09-14T10:59:09.936931+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.936931+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:22.882495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:35.479703+0000","last_change":"2024-09-14T10:59:35.479635+0000","last_active":"2024-09-14T10:59:35.479703+0000","last_peered":"2024-09-14T10:59:35.479703+0000","last_clean":"2024-09-14T10:59:35.479703+0000","last_became_active":"2024-09-14T10:55:12.723133+0000","last_became_peered":"2024-09-14T10:55:12.723133+0000","last_unstale":"2024-09-14T10:59:35.479703+0000","last_undegraded":"2024-09-14T10:59:35.479703+0000","last_fullsized":"2024-09-14T10:59:35.479703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:35.479545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:35.479545+0000","last_clean_scrub_stamp":"2024-09-14T10:59:35.479545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:19.915394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:41.419462+0000","last_change":"2024-09-14T10:59:41.419462+0000","last_active":"2024-09-14T10:59:41.419462+0000","last_peered":"2024-09-14T10:59:41.419462+0000","last_clean":"2024-09-14T10:59:41.419462+0000","last_became_active":"2024-09-14T10:55:14.727766+0000","last_became_peered":"2024-09-14T10:55:14.727766+0000","last_unstale":"2024-09-14T10:59:41.419462+0000","last_undegraded":"2024-09-14T10:59:41.419462+0000","last_fullsized":"2024-09-14T10:59:41.419462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:59:41.419369+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:59:41.419369+0000","last_clean_scrub_stamp":"2024-09-14T10:59:41.419369+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:18.710147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.260956+0000","last_change":"2024-09-14T10:58:56.260882+0000","last_active":"2024-09-14T10:58:56.260956+0000","last_peered":"2024-09-14T10:58:56.260956+0000","last_clean":"2024-09-14T10:58:56.260956+0000","last_became_active":"2024-09-14T10:55:06.701636+0000","last_became_peered":"2024-09-14T10:55:06.701636+0000","last_unstale":"2024-09-14T10:58:56.260956+0000","last_undegraded":"2024-09-14T10:58:56.260956+0000","last_fullsized":"2024-09-14T10:58:56.260956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:56.260781+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.260781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.944726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.142012+0000","last_change":"2024-09-14T10:58:34.141947+0000","last_active":"2024-09-14T10:58:34.142012+0000","last_peered":"2024-09-14T10:58:34.142012+0000","last_clean":"2024-09-14T10:58:34.142012+0000","last_became_active":"2024-09-14T10:55:04.699869+0000","last_became_peered":"2024-09-14T10:55:04.699869+0000","last_unstale":"2024-09-14T10:58:34.142012+0000","last_undegraded":"2024-09-14T10:58:34.142012+0000","last_fullsized":"2024-09-14T10:58:34.142012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:34.141859+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.141859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:14.978632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.429107+0000","last_change":"2024-09-14T10:58:57.429031+0000","last_active":"2024-09-14T10:58:57.429107+0000","last_peered":"2024-09-14T10:58:57.429107+0000","last_clean":"2024-09-14T10:58:57.429107+0000","last_became_active":"2024-09-14T10:55:08.702886+0000","last_became_peered":"2024-09-14T10:55:08.702886+0000","last_unstale":"2024-09-14T10:58:57.429107+0000","last_undegraded":"2024-09-14T10:58:57.429107+0000","last_fullsized":"2024-09-14T10:58:57.429107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:57.428941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.428941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:25.714161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'49","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.636618+0000","last_change":"2024-09-14T10:59:00.636564+0000","last_active":"2024-09-14T10:59:00.636618+0000","last_peered":"2024-09-14T10:59:00.636618+0000","last_clean":"2024-09-14T10:59:00.636618+0000","last_became_active":"2024-09-14T10:55:10.703141+0000","last_became_peered":"2024-09-14T10:55:10.703141+0000","last_unstale":"2024-09-14T10:59:00.636618+0000","last_undegraded":"2024-09-14T10:59:00.636618+0000","last_fullsized":"2024-09-14T10:59:00.636618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:00.636458+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.636458+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.391010+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":416,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.675970+0000","last_change":"2024-09-14T10:59:06.675897+0000","last_active":"2024-09-14T10:59:06.675970+0000","last_peered":"2024-09-14T10:59:06.675970+0000","last_clean":"2024-09-14T10:59:06.675970+0000","last_became_active":"2024-09-14T10:55:12.717836+0000","last_became_peered":"2024-09-14T10:55:12.717836+0000","last_unstale":"2024-09-14T10:59:06.675970+0000","last_undegraded":"2024-09-14T10:59:06.675970+0000","last_fullsized":"2024-09-14T10:59:06.675970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:06.675797+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.675797+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:04.953299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'13","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.452228+0000","last_change":"2024-09-14T10:59:16.452175+0000","last_active":"2024-09-14T10:59:16.452228+0000","last_peered":"2024-09-14T10:59:16.452228+0000","last_clean":"2024-09-14T10:59:16.452228+0000","last_became_active":"2024-09-14T10:55:14.722162+0000","last_became_peered":"2024-09-14T10:55:14.722162+0000","last_unstale":"2024-09-14T10:59:16.452228+0000","last_undegraded":"2024-09-14T10:59:16.452228+0000","last_fullsized":"2024-09-14T10:59:16.452228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'13","last_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_deep_scrub":"37'13","last_deep_scrub_stamp":"2024-09-14T10:59:16.452083+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.452083+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:31.073850+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'18","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.764616+0000","last_change":"2024-09-14T10:58:40.764524+0000","last_active":"2024-09-14T10:58:40.764616+0000","last_peered":"2024-09-14T10:58:40.764616+0000","last_clean":"2024-09-14T10:58:40.764616+0000","last_became_active":"2024-09-14T10:55:06.695215+0000","last_became_peered":"2024-09-14T10:55:06.695215+0000","last_unstale":"2024-09-14T10:58:40.764616+0000","last_undegraded":"2024-09-14T10:58:40.764616+0000","last_fullsized":"2024-09-14T10:58:40.764616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:40.764431+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.764431+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:57.754237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.139922+0000","last_change":"2024-09-14T10:58:33.139853+0000","last_active":"2024-09-14T10:58:33.139922+0000","last_peered":"2024-09-14T10:58:33.139922+0000","last_clean":"2024-09-14T10:58:33.139922+0000","last_became_active":"2024-09-14T10:55:04.705577+0000","last_became_peered":"2024-09-14T10:55:04.705577+0000","last_unstale":"2024-09-14T10:58:33.139922+0000","last_undegraded":"2024-09-14T10:58:33.139922+0000","last_fullsized":"2024-09-14T10:58:33.139922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.139755+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.139755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.454102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.097340+0000","last_change":"2024-09-14T10:59:04.097284+0000","last_active":"2024-09-14T10:59:04.097340+0000","last_peered":"2024-09-14T10:59:04.097340+0000","last_clean":"2024-09-14T10:59:04.097340+0000","last_became_active":"2024-09-14T10:55:08.701488+0000","last_became_peered":"2024-09-14T10:55:08.701488+0000","last_unstale":"2024-09-14T10:59:04.097340+0000","last_undegraded":"2024-09-14T10:59:04.097340+0000","last_fullsized":"2024-09-14T10:59:04.097340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:04.097190+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.097190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:24.762136+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'16","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:28.462805+0000","last_change":"2024-09-14T10:59:28.462740+0000","last_active":"2024-09-14T10:59:28.462805+0000","last_peered":"2024-09-14T10:59:28.462805+0000","last_clean":"2024-09-14T10:59:28.462805+0000","last_became_active":"2024-09-14T10:55:10.715310+0000","last_became_peered":"2024-09-14T10:55:10.715310+0000","last_unstale":"2024-09-14T10:59:28.462805+0000","last_undegraded":"2024-09-14T10:59:28.462805+0000","last_fullsized":"2024-09-14T10:59:28.462805+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:59:28.462636+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:59:28.462636+0000","last_clean_scrub_stamp":"2024-09-14T10:59:28.462636+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:45.927925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":472,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.979912+0000","last_change":"2024-09-14T10:59:08.979812+0000","last_active":"2024-09-14T10:59:08.979912+0000","last_peered":"2024-09-14T10:59:08.979912+0000","last_clean":"2024-09-14T10:59:08.979912+0000","last_became_active":"2024-09-14T10:55:12.708217+0000","last_became_peered":"2024-09-14T10:55:12.708217+0000","last_unstale":"2024-09-14T10:59:08.979912+0000","last_undegraded":"2024-09-14T10:59:08.979912+0000","last_fullsized":"2024-09-14T10:59:08.979912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:08.979700+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.979700+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:04.708361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'14","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.696173+0000","last_change":"2024-09-14T10:59:11.696117+0000","last_active":"2024-09-14T10:59:11.696173+0000","last_peered":"2024-09-14T10:59:11.696173+0000","last_clean":"2024-09-14T10:59:11.696173+0000","last_became_active":"2024-09-14T10:55:14.719252+0000","last_became_peered":"2024-09-14T10:55:14.719252+0000","last_unstale":"2024-09-14T10:59:11.696173+0000","last_undegraded":"2024-09-14T10:59:11.696173+0000","last_fullsized":"2024-09-14T10:59:11.696173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:11.696028+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.696028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.462538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":62,"num_write":37,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'3","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.122369+0000","last_change":"2024-09-14T10:58:42.122287+0000","last_active":"2024-09-14T10:58:42.122369+0000","last_peered":"2024-09-14T10:58:42.122369+0000","last_clean":"2024-09-14T10:58:42.122369+0000","last_became_active":"2024-09-14T10:55:06.706031+0000","last_became_peered":"2024-09-14T10:55:06.706031+0000","last_unstale":"2024-09-14T10:58:42.122369+0000","last_undegraded":"2024-09-14T10:58:42.122369+0000","last_fullsized":"2024-09-14T10:58:42.122369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:42.122178+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.122178+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:54.680983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.154655+0000","last_change":"2024-09-14T10:58:32.154586+0000","last_active":"2024-09-14T10:58:32.154655+0000","last_peered":"2024-09-14T10:58:32.154655+0000","last_clean":"2024-09-14T10:58:32.154655+0000","last_became_active":"2024-09-14T10:55:04.709718+0000","last_became_peered":"2024-09-14T10:55:04.709718+0000","last_unstale":"2024-09-14T10:58:32.154655+0000","last_undegraded":"2024-09-14T10:58:32.154655+0000","last_fullsized":"2024-09-14T10:58:32.154655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.154493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.154493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:40.858878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.211461+0000","last_change":"2024-09-14T10:59:14.211383+0000","last_active":"2024-09-14T10:59:14.211461+0000","last_peered":"2024-09-14T10:59:14.211461+0000","last_clean":"2024-09-14T10:59:14.211461+0000","last_became_active":"2024-09-14T10:55:08.698306+0000","last_became_peered":"2024-09-14T10:55:08.698306+0000","last_unstale":"2024-09-14T10:59:14.211461+0000","last_undegraded":"2024-09-14T10:59:14.211461+0000","last_fullsized":"2024-09-14T10:59:14.211461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.211298+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.211298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:33.896220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'50","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.008193+0000","last_change":"2024-09-14T10:59:08.008101+0000","last_active":"2024-09-14T10:59:08.008193+0000","last_peered":"2024-09-14T10:59:08.008193+0000","last_clean":"2024-09-14T10:59:08.008193+0000","last_became_active":"2024-09-14T10:55:10.704837+0000","last_became_peered":"2024-09-14T10:55:10.704837+0000","last_unstale":"2024-09-14T10:59:08.008193+0000","last_undegraded":"2024-09-14T10:59:08.008193+0000","last_fullsized":"2024-09-14T10:59:08.008193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'50","last_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_deep_scrub":"37'50","last_deep_scrub_stamp":"2024-09-14T10:59:08.007987+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.007987+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:18.101895+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.667016+0000","last_change":"2024-09-14T10:59:05.666964+0000","last_active":"2024-09-14T10:59:05.667016+0000","last_peered":"2024-09-14T10:59:05.667016+0000","last_clean":"2024-09-14T10:59:05.667016+0000","last_became_active":"2024-09-14T10:55:12.721141+0000","last_became_peered":"2024-09-14T10:55:12.721141+0000","last_unstale":"2024-09-14T10:59:05.667016+0000","last_undegraded":"2024-09-14T10:59:05.667016+0000","last_fullsized":"2024-09-14T10:59:05.667016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.666866+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.666866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:58.215776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.813422+0000","last_change":"2024-09-14T10:59:17.813354+0000","last_active":"2024-09-14T10:59:17.813422+0000","last_peered":"2024-09-14T10:59:17.813422+0000","last_clean":"2024-09-14T10:59:17.813422+0000","last_became_active":"2024-09-14T10:55:14.722209+0000","last_became_peered":"2024-09-14T10:55:14.722209+0000","last_unstale":"2024-09-14T10:59:17.813422+0000","last_undegraded":"2024-09-14T10:59:17.813422+0000","last_fullsized":"2024-09-14T10:59:17.813422+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:17.813268+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.813268+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.517653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.270136+0000","last_change":"2024-09-14T10:58:54.270045+0000","last_active":"2024-09-14T10:58:54.270136+0000","last_peered":"2024-09-14T10:58:54.270136+0000","last_clean":"2024-09-14T10:58:54.270136+0000","last_became_active":"2024-09-14T10:55:06.699237+0000","last_became_peered":"2024-09-14T10:55:06.699237+0000","last_unstale":"2024-09-14T10:58:54.270136+0000","last_undegraded":"2024-09-14T10:58:54.270136+0000","last_fullsized":"2024-09-14T10:58:54.270136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:54.269944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.269944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:15.040276+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":159,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.259271+0000","last_change":"2024-09-14T10:58:24.259197+0000","last_active":"2024-09-14T10:58:24.259271+0000","last_peered":"2024-09-14T10:58:24.259271+0000","last_clean":"2024-09-14T10:58:24.259271+0000","last_became_active":"2024-09-14T10:54:50.378629+0000","last_became_peered":"2024-09-14T10:54:50.378629+0000","last_unstale":"2024-09-14T10:58:24.259271+0000","last_undegraded":"2024-09-14T10:58:24.259271+0000","last_fullsized":"2024-09-14T10:58:24.259271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-14T10:58:24.259102+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.259102+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:48.731970+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.056067+0000","last_change":"2024-09-14T10:58:28.055953+0000","last_active":"2024-09-14T10:58:28.056067+0000","last_peered":"2024-09-14T10:58:28.056067+0000","last_clean":"2024-09-14T10:58:28.056067+0000","last_became_active":"2024-09-14T10:54:52.903678+0000","last_became_peered":"2024-09-14T10:54:52.903678+0000","last_unstale":"2024-09-14T10:58:28.056067+0000","last_undegraded":"2024-09-14T10:58:28.056067+0000","last_fullsized":"2024-09-14T10:58:28.056067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.055847+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.055847+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:09.084414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00074415699999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.127724+0000","last_change":"2024-09-14T10:58:30.127641+0000","last_active":"2024-09-14T10:58:30.127724+0000","last_peered":"2024-09-14T10:58:30.127724+0000","last_clean":"2024-09-14T10:58:30.127724+0000","last_became_active":"2024-09-14T10:55:04.708378+0000","last_became_peered":"2024-09-14T10:55:04.708378+0000","last_unstale":"2024-09-14T10:58:30.127724+0000","last_undegraded":"2024-09-14T10:58:30.127724+0000","last_fullsized":"2024-09-14T10:58:30.127724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.127553+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.127553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.604808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.100990+0000","last_change":"2024-09-14T10:58:58.100923+0000","last_active":"2024-09-14T10:58:58.100990+0000","last_peered":"2024-09-14T10:58:58.100990+0000","last_clean":"2024-09-14T10:58:58.100990+0000","last_became_active":"2024-09-14T10:55:08.699906+0000","last_became_peered":"2024-09-14T10:55:08.699906+0000","last_unstale":"2024-09-14T10:58:58.100990+0000","last_undegraded":"2024-09-14T10:58:58.100990+0000","last_fullsized":"2024-09-14T10:58:58.100990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:58.100810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.100810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:42.350681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'90","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.412553+0000","last_change":"2024-09-14T10:59:22.412474+0000","last_active":"2024-09-14T10:59:22.412553+0000","last_peered":"2024-09-14T10:59:22.412553+0000","last_clean":"2024-09-14T10:59:22.412553+0000","last_became_active":"2024-09-14T10:55:10.713699+0000","last_became_peered":"2024-09-14T10:55:10.713699+0000","last_unstale":"2024-09-14T10:59:22.412553+0000","last_undegraded":"2024-09-14T10:59:22.412553+0000","last_fullsized":"2024-09-14T10:59:22.412553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-14T10:59:22.412384+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-14T10:59:22.412384+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.412384+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:07.564079+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.416049+0000","last_change":"2024-09-14T10:59:08.415993+0000","last_active":"2024-09-14T10:59:08.416049+0000","last_peered":"2024-09-14T10:59:08.416049+0000","last_clean":"2024-09-14T10:59:08.416049+0000","last_became_active":"2024-09-14T10:55:12.713776+0000","last_became_peered":"2024-09-14T10:55:12.713776+0000","last_unstale":"2024-09-14T10:59:08.416049+0000","last_undegraded":"2024-09-14T10:59:08.416049+0000","last_fullsized":"2024-09-14T10:59:08.416049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.415907+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.415907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:02.088717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'81","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.788427+0000","last_change":"2024-09-14T10:59:13.788337+0000","last_active":"2024-09-14T10:59:13.788427+0000","last_peered":"2024-09-14T10:59:13.788427+0000","last_clean":"2024-09-14T10:59:13.788427+0000","last_became_active":"2024-09-14T10:55:14.721058+0000","last_became_peered":"2024-09-14T10:55:14.721058+0000","last_unstale":"2024-09-14T10:59:13.788427+0000","last_undegraded":"2024-09-14T10:59:13.788427+0000","last_fullsized":"2024-09-14T10:59:13.788427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'81","last_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_deep_scrub":"37'81","last_deep_scrub_stamp":"2024-09-14T10:59:13.788216+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.788216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:53.195658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'8","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.286512+0000","last_change":"2024-09-14T10:58:55.286417+0000","last_active":"2024-09-14T10:58:55.286512+0000","last_peered":"2024-09-14T10:58:55.286512+0000","last_clean":"2024-09-14T10:58:55.286512+0000","last_became_active":"2024-09-14T10:55:06.692618+0000","last_became_peered":"2024-09-14T10:55:06.692618+0000","last_unstale":"2024-09-14T10:58:55.286512+0000","last_undegraded":"2024-09-14T10:58:55.286512+0000","last_fullsized":"2024-09-14T10:58:55.286512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:55.286296+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.286296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.817177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.090047+0000","last_change":"2024-09-14T10:58:25.089983+0000","last_active":"2024-09-14T10:58:25.090047+0000","last_peered":"2024-09-14T10:58:25.090047+0000","last_clean":"2024-09-14T10:58:25.090047+0000","last_became_active":"2024-09-14T10:54:52.904108+0000","last_became_peered":"2024-09-14T10:54:52.904108+0000","last_unstale":"2024-09-14T10:58:25.090047+0000","last_undegraded":"2024-09-14T10:58:25.090047+0000","last_fullsized":"2024-09-14T10:58:25.090047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:25.089891+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.089891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:47.106405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000517359,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.587614+0000","last_change":"2024-09-14T10:58:26.587548+0000","last_active":"2024-09-14T10:58:26.587614+0000","last_peered":"2024-09-14T10:58:26.587614+0000","last_clean":"2024-09-14T10:58:26.587614+0000","last_became_active":"2024-09-14T10:55:04.692184+0000","last_became_peered":"2024-09-14T10:55:04.692184+0000","last_unstale":"2024-09-14T10:58:26.587614+0000","last_undegraded":"2024-09-14T10:58:26.587614+0000","last_fullsized":"2024-09-14T10:58:26.587614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.587449+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.587449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:17.118474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:15.240845+0000","last_change":"2024-09-14T10:59:15.240769+0000","last_active":"2024-09-14T10:59:15.240845+0000","last_peered":"2024-09-14T10:59:15.240845+0000","last_clean":"2024-09-14T10:59:15.240845+0000","last_became_active":"2024-09-14T10:55:41.752276+0000","last_became_peered":"2024-09-14T10:55:41.752276+0000","last_unstale":"2024-09-14T10:59:15.240845+0000","last_undegraded":"2024-09-14T10:59:15.240845+0000","last_fullsized":"2024-09-14T10:59:15.240845+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:15.240678+0000","last_clean_scrub_stamp":"2024-09-14T10:59:15.240678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:15.558925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":519,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.015481+0000","last_change":"2024-09-14T10:59:07.015417+0000","last_active":"2024-09-14T10:59:07.015481+0000","last_peered":"2024-09-14T10:59:07.015481+0000","last_clean":"2024-09-14T10:59:07.015481+0000","last_became_active":"2024-09-14T10:55:10.705420+0000","last_became_peered":"2024-09-14T10:55:10.705420+0000","last_unstale":"2024-09-14T10:59:07.015481+0000","last_undegraded":"2024-09-14T10:59:07.015481+0000","last_fullsized":"2024-09-14T10:59:07.015481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-14T10:59:07.015303+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.015303+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:51.782594+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:33.470292+0000","last_change":"2024-09-14T10:59:33.470292+0000","last_active":"2024-09-14T10:59:33.470292+0000","last_peered":"2024-09-14T10:59:33.470292+0000","last_clean":"2024-09-14T10:59:33.470292+0000","last_became_active":"2024-09-14T10:55:12.723150+0000","last_became_peered":"2024-09-14T10:55:12.723150+0000","last_unstale":"2024-09-14T10:59:33.470292+0000","last_undegraded":"2024-09-14T10:59:33.470292+0000","last_fullsized":"2024-09-14T10:59:33.470292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:33.470187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:33.470187+0000","last_clean_scrub_stamp":"2024-09-14T10:59:33.470187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.859012+0000","last_change":"2024-09-14T10:59:20.858942+0000","last_active":"2024-09-14T10:59:20.859012+0000","last_peered":"2024-09-14T10:59:20.859012+0000","last_clean":"2024-09-14T10:59:20.859012+0000","last_became_active":"2024-09-14T10:55:14.727399+0000","last_became_peered":"2024-09-14T10:55:14.727399+0000","last_unstale":"2024-09-14T10:59:20.859012+0000","last_undegraded":"2024-09-14T10:59:20.859012+0000","last_fullsized":"2024-09-14T10:59:20.859012+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-14T10:59:20.858844+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.858844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:40.544088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"37'6","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.557754+0000","last_change":"2024-09-14T10:58:40.557700+0000","last_active":"2024-09-14T10:58:40.557754+0000","last_peered":"2024-09-14T10:58:40.557754+0000","last_clean":"2024-09-14T10:58:40.557754+0000","last_became_active":"2024-09-14T10:55:06.696893+0000","last_became_peered":"2024-09-14T10:55:06.696893+0000","last_unstale":"2024-09-14T10:58:40.557754+0000","last_undegraded":"2024-09-14T10:58:40.557754+0000","last_fullsized":"2024-09-14T10:58:40.557754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:40.557602+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.557602+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:11:10.950855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.791361+0000","last_change":"2024-09-14T10:58:23.791275+0000","last_active":"2024-09-14T10:58:23.791361+0000","last_peered":"2024-09-14T10:58:23.791361+0000","last_clean":"2024-09-14T10:58:23.791361+0000","last_became_active":"2024-09-14T10:54:52.902950+0000","last_became_peered":"2024-09-14T10:54:52.902950+0000","last_unstale":"2024-09-14T10:58:23.791361+0000","last_undegraded":"2024-09-14T10:58:23.791361+0000","last_fullsized":"2024-09-14T10:58:23.791361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.791189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.791189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:54.211244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043120399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:25.586979+0000","last_change":"2024-09-14T10:58:25.586908+0000","last_active":"2024-09-14T10:58:25.586979+0000","last_peered":"2024-09-14T10:58:25.586979+0000","last_clean":"2024-09-14T10:58:25.586979+0000","last_became_active":"2024-09-14T10:55:04.703030+0000","last_became_peered":"2024-09-14T10:55:04.703030+0000","last_unstale":"2024-09-14T10:58:25.586979+0000","last_undegraded":"2024-09-14T10:58:25.586979+0000","last_fullsized":"2024-09-14T10:58:25.586979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:25.586807+0000","last_clean_scrub_stamp":"2024-09-14T10:58:25.586807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:59.791741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.694637+0000","last_change":"2024-09-14T10:58:51.694574+0000","last_active":"2024-09-14T10:58:51.694637+0000","last_peered":"2024-09-14T10:58:51.694637+0000","last_clean":"2024-09-14T10:58:51.694637+0000","last_became_active":"2024-09-14T10:55:08.699365+0000","last_became_peered":"2024-09-14T10:55:08.699365+0000","last_unstale":"2024-09-14T10:58:51.694637+0000","last_undegraded":"2024-09-14T10:58:51.694637+0000","last_fullsized":"2024-09-14T10:58:51.694637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:51.694493+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.694493+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:32.029523+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":101,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.679036+0000","last_change":"2024-09-14T10:58:58.678947+0000","last_active":"2024-09-14T10:58:58.679036+0000","last_peered":"2024-09-14T10:58:58.679036+0000","last_clean":"2024-09-14T10:58:58.679036+0000","last_became_active":"2024-09-14T10:55:10.710879+0000","last_became_peered":"2024-09-14T10:55:10.710879+0000","last_unstale":"2024-09-14T10:58:58.679036+0000","last_undegraded":"2024-09-14T10:58:58.679036+0000","last_fullsized":"2024-09-14T10:58:58.679036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-14T10:58:58.678809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.678809+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:42.184294+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.385391+0000","last_change":"2024-09-14T10:59:07.385340+0000","last_active":"2024-09-14T10:59:07.385391+0000","last_peered":"2024-09-14T10:59:07.385391+0000","last_clean":"2024-09-14T10:59:07.385391+0000","last_became_active":"2024-09-14T10:55:12.713798+0000","last_became_peered":"2024-09-14T10:55:12.713798+0000","last_unstale":"2024-09-14T10:59:07.385391+0000","last_undegraded":"2024-09-14T10:59:07.385391+0000","last_fullsized":"2024-09-14T10:59:07.385391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.385243+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.385243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:37.754783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:40.453743+0000","last_change":"2024-09-14T10:59:40.453629+0000","last_active":"2024-09-14T10:59:40.453743+0000","last_peered":"2024-09-14T10:59:40.453743+0000","last_clean":"2024-09-14T10:59:40.453743+0000","last_became_active":"2024-09-14T10:55:14.729120+0000","last_became_peered":"2024-09-14T10:55:14.729120+0000","last_unstale":"2024-09-14T10:59:40.453743+0000","last_undegraded":"2024-09-14T10:59:40.453743+0000","last_fullsized":"2024-09-14T10:59:40.453743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:40.453526+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:40.453526+0000","last_clean_scrub_stamp":"2024-09-14T10:59:40.453526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:00.279035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.572976+0000","last_change":"2024-09-14T10:58:39.572915+0000","last_active":"2024-09-14T10:58:39.572976+0000","last_peered":"2024-09-14T10:58:39.572976+0000","last_clean":"2024-09-14T10:58:39.572976+0000","last_became_active":"2024-09-14T10:55:06.696079+0000","last_became_peered":"2024-09-14T10:55:06.696079+0000","last_unstale":"2024-09-14T10:58:39.572976+0000","last_undegraded":"2024-09-14T10:58:39.572976+0000","last_fullsized":"2024-09-14T10:58:39.572976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:39.572821+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.572821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:18.045575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.107071+0000","last_change":"2024-09-14T10:58:26.106994+0000","last_active":"2024-09-14T10:58:26.107071+0000","last_peered":"2024-09-14T10:58:26.107071+0000","last_clean":"2024-09-14T10:58:26.107071+0000","last_became_active":"2024-09-14T10:54:52.903648+0000","last_became_peered":"2024-09-14T10:54:52.903648+0000","last_unstale":"2024-09-14T10:58:26.107071+0000","last_undegraded":"2024-09-14T10:58:26.107071+0000","last_fullsized":"2024-09-14T10:58:26.107071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:58:26.106908+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.106908+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:54.967192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001129873,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.820671+0000","last_change":"2024-09-14T10:58:24.820612+0000","last_active":"2024-09-14T10:58:24.820671+0000","last_peered":"2024-09-14T10:58:24.820671+0000","last_clean":"2024-09-14T10:58:24.820671+0000","last_became_active":"2024-09-14T10:55:04.701162+0000","last_became_peered":"2024-09-14T10:55:04.701162+0000","last_unstale":"2024-09-14T10:58:24.820671+0000","last_undegraded":"2024-09-14T10:58:24.820671+0000","last_fullsized":"2024-09-14T10:58:24.820671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.820510+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.820510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:45.492993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.499164+0000","last_change":"2024-09-14T10:58:54.499067+0000","last_active":"2024-09-14T10:58:54.499164+0000","last_peered":"2024-09-14T10:58:54.499164+0000","last_clean":"2024-09-14T10:58:54.499164+0000","last_became_active":"2024-09-14T10:55:08.696876+0000","last_became_peered":"2024-09-14T10:55:08.696876+0000","last_unstale":"2024-09-14T10:58:54.499164+0000","last_undegraded":"2024-09-14T10:58:54.499164+0000","last_fullsized":"2024-09-14T10:58:54.499164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.498961+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.498961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:18.100542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'22","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.388177+0000","last_change":"2024-09-14T10:59:21.388113+0000","last_active":"2024-09-14T10:59:21.388177+0000","last_peered":"2024-09-14T10:59:21.388177+0000","last_clean":"2024-09-14T10:59:21.388177+0000","last_became_active":"2024-09-14T10:55:10.715438+0000","last_became_peered":"2024-09-14T10:55:10.715438+0000","last_unstale":"2024-09-14T10:59:21.388177+0000","last_undegraded":"2024-09-14T10:59:21.388177+0000","last_fullsized":"2024-09-14T10:59:21.388177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-14T10:59:21.388025+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.388025+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:27.387659+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:34.442046+0000","last_change":"2024-09-14T10:59:34.442046+0000","last_active":"2024-09-14T10:59:34.442046+0000","last_peered":"2024-09-14T10:59:34.442046+0000","last_clean":"2024-09-14T10:59:34.442046+0000","last_became_active":"2024-09-14T10:55:12.723328+0000","last_became_peered":"2024-09-14T10:55:12.723328+0000","last_unstale":"2024-09-14T10:59:34.442046+0000","last_undegraded":"2024-09-14T10:59:34.442046+0000","last_fullsized":"2024-09-14T10:59:34.442046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:34.441956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:34.441956+0000","last_clean_scrub_stamp":"2024-09-14T10:59:34.441956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:53.077150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.826590+0000","last_change":"2024-09-14T10:59:19.826528+0000","last_active":"2024-09-14T10:59:19.826590+0000","last_peered":"2024-09-14T10:59:19.826590+0000","last_clean":"2024-09-14T10:59:19.826590+0000","last_became_active":"2024-09-14T10:55:14.730258+0000","last_became_peered":"2024-09-14T10:55:14.730258+0000","last_unstale":"2024-09-14T10:59:19.826590+0000","last_undegraded":"2024-09-14T10:59:19.826590+0000","last_fullsized":"2024-09-14T10:59:19.826590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:19.826448+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.826448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:56.627240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:37.173116+0000","last_change":"2024-09-14T10:58:37.173058+0000","last_active":"2024-09-14T10:58:37.173116+0000","last_peered":"2024-09-14T10:58:37.173116+0000","last_clean":"2024-09-14T10:58:37.173116+0000","last_became_active":"2024-09-14T10:55:06.706120+0000","last_became_peered":"2024-09-14T10:55:06.706120+0000","last_unstale":"2024-09-14T10:58:37.173116+0000","last_undegraded":"2024-09-14T10:58:37.173116+0000","last_fullsized":"2024-09-14T10:58:37.173116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:37.172972+0000","last_clean_scrub_stamp":"2024-09-14T10:58:37.172972+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:17.508002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.859776+0000","last_change":"2024-09-14T10:58:26.859668+0000","last_active":"2024-09-14T10:58:26.859776+0000","last_peered":"2024-09-14T10:58:26.859776+0000","last_clean":"2024-09-14T10:58:26.859776+0000","last_became_active":"2024-09-14T10:55:04.700263+0000","last_became_peered":"2024-09-14T10:55:04.700263+0000","last_unstale":"2024-09-14T10:58:26.859776+0000","last_undegraded":"2024-09-14T10:58:26.859776+0000","last_fullsized":"2024-09-14T10:58:26.859776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.859576+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.859576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:53.447405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:23.568697+0000","last_change":"2024-09-14T10:58:23.568609+0000","last_active":"2024-09-14T10:58:23.568697+0000","last_peered":"2024-09-14T10:58:23.568697+0000","last_clean":"2024-09-14T10:58:23.568697+0000","last_became_active":"2024-09-14T10:54:52.905843+0000","last_became_peered":"2024-09-14T10:54:52.905843+0000","last_unstale":"2024-09-14T10:58:23.568697+0000","last_undegraded":"2024-09-14T10:58:23.568697+0000","last_fullsized":"2024-09-14T10:58:23.568697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:23.568525+0000","last_clean_scrub_stamp":"2024-09-14T10:58:23.568525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:01.283682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061213800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.462335+0000","last_change":"2024-09-14T10:58:53.462273+0000","last_active":"2024-09-14T10:58:53.462335+0000","last_peered":"2024-09-14T10:58:53.462335+0000","last_clean":"2024-09-14T10:58:53.462335+0000","last_became_active":"2024-09-14T10:55:08.696997+0000","last_became_peered":"2024-09-14T10:55:08.696997+0000","last_unstale":"2024-09-14T10:58:53.462335+0000","last_undegraded":"2024-09-14T10:58:53.462335+0000","last_fullsized":"2024-09-14T10:58:53.462335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:53.462186+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.462186+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:08.865241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'76","reported_seq":153,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.436010+0000","last_change":"2024-09-14T10:59:01.435949+0000","last_active":"2024-09-14T10:59:01.436010+0000","last_peered":"2024-09-14T10:59:01.436010+0000","last_clean":"2024-09-14T10:59:01.436010+0000","last_became_active":"2024-09-14T10:55:10.706152+0000","last_became_peered":"2024-09-14T10:55:10.706152+0000","last_unstale":"2024-09-14T10:59:01.436010+0000","last_undegraded":"2024-09-14T10:59:01.436010+0000","last_fullsized":"2024-09-14T10:59:01.436010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'76","last_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_deep_scrub":"37'76","last_deep_scrub_stamp":"2024-09-14T10:59:01.435845+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.435845+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:19.503768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.681206+0000","last_change":"2024-09-14T10:59:04.681154+0000","last_active":"2024-09-14T10:59:04.681206+0000","last_peered":"2024-09-14T10:59:04.681206+0000","last_clean":"2024-09-14T10:59:04.681206+0000","last_became_active":"2024-09-14T10:55:12.716897+0000","last_became_peered":"2024-09-14T10:55:12.716897+0000","last_unstale":"2024-09-14T10:59:04.681206+0000","last_undegraded":"2024-09-14T10:59:04.681206+0000","last_fullsized":"2024-09-14T10:59:04.681206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:04.681068+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.681068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:31.995348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:22.644851+0000","last_change":"2024-09-14T10:59:22.644778+0000","last_active":"2024-09-14T10:59:22.644851+0000","last_peered":"2024-09-14T10:59:22.644851+0000","last_clean":"2024-09-14T10:59:22.644851+0000","last_became_active":"2024-09-14T10:55:14.720516+0000","last_became_peered":"2024-09-14T10:55:14.720516+0000","last_unstale":"2024-09-14T10:59:22.644851+0000","last_undegraded":"2024-09-14T10:59:22.644851+0000","last_fullsized":"2024-09-14T10:59:22.644851+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-14T10:59:22.644682+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-14T10:59:22.644682+0000","last_clean_scrub_stamp":"2024-09-14T10:59:22.644682+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:53.409623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.116613+0000","last_change":"2024-09-14T10:58:39.116558+0000","last_active":"2024-09-14T10:58:39.116613+0000","last_peered":"2024-09-14T10:58:39.116613+0000","last_clean":"2024-09-14T10:58:39.116613+0000","last_became_active":"2024-09-14T10:55:06.706228+0000","last_became_peered":"2024-09-14T10:55:06.706228+0000","last_unstale":"2024-09-14T10:58:39.116613+0000","last_undegraded":"2024-09-14T10:58:39.116613+0000","last_fullsized":"2024-09-14T10:58:39.116613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:39.116455+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.116455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:06.853633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.594205+0000","last_change":"2024-09-14T10:58:27.594149+0000","last_active":"2024-09-14T10:58:27.594205+0000","last_peered":"2024-09-14T10:58:27.594205+0000","last_clean":"2024-09-14T10:58:27.594205+0000","last_became_active":"2024-09-14T10:55:04.693546+0000","last_became_peered":"2024-09-14T10:55:04.693546+0000","last_unstale":"2024-09-14T10:58:27.594205+0000","last_undegraded":"2024-09-14T10:58:27.594205+0000","last_fullsized":"2024-09-14T10:58:27.594205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:27.594048+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.594048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:09.026037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.081677+0000","last_change":"2024-09-14T10:58:27.081564+0000","last_active":"2024-09-14T10:58:27.081677+0000","last_peered":"2024-09-14T10:58:27.081677+0000","last_clean":"2024-09-14T10:58:27.081677+0000","last_became_active":"2024-09-14T10:54:52.902994+0000","last_became_peered":"2024-09-14T10:54:52.902994+0000","last_unstale":"2024-09-14T10:58:27.081677+0000","last_undegraded":"2024-09-14T10:58:27.081677+0000","last_fullsized":"2024-09-14T10:58:27.081677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.081459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.081459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:54.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010834110000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.187198+0000","last_change":"2024-09-14T10:59:13.187086+0000","last_active":"2024-09-14T10:59:13.187198+0000","last_peered":"2024-09-14T10:59:13.187198+0000","last_clean":"2024-09-14T10:59:13.187198+0000","last_became_active":"2024-09-14T10:55:08.701304+0000","last_became_peered":"2024-09-14T10:55:08.701304+0000","last_unstale":"2024-09-14T10:59:13.187198+0000","last_undegraded":"2024-09-14T10:59:13.187198+0000","last_fullsized":"2024-09-14T10:59:13.187198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.186988+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.186988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:15.867651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.059645+0000","last_change":"2024-09-14T10:59:06.059580+0000","last_active":"2024-09-14T10:59:06.059645+0000","last_peered":"2024-09-14T10:59:06.059645+0000","last_clean":"2024-09-14T10:59:06.059645+0000","last_became_active":"2024-09-14T10:55:10.707211+0000","last_became_peered":"2024-09-14T10:55:10.707211+0000","last_unstale":"2024-09-14T10:59:06.059645+0000","last_undegraded":"2024-09-14T10:59:06.059645+0000","last_fullsized":"2024-09-14T10:59:06.059645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-14T10:59:06.059473+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.059473+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:52.359073+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":359,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.929779+0000","last_change":"2024-09-14T10:59:10.929681+0000","last_active":"2024-09-14T10:59:10.929779+0000","last_peered":"2024-09-14T10:59:10.929779+0000","last_clean":"2024-09-14T10:59:10.929779+0000","last_became_active":"2024-09-14T10:55:12.709803+0000","last_became_peered":"2024-09-14T10:55:12.709803+0000","last_unstale":"2024-09-14T10:59:10.929779+0000","last_undegraded":"2024-09-14T10:59:10.929779+0000","last_fullsized":"2024-09-14T10:59:10.929779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.929558+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.929558+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:32.946072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:42.417344+0000","last_change":"2024-09-14T10:59:42.417284+0000","last_active":"2024-09-14T10:59:42.417344+0000","last_peered":"2024-09-14T10:59:42.417344+0000","last_clean":"2024-09-14T10:59:42.417344+0000","last_became_active":"2024-09-14T10:55:14.730195+0000","last_became_peered":"2024-09-14T10:55:14.730195+0000","last_unstale":"2024-09-14T10:59:42.417344+0000","last_undegraded":"2024-09-14T10:59:42.417344+0000","last_fullsized":"2024-09-14T10:59:42.417344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:42.417193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:42.417193+0000","last_clean_scrub_stamp":"2024-09-14T10:59:42.417193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:01.628550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.238769+0000","last_change":"2024-09-14T10:58:53.238709+0000","last_active":"2024-09-14T10:58:53.238769+0000","last_peered":"2024-09-14T10:58:53.238769+0000","last_clean":"2024-09-14T10:58:53.238769+0000","last_became_active":"2024-09-14T10:55:06.700032+0000","last_became_peered":"2024-09-14T10:55:06.700032+0000","last_unstale":"2024-09-14T10:58:53.238769+0000","last_undegraded":"2024-09-14T10:58:53.238769+0000","last_fullsized":"2024-09-14T10:58:53.238769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:53.238622+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.238622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:29.890586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.116649+0000","last_change":"2024-09-14T10:58:31.116581+0000","last_active":"2024-09-14T10:58:31.116649+0000","last_peered":"2024-09-14T10:58:31.116649+0000","last_clean":"2024-09-14T10:58:31.116649+0000","last_became_active":"2024-09-14T10:55:04.700975+0000","last_became_peered":"2024-09-14T10:55:04.700975+0000","last_unstale":"2024-09-14T10:58:31.116649+0000","last_undegraded":"2024-09-14T10:58:31.116649+0000","last_fullsized":"2024-09-14T10:58:31.116649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.116494+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.116494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:34.643323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:24.589321+0000","last_change":"2024-09-14T10:58:24.589271+0000","last_active":"2024-09-14T10:58:24.589321+0000","last_peered":"2024-09-14T10:58:24.589321+0000","last_clean":"2024-09-14T10:58:24.589321+0000","last_became_active":"2024-09-14T10:54:52.903476+0000","last_became_peered":"2024-09-14T10:54:52.903476+0000","last_unstale":"2024-09-14T10:58:24.589321+0000","last_undegraded":"2024-09-14T10:58:24.589321+0000","last_fullsized":"2024-09-14T10:58:24.589321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:24.589189+0000","last_clean_scrub_stamp":"2024-09-14T10:58:24.589189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:10.074498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057376699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.205725+0000","last_change":"2024-09-14T10:59:12.205661+0000","last_active":"2024-09-14T10:59:12.205725+0000","last_peered":"2024-09-14T10:59:12.205725+0000","last_clean":"2024-09-14T10:59:12.205725+0000","last_became_active":"2024-09-14T10:55:08.703243+0000","last_became_peered":"2024-09-14T10:55:08.703243+0000","last_unstale":"2024-09-14T10:59:12.205725+0000","last_undegraded":"2024-09-14T10:59:12.205725+0000","last_fullsized":"2024-09-14T10:59:12.205725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:12.205517+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.205517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:58.866367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:20.359398+0000","last_change":"2024-09-14T10:59:20.359321+0000","last_active":"2024-09-14T10:59:20.359398+0000","last_peered":"2024-09-14T10:59:20.359398+0000","last_clean":"2024-09-14T10:59:20.359398+0000","last_became_active":"2024-09-14T10:55:10.714447+0000","last_became_peered":"2024-09-14T10:55:10.714447+0000","last_unstale":"2024-09-14T10:59:20.359398+0000","last_undegraded":"2024-09-14T10:59:20.359398+0000","last_fullsized":"2024-09-14T10:59:20.359398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-14T10:59:20.359218+0000","last_clean_scrub_stamp":"2024-09-14T10:59:20.359218+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:25.021682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":402,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.493282+0000","last_change":"2024-09-14T10:59:13.493228+0000","last_active":"2024-09-14T10:59:13.493282+0000","last_peered":"2024-09-14T10:59:13.493282+0000","last_clean":"2024-09-14T10:59:13.493282+0000","last_became_active":"2024-09-14T10:55:12.718951+0000","last_became_peered":"2024-09-14T10:55:12.718951+0000","last_unstale":"2024-09-14T10:59:13.493282+0000","last_undegraded":"2024-09-14T10:59:13.493282+0000","last_fullsized":"2024-09-14T10:59:13.493282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:13.493141+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.493141+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:03.120118+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'8","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:21.843342+0000","last_change":"2024-09-14T10:59:21.843260+0000","last_active":"2024-09-14T10:59:21.843342+0000","last_peered":"2024-09-14T10:59:21.843342+0000","last_clean":"2024-09-14T10:59:21.843342+0000","last_became_active":"2024-09-14T10:55:14.729000+0000","last_became_peered":"2024-09-14T10:55:14.729000+0000","last_unstale":"2024-09-14T10:59:21.843342+0000","last_undegraded":"2024-09-14T10:59:21.843342+0000","last_fullsized":"2024-09-14T10:59:21.843342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:21.843177+0000","last_clean_scrub_stamp":"2024-09-14T10:59:21.843177+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:05.873379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'18","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:38.746067+0000","last_change":"2024-09-14T10:58:38.745965+0000","last_active":"2024-09-14T10:58:38.746067+0000","last_peered":"2024-09-14T10:58:38.746067+0000","last_clean":"2024-09-14T10:58:38.746067+0000","last_became_active":"2024-09-14T10:55:06.695992+0000","last_became_peered":"2024-09-14T10:55:06.695992+0000","last_unstale":"2024-09-14T10:58:38.746067+0000","last_undegraded":"2024-09-14T10:58:38.746067+0000","last_fullsized":"2024-09-14T10:58:38.746067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:58:38.745855+0000","last_clean_scrub_stamp":"2024-09-14T10:58:38.745855+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:52.592315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":51,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:26.289716+0000","last_change":"2024-09-14T10:58:26.289652+0000","last_active":"2024-09-14T10:58:26.289716+0000","last_peered":"2024-09-14T10:58:26.289716+0000","last_clean":"2024-09-14T10:58:26.289716+0000","last_became_active":"2024-09-14T10:55:04.710950+0000","last_became_peered":"2024-09-14T10:55:04.710950+0000","last_unstale":"2024-09-14T10:58:26.289716+0000","last_undegraded":"2024-09-14T10:58:26.289716+0000","last_fullsized":"2024-09-14T10:58:26.289716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:26.289566+0000","last_clean_scrub_stamp":"2024-09-14T10:58:26.289566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:30:43.279373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.103763+0000","last_change":"2024-09-14T10:58:29.103701+0000","last_active":"2024-09-14T10:58:29.103763+0000","last_peered":"2024-09-14T10:58:29.103763+0000","last_clean":"2024-09-14T10:58:29.103763+0000","last_became_active":"2024-09-14T10:54:52.903618+0000","last_became_peered":"2024-09-14T10:54:52.903618+0000","last_unstale":"2024-09-14T10:58:29.103763+0000","last_undegraded":"2024-09-14T10:58:29.103763+0000","last_fullsized":"2024-09-14T10:58:29.103763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.103624+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.103624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:04.088102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013241360000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:11.222060+0000","last_change":"2024-09-14T10:59:11.221996+0000","last_active":"2024-09-14T10:59:11.222060+0000","last_peered":"2024-09-14T10:59:11.222060+0000","last_clean":"2024-09-14T10:59:11.222060+0000","last_became_active":"2024-09-14T10:55:08.702466+0000","last_became_peered":"2024-09-14T10:55:08.702466+0000","last_unstale":"2024-09-14T10:59:11.222060+0000","last_undegraded":"2024-09-14T10:59:11.222060+0000","last_fullsized":"2024-09-14T10:59:11.222060+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:11.221910+0000","last_clean_scrub_stamp":"2024-09-14T10:59:11.221910+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:56.327449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'101","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:56.691560+0000","last_change":"2024-09-14T10:58:56.691503+0000","last_active":"2024-09-14T10:58:56.691560+0000","last_peered":"2024-09-14T10:58:56.691560+0000","last_clean":"2024-09-14T10:58:56.691560+0000","last_became_active":"2024-09-14T10:55:10.705833+0000","last_became_peered":"2024-09-14T10:55:10.705833+0000","last_unstale":"2024-09-14T10:58:56.691560+0000","last_undegraded":"2024-09-14T10:58:56.691560+0000","last_fullsized":"2024-09-14T10:58:56.691560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'101","last_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_deep_scrub":"37'101","last_deep_scrub_stamp":"2024-09-14T10:58:56.691401+0000","last_clean_scrub_stamp":"2024-09-14T10:58:56.691401+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:40.292482+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.423604+0000","last_change":"2024-09-14T10:59:06.423553+0000","last_active":"2024-09-14T10:59:06.423604+0000","last_peered":"2024-09-14T10:59:06.423604+0000","last_clean":"2024-09-14T10:59:06.423604+0000","last_became_active":"2024-09-14T10:55:12.717624+0000","last_became_peered":"2024-09-14T10:55:12.717624+0000","last_unstale":"2024-09-14T10:59:06.423604+0000","last_undegraded":"2024-09-14T10:59:06.423604+0000","last_fullsized":"2024-09-14T10:59:06.423604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:06.423468+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.423468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:55.849051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.824538+0000","last_change":"2024-09-14T10:59:14.824478+0000","last_active":"2024-09-14T10:59:14.824538+0000","last_peered":"2024-09-14T10:59:14.824538+0000","last_clean":"2024-09-14T10:59:14.824538+0000","last_became_active":"2024-09-14T10:55:14.721619+0000","last_became_peered":"2024-09-14T10:55:14.721619+0000","last_unstale":"2024-09-14T10:59:14.824538+0000","last_undegraded":"2024-09-14T10:59:14.824538+0000","last_fullsized":"2024-09-14T10:59:14.824538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.824378+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.824378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:39.981806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.895503+0000","last_change":"2024-09-14T10:59:16.895449+0000","last_active":"2024-09-14T10:59:16.895503+0000","last_peered":"2024-09-14T10:59:16.895503+0000","last_clean":"2024-09-14T10:59:16.895503+0000","last_became_active":"2024-09-14T10:55:14.723830+0000","last_became_peered":"2024-09-14T10:55:14.723830+0000","last_unstale":"2024-09-14T10:59:16.895503+0000","last_undegraded":"2024-09-14T10:59:16.895503+0000","last_fullsized":"2024-09-14T10:59:16.895503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:16.895366+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.895366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.067531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'8","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.732441+0000","last_change":"2024-09-14T10:58:42.732352+0000","last_active":"2024-09-14T10:58:42.732441+0000","last_peered":"2024-09-14T10:58:42.732441+0000","last_clean":"2024-09-14T10:58:42.732441+0000","last_became_active":"2024-09-14T10:55:06.703842+0000","last_became_peered":"2024-09-14T10:55:06.703842+0000","last_unstale":"2024-09-14T10:58:42.732441+0000","last_undegraded":"2024-09-14T10:58:42.732441+0000","last_fullsized":"2024-09-14T10:58:42.732441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:42.732246+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.732246+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:14.466351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.177654+0000","last_change":"2024-09-14T10:58:41.177563+0000","last_active":"2024-09-14T10:58:41.177654+0000","last_peered":"2024-09-14T10:58:41.177654+0000","last_clean":"2024-09-14T10:58:41.177654+0000","last_became_active":"2024-09-14T10:55:04.708281+0000","last_became_peered":"2024-09-14T10:55:04.708281+0000","last_unstale":"2024-09-14T10:58:41.177654+0000","last_undegraded":"2024-09-14T10:58:41.177654+0000","last_fullsized":"2024-09-14T10:58:41.177654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:41.177454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.177454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:25.761471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.069121+0000","last_change":"2024-09-14T10:59:00.069060+0000","last_active":"2024-09-14T10:59:00.069121+0000","last_peered":"2024-09-14T10:59:00.069121+0000","last_clean":"2024-09-14T10:59:00.069121+0000","last_became_active":"2024-09-14T10:55:41.753457+0000","last_became_peered":"2024-09-14T10:55:41.753457+0000","last_unstale":"2024-09-14T10:59:00.069121+0000","last_undegraded":"2024-09-14T10:59:00.069121+0000","last_fullsized":"2024-09-14T10:59:00.069121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.068976+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.068976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:01.384012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:26.415814+0000","last_change":"2024-09-14T10:59:26.415749+0000","last_active":"2024-09-14T10:59:26.415814+0000","last_peered":"2024-09-14T10:59:26.415814+0000","last_clean":"2024-09-14T10:59:26.415814+0000","last_became_active":"2024-09-14T10:55:10.711828+0000","last_became_peered":"2024-09-14T10:55:10.711828+0000","last_unstale":"2024-09-14T10:59:26.415814+0000","last_undegraded":"2024-09-14T10:59:26.415814+0000","last_fullsized":"2024-09-14T10:59:26.415814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:26.415644+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:26.415644+0000","last_clean_scrub_stamp":"2024-09-14T10:59:26.415644+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:05.731325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:36.496850+0000","last_change":"2024-09-14T10:59:36.496725+0000","last_active":"2024-09-14T10:59:36.496850+0000","last_peered":"2024-09-14T10:59:36.496850+0000","last_clean":"2024-09-14T10:59:36.496850+0000","last_became_active":"2024-09-14T10:55:12.721665+0000","last_became_peered":"2024-09-14T10:55:12.721665+0000","last_unstale":"2024-09-14T10:59:36.496850+0000","last_undegraded":"2024-09-14T10:59:36.496850+0000","last_fullsized":"2024-09-14T10:59:36.496850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:36.496614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:36.496614+0000","last_clean_scrub_stamp":"2024-09-14T10:59:36.496614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:54.201020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:26.682919+0000","last_change":"2024-09-14T10:59:26.682919+0000","last_active":"2024-09-14T10:59:26.682919+0000","last_peered":"2024-09-14T10:59:26.682919+0000","last_clean":"2024-09-14T10:59:26.682919+0000","last_became_active":"2024-09-14T10:55:14.718023+0000","last_became_peered":"2024-09-14T10:55:14.718023+0000","last_unstale":"2024-09-14T10:59:26.682919+0000","last_undegraded":"2024-09-14T10:59:26.682919+0000","last_fullsized":"2024-09-14T10:59:26.682919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:26.682791+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:26.682791+0000","last_clean_scrub_stamp":"2024-09-14T10:59:26.682791+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:33.070183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'4","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.081071+0000","last_change":"2024-09-14T10:58:43.081008+0000","last_active":"2024-09-14T10:58:43.081071+0000","last_peered":"2024-09-14T10:58:43.081071+0000","last_clean":"2024-09-14T10:58:43.081071+0000","last_became_active":"2024-09-14T10:55:06.706577+0000","last_became_peered":"2024-09-14T10:55:06.706577+0000","last_unstale":"2024-09-14T10:58:43.081071+0000","last_undegraded":"2024-09-14T10:58:43.081071+0000","last_fullsized":"2024-09-14T10:58:43.081071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:43.080921+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.080921+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:50.785770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.775357+0000","last_change":"2024-09-14T10:58:30.775299+0000","last_active":"2024-09-14T10:58:30.775357+0000","last_peered":"2024-09-14T10:58:30.775357+0000","last_clean":"2024-09-14T10:58:30.775357+0000","last_became_active":"2024-09-14T10:55:04.701100+0000","last_became_peered":"2024-09-14T10:55:04.701100+0000","last_unstale":"2024-09-14T10:58:30.775357+0000","last_undegraded":"2024-09-14T10:58:30.775357+0000","last_fullsized":"2024-09-14T10:58:30.775357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:30.775211+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.775211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:47.614898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.294477+0000","last_change":"2024-09-14T10:59:17.294422+0000","last_active":"2024-09-14T10:59:17.294477+0000","last_peered":"2024-09-14T10:59:17.294477+0000","last_clean":"2024-09-14T10:59:17.294477+0000","last_became_active":"2024-09-14T10:55:08.701652+0000","last_became_peered":"2024-09-14T10:55:08.701652+0000","last_unstale":"2024-09-14T10:59:17.294477+0000","last_undegraded":"2024-09-14T10:59:17.294477+0000","last_fullsized":"2024-09-14T10:59:17.294477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.294339+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.294339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:41.287665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.451007+0000","last_change":"2024-09-14T10:59:05.450923+0000","last_active":"2024-09-14T10:59:05.451007+0000","last_peered":"2024-09-14T10:59:05.451007+0000","last_clean":"2024-09-14T10:59:05.451007+0000","last_became_active":"2024-09-14T10:55:10.703387+0000","last_became_peered":"2024-09-14T10:55:10.703387+0000","last_unstale":"2024-09-14T10:59:05.451007+0000","last_undegraded":"2024-09-14T10:59:05.451007+0000","last_fullsized":"2024-09-14T10:59:05.451007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:05.450828+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.450828+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:02.547681+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.721840+0000","last_change":"2024-09-14T10:59:07.721772+0000","last_active":"2024-09-14T10:59:07.721840+0000","last_peered":"2024-09-14T10:59:07.721840+0000","last_clean":"2024-09-14T10:59:07.721840+0000","last_became_active":"2024-09-14T10:55:12.721742+0000","last_became_peered":"2024-09-14T10:55:12.721742+0000","last_unstale":"2024-09-14T10:59:07.721840+0000","last_undegraded":"2024-09-14T10:59:07.721840+0000","last_fullsized":"2024-09-14T10:59:07.721840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:07.721683+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.721683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:53.356436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:25.658476+0000","last_change":"2024-09-14T10:59:25.658476+0000","last_active":"2024-09-14T10:59:25.658476+0000","last_peered":"2024-09-14T10:59:25.658476+0000","last_clean":"2024-09-14T10:59:25.658476+0000","last_became_active":"2024-09-14T10:55:14.721771+0000","last_became_peered":"2024-09-14T10:55:14.721771+0000","last_unstale":"2024-09-14T10:59:25.658476+0000","last_undegraded":"2024-09-14T10:59:25.658476+0000","last_fullsized":"2024-09-14T10:59:25.658476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:25.658402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:25.658402+0000","last_clean_scrub_stamp":"2024-09-14T10:59:25.658402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:22.419520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:41.535512+0000","last_change":"2024-09-14T10:58:41.535431+0000","last_active":"2024-09-14T10:58:41.535512+0000","last_peered":"2024-09-14T10:58:41.535512+0000","last_clean":"2024-09-14T10:58:41.535512+0000","last_became_active":"2024-09-14T10:55:06.693668+0000","last_became_peered":"2024-09-14T10:55:06.693668+0000","last_unstale":"2024-09-14T10:58:41.535512+0000","last_undegraded":"2024-09-14T10:58:41.535512+0000","last_fullsized":"2024-09-14T10:58:41.535512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:41.535348+0000","last_clean_scrub_stamp":"2024-09-14T10:58:41.535348+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:23.024244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.788441+0000","last_change":"2024-09-14T10:58:29.788388+0000","last_active":"2024-09-14T10:58:29.788441+0000","last_peered":"2024-09-14T10:58:29.788441+0000","last_clean":"2024-09-14T10:58:29.788441+0000","last_became_active":"2024-09-14T10:55:04.694465+0000","last_became_peered":"2024-09-14T10:55:04.694465+0000","last_unstale":"2024-09-14T10:58:29.788441+0000","last_undegraded":"2024-09-14T10:58:29.788441+0000","last_fullsized":"2024-09-14T10:58:29.788441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.788303+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.788303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:32.833510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:52.684710+0000","last_change":"2024-09-14T10:58:52.684626+0000","last_active":"2024-09-14T10:58:52.684710+0000","last_peered":"2024-09-14T10:58:52.684710+0000","last_clean":"2024-09-14T10:58:52.684710+0000","last_became_active":"2024-09-14T10:55:08.705969+0000","last_became_peered":"2024-09-14T10:55:08.705969+0000","last_unstale":"2024-09-14T10:58:52.684710+0000","last_undegraded":"2024-09-14T10:58:52.684710+0000","last_fullsized":"2024-09-14T10:58:52.684710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:52.684528+0000","last_clean_scrub_stamp":"2024-09-14T10:58:52.684528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:48.491610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'49","reported_seq":122,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.435705+0000","last_change":"2024-09-14T10:59:02.435649+0000","last_active":"2024-09-14T10:59:02.435705+0000","last_peered":"2024-09-14T10:59:02.435705+0000","last_clean":"2024-09-14T10:59:02.435705+0000","last_became_active":"2024-09-14T10:55:10.704311+0000","last_became_peered":"2024-09-14T10:55:10.704311+0000","last_unstale":"2024-09-14T10:59:02.435705+0000","last_undegraded":"2024-09-14T10:59:02.435705+0000","last_fullsized":"2024-09-14T10:59:02.435705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-14T10:59:02.435554+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.435554+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:13.499863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:13.855165+0000","last_change":"2024-09-14T10:59:13.855092+0000","last_active":"2024-09-14T10:59:13.855165+0000","last_peered":"2024-09-14T10:59:13.855165+0000","last_clean":"2024-09-14T10:59:13.855165+0000","last_became_active":"2024-09-14T10:55:12.711988+0000","last_became_peered":"2024-09-14T10:55:12.711988+0000","last_unstale":"2024-09-14T10:59:13.855165+0000","last_undegraded":"2024-09-14T10:59:13.855165+0000","last_fullsized":"2024-09-14T10:59:13.855165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:13.855007+0000","last_clean_scrub_stamp":"2024-09-14T10:59:13.855007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:01.983456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:48.474088+0000","last_change":"2024-09-14T10:59:48.474088+0000","last_active":"2024-09-14T10:59:48.474088+0000","last_peered":"2024-09-14T10:59:48.474088+0000","last_clean":"2024-09-14T10:59:48.474088+0000","last_became_active":"2024-09-14T10:55:14.730510+0000","last_became_peered":"2024-09-14T10:55:14.730510+0000","last_unstale":"2024-09-14T10:59:48.474088+0000","last_undegraded":"2024-09-14T10:59:48.474088+0000","last_fullsized":"2024-09-14T10:59:48.474088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:59:48.473997+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:59:48.473997+0000","last_clean_scrub_stamp":"2024-09-14T10:59:48.473997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:01.728697+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:58.289156+0000","last_change":"2024-09-14T10:58:58.289056+0000","last_active":"2024-09-14T10:58:58.289156+0000","last_peered":"2024-09-14T10:58:58.289156+0000","last_clean":"2024-09-14T10:58:58.289156+0000","last_became_active":"2024-09-14T10:55:06.699685+0000","last_became_peered":"2024-09-14T10:55:06.699685+0000","last_unstale":"2024-09-14T10:58:58.289156+0000","last_undegraded":"2024-09-14T10:58:58.289156+0000","last_fullsized":"2024-09-14T10:58:58.289156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:58.288955+0000","last_clean_scrub_stamp":"2024-09-14T10:58:58.288955+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.787124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:29.206991+0000","last_change":"2024-09-14T10:58:29.206920+0000","last_active":"2024-09-14T10:58:29.206991+0000","last_peered":"2024-09-14T10:58:29.206991+0000","last_clean":"2024-09-14T10:58:29.206991+0000","last_became_active":"2024-09-14T10:55:04.698591+0000","last_became_peered":"2024-09-14T10:55:04.698591+0000","last_unstale":"2024-09-14T10:58:29.206991+0000","last_undegraded":"2024-09-14T10:58:29.206991+0000","last_fullsized":"2024-09-14T10:58:29.206991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:29.206835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:29.206835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:53.545366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.247351+0000","last_change":"2024-09-14T10:59:16.247242+0000","last_active":"2024-09-14T10:59:16.247351+0000","last_peered":"2024-09-14T10:59:16.247351+0000","last_clean":"2024-09-14T10:59:16.247351+0000","last_became_active":"2024-09-14T10:55:08.698318+0000","last_became_peered":"2024-09-14T10:55:08.698318+0000","last_unstale":"2024-09-14T10:59:16.247351+0000","last_undegraded":"2024-09-14T10:59:16.247351+0000","last_fullsized":"2024-09-14T10:59:16.247351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.247150+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.247150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:52.172918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'38","reported_seq":94,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.665842+0000","last_change":"2024-09-14T10:59:01.665776+0000","last_active":"2024-09-14T10:59:01.665842+0000","last_peered":"2024-09-14T10:59:01.665842+0000","last_clean":"2024-09-14T10:59:01.665842+0000","last_became_active":"2024-09-14T10:55:10.702356+0000","last_became_peered":"2024-09-14T10:55:10.702356+0000","last_unstale":"2024-09-14T10:59:01.665842+0000","last_undegraded":"2024-09-14T10:59:01.665842+0000","last_fullsized":"2024-09-14T10:59:01.665842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'38","last_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_deep_scrub":"37'38","last_deep_scrub_stamp":"2024-09-14T10:59:01.665619+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.665619+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:22.301986+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:08.686983+0000","last_change":"2024-09-14T10:59:08.686929+0000","last_active":"2024-09-14T10:59:08.686983+0000","last_peered":"2024-09-14T10:59:08.686983+0000","last_clean":"2024-09-14T10:59:08.686983+0000","last_became_active":"2024-09-14T10:55:12.718259+0000","last_became_peered":"2024-09-14T10:55:12.718259+0000","last_unstale":"2024-09-14T10:59:08.686983+0000","last_undegraded":"2024-09-14T10:59:08.686983+0000","last_fullsized":"2024-09-14T10:59:08.686983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:08.686815+0000","last_clean_scrub_stamp":"2024-09-14T10:59:08.686815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:37.922629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.311192+0000","last_change":"2024-09-14T10:59:03.311089+0000","last_active":"2024-09-14T10:59:03.311192+0000","last_peered":"2024-09-14T10:59:03.311192+0000","last_clean":"2024-09-14T10:59:03.311192+0000","last_became_active":"2024-09-14T10:55:06.688095+0000","last_became_peered":"2024-09-14T10:55:06.688095+0000","last_unstale":"2024-09-14T10:59:03.311192+0000","last_undegraded":"2024-09-14T10:59:03.311192+0000","last_fullsized":"2024-09-14T10:59:03.311192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:03.310960+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.310960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:10:15.706209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:39.107621+0000","last_change":"2024-09-14T10:58:39.107566+0000","last_active":"2024-09-14T10:58:39.107621+0000","last_peered":"2024-09-14T10:58:39.107621+0000","last_clean":"2024-09-14T10:58:39.107621+0000","last_became_active":"2024-09-14T10:55:04.708682+0000","last_became_peered":"2024-09-14T10:55:04.708682+0000","last_unstale":"2024-09-14T10:58:39.107621+0000","last_undegraded":"2024-09-14T10:58:39.107621+0000","last_fullsized":"2024-09-14T10:58:39.107621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:39.107454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:39.107454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:43.832399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:00.451636+0000","last_change":"2024-09-14T10:59:00.451569+0000","last_active":"2024-09-14T10:59:00.451636+0000","last_peered":"2024-09-14T10:59:00.451636+0000","last_clean":"2024-09-14T10:59:00.451636+0000","last_became_active":"2024-09-14T10:55:08.696823+0000","last_became_peered":"2024-09-14T10:55:08.696823+0000","last_unstale":"2024-09-14T10:59:00.451636+0000","last_undegraded":"2024-09-14T10:59:00.451636+0000","last_fullsized":"2024-09-14T10:59:00.451636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:00.451469+0000","last_clean_scrub_stamp":"2024-09-14T10:59:00.451469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:40.073007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'65","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.484527+0000","last_change":"2024-09-14T10:59:03.484527+0000","last_active":"2024-09-14T10:59:03.484527+0000","last_peered":"2024-09-14T10:59:03.484527+0000","last_clean":"2024-09-14T10:59:03.484527+0000","last_became_active":"2024-09-14T10:55:10.703383+0000","last_became_peered":"2024-09-14T10:55:10.703383+0000","last_unstale":"2024-09-14T10:59:03.484527+0000","last_undegraded":"2024-09-14T10:59:03.484527+0000","last_fullsized":"2024-09-14T10:59:03.484527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-09-14T10:59:03.484426+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.484426+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.066126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.696165+0000","last_change":"2024-09-14T10:59:09.696165+0000","last_active":"2024-09-14T10:59:09.696165+0000","last_peered":"2024-09-14T10:59:09.696165+0000","last_clean":"2024-09-14T10:59:09.696165+0000","last_became_active":"2024-09-14T10:55:12.717234+0000","last_became_peered":"2024-09-14T10:55:12.717234+0000","last_unstale":"2024-09-14T10:59:09.696165+0000","last_undegraded":"2024-09-14T10:59:09.696165+0000","last_fullsized":"2024-09-14T10:59:09.696165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:09.696077+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.696077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:53.945948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.650386+0000","last_change":"2024-09-14T10:59:23.650298+0000","last_active":"2024-09-14T10:59:23.650386+0000","last_peered":"2024-09-14T10:59:23.650386+0000","last_clean":"2024-09-14T10:59:23.650386+0000","last_became_active":"2024-09-14T10:55:14.721938+0000","last_became_peered":"2024-09-14T10:55:14.721938+0000","last_unstale":"2024-09-14T10:59:23.650386+0000","last_undegraded":"2024-09-14T10:59:23.650386+0000","last_fullsized":"2024-09-14T10:59:23.650386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:23.650194+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:23.650194+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.650194+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:09.579587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.518559+0000","last_change":"2024-09-14T10:58:43.518493+0000","last_active":"2024-09-14T10:58:43.518559+0000","last_peered":"2024-09-14T10:58:43.518559+0000","last_clean":"2024-09-14T10:58:43.518559+0000","last_became_active":"2024-09-14T10:55:06.697212+0000","last_became_peered":"2024-09-14T10:55:06.697212+0000","last_unstale":"2024-09-14T10:58:43.518559+0000","last_undegraded":"2024-09-14T10:58:43.518559+0000","last_fullsized":"2024-09-14T10:58:43.518559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.518393+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.518393+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:29.224226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.217112+0000","last_change":"2024-09-14T10:58:28.217001+0000","last_active":"2024-09-14T10:58:28.217112+0000","last_peered":"2024-09-14T10:58:28.217112+0000","last_clean":"2024-09-14T10:58:28.217112+0000","last_became_active":"2024-09-14T10:55:04.709340+0000","last_became_peered":"2024-09-14T10:55:04.709340+0000","last_unstale":"2024-09-14T10:58:28.217112+0000","last_undegraded":"2024-09-14T10:58:28.217112+0000","last_fullsized":"2024-09-14T10:58:28.217112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:28.216899+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.216899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:59.951004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:54.664202+0000","last_change":"2024-09-14T10:58:54.664147+0000","last_active":"2024-09-14T10:58:54.664202+0000","last_peered":"2024-09-14T10:58:54.664202+0000","last_clean":"2024-09-14T10:58:54.664202+0000","last_became_active":"2024-09-14T10:55:08.699252+0000","last_became_peered":"2024-09-14T10:55:08.699252+0000","last_unstale":"2024-09-14T10:58:54.664202+0000","last_undegraded":"2024-09-14T10:58:54.664202+0000","last_fullsized":"2024-09-14T10:58:54.664202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:54.664065+0000","last_clean_scrub_stamp":"2024-09-14T10:58:54.664065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:15.688027+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:31.476206+0000","last_change":"2024-09-14T10:59:31.476206+0000","last_active":"2024-09-14T10:59:31.476206+0000","last_peered":"2024-09-14T10:59:31.476206+0000","last_clean":"2024-09-14T10:59:31.476206+0000","last_became_active":"2024-09-14T10:55:10.712638+0000","last_became_peered":"2024-09-14T10:55:10.712638+0000","last_unstale":"2024-09-14T10:59:31.476206+0000","last_undegraded":"2024-09-14T10:59:31.476206+0000","last_fullsized":"2024-09-14T10:59:31.476206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:31.476106+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:31.476106+0000","last_clean_scrub_stamp":"2024-09-14T10:59:31.476106+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:39.449223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:16.854224+0000","last_change":"2024-09-14T10:59:16.854224+0000","last_active":"2024-09-14T10:59:16.854224+0000","last_peered":"2024-09-14T10:59:16.854224+0000","last_clean":"2024-09-14T10:59:16.854224+0000","last_became_active":"2024-09-14T10:55:12.719248+0000","last_became_peered":"2024-09-14T10:55:12.719248+0000","last_unstale":"2024-09-14T10:59:16.854224+0000","last_undegraded":"2024-09-14T10:59:16.854224+0000","last_fullsized":"2024-09-14T10:59:16.854224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:16.854142+0000","last_clean_scrub_stamp":"2024-09-14T10:59:16.854142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:52:20.380972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"37'8","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:45.436727+0000","last_change":"2024-09-14T10:59:45.436658+0000","last_active":"2024-09-14T10:59:45.436727+0000","last_peered":"2024-09-14T10:59:45.436727+0000","last_clean":"2024-09-14T10:59:45.436727+0000","last_became_active":"2024-09-14T10:55:14.728709+0000","last_became_peered":"2024-09-14T10:55:14.728709+0000","last_unstale":"2024-09-14T10:59:45.436727+0000","last_undegraded":"2024-09-14T10:59:45.436727+0000","last_fullsized":"2024-09-14T10:59:45.436727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:45.436559+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:45.436559+0000","last_clean_scrub_stamp":"2024-09-14T10:59:45.436559+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:37.908827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'18","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.344968+0000","last_change":"2024-09-14T10:59:04.344968+0000","last_active":"2024-09-14T10:59:04.344968+0000","last_peered":"2024-09-14T10:59:04.344968+0000","last_clean":"2024-09-14T10:59:04.344968+0000","last_became_active":"2024-09-14T10:55:06.700214+0000","last_became_peered":"2024-09-14T10:55:06.700214+0000","last_unstale":"2024-09-14T10:59:04.344968+0000","last_undegraded":"2024-09-14T10:59:04.344968+0000","last_fullsized":"2024-09-14T10:59:04.344968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'18","last_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_deep_scrub":"37'18","last_deep_scrub_stamp":"2024-09-14T10:59:04.344883+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.344883+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.737716+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:27.239940+0000","last_change":"2024-09-14T10:58:27.239940+0000","last_active":"2024-09-14T10:58:27.239940+0000","last_peered":"2024-09-14T10:58:27.239940+0000","last_clean":"2024-09-14T10:58:27.239940+0000","last_became_active":"2024-09-14T10:55:04.710746+0000","last_became_peered":"2024-09-14T10:55:04.710746+0000","last_unstale":"2024-09-14T10:58:27.239940+0000","last_undegraded":"2024-09-14T10:58:27.239940+0000","last_fullsized":"2024-09-14T10:58:27.239940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:27.239835+0000","last_clean_scrub_stamp":"2024-09-14T10:58:27.239835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:20.526619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:53.649814+0000","last_change":"2024-09-14T10:58:53.649814+0000","last_active":"2024-09-14T10:58:53.649814+0000","last_peered":"2024-09-14T10:58:53.649814+0000","last_clean":"2024-09-14T10:58:53.649814+0000","last_became_active":"2024-09-14T10:55:08.696461+0000","last_became_peered":"2024-09-14T10:55:08.696461+0000","last_unstale":"2024-09-14T10:58:53.649814+0000","last_undegraded":"2024-09-14T10:58:53.649814+0000","last_fullsized":"2024-09-14T10:58:53.649814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:53.649710+0000","last_clean_scrub_stamp":"2024-09-14T10:58:53.649710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:50.909366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:04.477299+0000","last_change":"2024-09-14T10:59:04.477244+0000","last_active":"2024-09-14T10:59:04.477299+0000","last_peered":"2024-09-14T10:59:04.477299+0000","last_clean":"2024-09-14T10:59:04.477299+0000","last_became_active":"2024-09-14T10:55:10.712698+0000","last_became_peered":"2024-09-14T10:55:10.712698+0000","last_unstale":"2024-09-14T10:59:04.477299+0000","last_undegraded":"2024-09-14T10:59:04.477299+0000","last_fullsized":"2024-09-14T10:59:04.477299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:04.477125+0000","last_clean_scrub_stamp":"2024-09-14T10:59:04.477125+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:02.058047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:14.497609+0000","last_change":"2024-09-14T10:59:14.497556+0000","last_active":"2024-09-14T10:59:14.497609+0000","last_peered":"2024-09-14T10:59:14.497609+0000","last_clean":"2024-09-14T10:59:14.497609+0000","last_became_active":"2024-09-14T10:55:12.717797+0000","last_became_peered":"2024-09-14T10:55:12.717797+0000","last_unstale":"2024-09-14T10:59:14.497609+0000","last_undegraded":"2024-09-14T10:59:14.497609+0000","last_fullsized":"2024-09-14T10:59:14.497609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:14.497472+0000","last_clean_scrub_stamp":"2024-09-14T10:59:14.497472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:22.192393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:44.418771+0000","last_change":"2024-09-14T10:59:44.418689+0000","last_active":"2024-09-14T10:59:44.418771+0000","last_peered":"2024-09-14T10:59:44.418771+0000","last_clean":"2024-09-14T10:59:44.418771+0000","last_became_active":"2024-09-14T10:55:14.731301+0000","last_became_peered":"2024-09-14T10:55:14.731301+0000","last_unstale":"2024-09-14T10:59:44.418771+0000","last_undegraded":"2024-09-14T10:59:44.418771+0000","last_fullsized":"2024-09-14T10:59:44.418771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-14T10:59:44.418607+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-14T10:59:44.418607+0000","last_clean_scrub_stamp":"2024-09-14T10:59:44.418607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:21.595005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'8","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.487050+0000","last_change":"2024-09-14T10:58:44.487050+0000","last_active":"2024-09-14T10:58:44.487050+0000","last_peered":"2024-09-14T10:58:44.487050+0000","last_clean":"2024-09-14T10:58:44.487050+0000","last_became_active":"2024-09-14T10:55:06.687240+0000","last_became_peered":"2024-09-14T10:55:06.687240+0000","last_unstale":"2024-09-14T10:58:44.487050+0000","last_undegraded":"2024-09-14T10:58:44.487050+0000","last_fullsized":"2024-09-14T10:58:44.487050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:44.486941+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.486941+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:33.241927+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:40.153933+0000","last_change":"2024-09-14T10:58:40.153933+0000","last_active":"2024-09-14T10:58:40.153933+0000","last_peered":"2024-09-14T10:58:40.153933+0000","last_clean":"2024-09-14T10:58:40.153933+0000","last_became_active":"2024-09-14T10:55:04.705316+0000","last_became_peered":"2024-09-14T10:55:04.705316+0000","last_unstale":"2024-09-14T10:58:40.153933+0000","last_undegraded":"2024-09-14T10:58:40.153933+0000","last_fullsized":"2024-09-14T10:58:40.153933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:40.153809+0000","last_clean_scrub_stamp":"2024-09-14T10:58:40.153809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:56.955930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.058987+0000","last_change":"2024-09-14T10:59:05.058987+0000","last_active":"2024-09-14T10:59:05.058987+0000","last_peered":"2024-09-14T10:59:05.058987+0000","last_clean":"2024-09-14T10:59:05.058987+0000","last_became_active":"2024-09-14T10:55:08.700412+0000","last_became_peered":"2024-09-14T10:55:08.700412+0000","last_unstale":"2024-09-14T10:59:05.058987+0000","last_undegraded":"2024-09-14T10:59:05.058987+0000","last_fullsized":"2024-09-14T10:59:05.058987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.058900+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.058900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:57.231065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:32.500655+0000","last_change":"2024-09-14T10:59:32.500655+0000","last_active":"2024-09-14T10:59:32.500655+0000","last_peered":"2024-09-14T10:59:32.500655+0000","last_clean":"2024-09-14T10:59:32.500655+0000","last_became_active":"2024-09-14T10:55:10.715492+0000","last_became_peered":"2024-09-14T10:55:10.715492+0000","last_unstale":"2024-09-14T10:59:32.500655+0000","last_undegraded":"2024-09-14T10:59:32.500655+0000","last_fullsized":"2024-09-14T10:59:32.500655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-14T10:59:32.500550+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-14T10:59:32.500550+0000","last_clean_scrub_stamp":"2024-09-14T10:59:32.500550+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:57.728843+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:10.656144+0000","last_change":"2024-09-14T10:59:10.656083+0000","last_active":"2024-09-14T10:59:10.656144+0000","last_peered":"2024-09-14T10:59:10.656144+0000","last_clean":"2024-09-14T10:59:10.656144+0000","last_became_active":"2024-09-14T10:55:12.721233+0000","last_became_peered":"2024-09-14T10:55:12.721233+0000","last_unstale":"2024-09-14T10:59:10.656144+0000","last_undegraded":"2024-09-14T10:59:10.656144+0000","last_fullsized":"2024-09-14T10:59:10.656144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-14T10:59:10.655996+0000","last_clean_scrub_stamp":"2024-09-14T10:59:10.655996+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:02.900112+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:43.433700+0000","last_change":"2024-09-14T10:59:43.433614+0000","last_active":"2024-09-14T10:59:43.433700+0000","last_peered":"2024-09-14T10:59:43.433700+0000","last_clean":"2024-09-14T10:59:43.433700+0000","last_became_active":"2024-09-14T10:55:14.724732+0000","last_became_peered":"2024-09-14T10:55:14.724732+0000","last_unstale":"2024-09-14T10:59:43.433700+0000","last_undegraded":"2024-09-14T10:59:43.433700+0000","last_fullsized":"2024-09-14T10:59:43.433700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:43.433500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:43.433500+0000","last_clean_scrub_stamp":"2024-09-14T10:59:43.433500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:28.209091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.766566+0000","last_change":"2024-09-14T10:58:43.766566+0000","last_active":"2024-09-14T10:58:43.766566+0000","last_peered":"2024-09-14T10:58:43.766566+0000","last_clean":"2024-09-14T10:58:43.766566+0000","last_became_active":"2024-09-14T10:55:06.687433+0000","last_became_peered":"2024-09-14T10:55:06.687433+0000","last_unstale":"2024-09-14T10:58:43.766566+0000","last_undegraded":"2024-09-14T10:58:43.766566+0000","last_fullsized":"2024-09-14T10:58:43.766566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:43.766463+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.766463+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:32.340255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.227452+0000","last_change":"2024-09-14T10:58:30.227452+0000","last_active":"2024-09-14T10:58:30.227452+0000","last_peered":"2024-09-14T10:58:30.227452+0000","last_clean":"2024-09-14T10:58:30.227452+0000","last_became_active":"2024-09-14T10:55:04.697549+0000","last_became_peered":"2024-09-14T10:55:04.697549+0000","last_unstale":"2024-09-14T10:58:30.227452+0000","last_undegraded":"2024-09-14T10:58:30.227452+0000","last_fullsized":"2024-09-14T10:58:30.227452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:30.227364+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.227364+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:25.413050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:03.060577+0000","last_change":"2024-09-14T10:59:03.060577+0000","last_active":"2024-09-14T10:59:03.060577+0000","last_peered":"2024-09-14T10:59:03.060577+0000","last_clean":"2024-09-14T10:59:03.060577+0000","last_became_active":"2024-09-14T10:55:08.701401+0000","last_became_peered":"2024-09-14T10:55:08.701401+0000","last_unstale":"2024-09-14T10:59:03.060577+0000","last_undegraded":"2024-09-14T10:59:03.060577+0000","last_fullsized":"2024-09-14T10:59:03.060577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:03.060457+0000","last_clean_scrub_stamp":"2024-09-14T10:59:03.060457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:28.217885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:12.893014+0000","last_change":"2024-09-14T10:59:12.892946+0000","last_active":"2024-09-14T10:59:12.893014+0000","last_peered":"2024-09-14T10:59:12.893014+0000","last_clean":"2024-09-14T10:59:12.893014+0000","last_became_active":"2024-09-14T10:55:10.704290+0000","last_became_peered":"2024-09-14T10:55:10.704290+0000","last_unstale":"2024-09-14T10:59:12.893014+0000","last_undegraded":"2024-09-14T10:59:12.893014+0000","last_fullsized":"2024-09-14T10:59:12.893014+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-14T10:59:12.892842+0000","last_clean_scrub_stamp":"2024-09-14T10:59:12.892842+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:40.674758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:17.465590+0000","last_change":"2024-09-14T10:59:17.465590+0000","last_active":"2024-09-14T10:59:17.465590+0000","last_peered":"2024-09-14T10:59:17.465590+0000","last_clean":"2024-09-14T10:59:17.465590+0000","last_became_active":"2024-09-14T10:55:12.713737+0000","last_became_peered":"2024-09-14T10:55:12.713737+0000","last_unstale":"2024-09-14T10:59:17.465590+0000","last_undegraded":"2024-09-14T10:59:17.465590+0000","last_fullsized":"2024-09-14T10:59:17.465590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:17.465512+0000","last_clean_scrub_stamp":"2024-09-14T10:59:17.465512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:34.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'4","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:23.802685+0000","last_change":"2024-09-14T10:59:23.802685+0000","last_active":"2024-09-14T10:59:23.802685+0000","last_peered":"2024-09-14T10:59:23.802685+0000","last_clean":"2024-09-14T10:59:23.802685+0000","last_became_active":"2024-09-14T10:55:14.727083+0000","last_became_peered":"2024-09-14T10:55:14.727083+0000","last_unstale":"2024-09-14T10:59:23.802685+0000","last_undegraded":"2024-09-14T10:59:23.802685+0000","last_fullsized":"2024-09-14T10:59:23.802685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:23.802576+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:23.802576+0000","last_clean_scrub_stamp":"2024-09-14T10:59:23.802576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:13:31.390352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'14","reported_seq":91,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.735243+0000","last_change":"2024-09-14T10:58:44.735243+0000","last_active":"2024-09-14T10:58:44.735243+0000","last_peered":"2024-09-14T10:58:44.735243+0000","last_clean":"2024-09-14T10:58:44.735243+0000","last_became_active":"2024-09-14T10:55:06.687065+0000","last_became_peered":"2024-09-14T10:55:06.687065+0000","last_unstale":"2024-09-14T10:58:44.735243+0000","last_undegraded":"2024-09-14T10:58:44.735243+0000","last_fullsized":"2024-09-14T10:58:44.735243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:44.735157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.735157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:39.920842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:43.246127+0000","last_change":"2024-09-14T10:58:43.246127+0000","last_active":"2024-09-14T10:58:43.246127+0000","last_peered":"2024-09-14T10:58:43.246127+0000","last_clean":"2024-09-14T10:58:43.246127+0000","last_became_active":"2024-09-14T10:55:04.710662+0000","last_became_peered":"2024-09-14T10:55:04.710662+0000","last_unstale":"2024-09-14T10:58:43.246127+0000","last_undegraded":"2024-09-14T10:58:43.246127+0000","last_fullsized":"2024-09-14T10:58:43.246127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:43.246039+0000","last_clean_scrub_stamp":"2024-09-14T10:58:43.246039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:21.991066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:55.703082+0000","last_change":"2024-09-14T10:58:55.703082+0000","last_active":"2024-09-14T10:58:55.703082+0000","last_peered":"2024-09-14T10:58:55.703082+0000","last_clean":"2024-09-14T10:58:55.703082+0000","last_became_active":"2024-09-14T10:55:08.697029+0000","last_became_peered":"2024-09-14T10:55:08.697029+0000","last_unstale":"2024-09-14T10:58:55.703082+0000","last_undegraded":"2024-09-14T10:58:55.703082+0000","last_fullsized":"2024-09-14T10:58:55.703082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:55.702997+0000","last_clean_scrub_stamp":"2024-09-14T10:58:55.702997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:50.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:09.446733+0000","last_change":"2024-09-14T10:59:09.446674+0000","last_active":"2024-09-14T10:59:09.446733+0000","last_peered":"2024-09-14T10:59:09.446733+0000","last_clean":"2024-09-14T10:59:09.446733+0000","last_became_active":"2024-09-14T10:55:10.706139+0000","last_became_peered":"2024-09-14T10:55:10.706139+0000","last_unstale":"2024-09-14T10:59:09.446733+0000","last_undegraded":"2024-09-14T10:59:09.446733+0000","last_fullsized":"2024-09-14T10:59:09.446733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-14T10:59:09.446576+0000","last_clean_scrub_stamp":"2024-09-14T10:59:09.446576+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:39.202271+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:38.486110+0000","last_change":"2024-09-14T10:59:38.486051+0000","last_active":"2024-09-14T10:59:38.486110+0000","last_peered":"2024-09-14T10:59:38.486110+0000","last_clean":"2024-09-14T10:59:38.486110+0000","last_became_active":"2024-09-14T10:55:12.721634+0000","last_became_peered":"2024-09-14T10:55:12.721634+0000","last_unstale":"2024-09-14T10:59:38.486110+0000","last_undegraded":"2024-09-14T10:59:38.486110+0000","last_fullsized":"2024-09-14T10:59:38.486110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:38.485958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:38.485958+0000","last_clean_scrub_stamp":"2024-09-14T10:59:38.485958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:23.006097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"37'4","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:47.483050+0000","last_change":"2024-09-14T10:59:47.483050+0000","last_active":"2024-09-14T10:59:47.483050+0000","last_peered":"2024-09-14T10:59:47.483050+0000","last_clean":"2024-09-14T10:59:47.483050+0000","last_became_active":"2024-09-14T10:55:14.730017+0000","last_became_peered":"2024-09-14T10:55:14.730017+0000","last_unstale":"2024-09-14T10:59:47.483050+0000","last_undegraded":"2024-09-14T10:59:47.483050+0000","last_fullsized":"2024-09-14T10:59:47.483050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:47.482955+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:47.482955+0000","last_clean_scrub_stamp":"2024-09-14T10:59:47.482955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:16.301786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'14","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.309333+0000","last_change":"2024-09-14T10:59:01.309250+0000","last_active":"2024-09-14T10:59:01.309333+0000","last_peered":"2024-09-14T10:59:01.309333+0000","last_clean":"2024-09-14T10:59:01.309333+0000","last_became_active":"2024-09-14T10:55:06.701482+0000","last_became_peered":"2024-09-14T10:55:06.701482+0000","last_unstale":"2024-09-14T10:59:01.309333+0000","last_undegraded":"2024-09-14T10:59:01.309333+0000","last_fullsized":"2024-09-14T10:59:01.309333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:59:01.309130+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.309130+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:26.220911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:28.633930+0000","last_change":"2024-09-14T10:58:28.633837+0000","last_active":"2024-09-14T10:58:28.633930+0000","last_peered":"2024-09-14T10:58:28.633930+0000","last_clean":"2024-09-14T10:58:28.633930+0000","last_became_active":"2024-09-14T10:55:04.693634+0000","last_became_peered":"2024-09-14T10:55:04.693634+0000","last_unstale":"2024-09-14T10:58:28.633930+0000","last_undegraded":"2024-09-14T10:58:28.633930+0000","last_fullsized":"2024-09-14T10:58:28.633930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:28.633728+0000","last_clean_scrub_stamp":"2024-09-14T10:58:28.633728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:50.487848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:02.057180+0000","last_change":"2024-09-14T10:59:02.057121+0000","last_active":"2024-09-14T10:59:02.057180+0000","last_peered":"2024-09-14T10:59:02.057180+0000","last_clean":"2024-09-14T10:59:02.057180+0000","last_became_active":"2024-09-14T10:55:08.704857+0000","last_became_peered":"2024-09-14T10:55:08.704857+0000","last_unstale":"2024-09-14T10:59:02.057180+0000","last_undegraded":"2024-09-14T10:59:02.057180+0000","last_fullsized":"2024-09-14T10:59:02.057180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:02.057026+0000","last_clean_scrub_stamp":"2024-09-14T10:59:02.057026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:06.578087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'31","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:30.460209+0000","last_change":"2024-09-14T10:59:30.460209+0000","last_active":"2024-09-14T10:59:30.460209+0000","last_peered":"2024-09-14T10:59:30.460209+0000","last_clean":"2024-09-14T10:59:30.460209+0000","last_became_active":"2024-09-14T10:55:10.712650+0000","last_became_peered":"2024-09-14T10:55:10.712650+0000","last_unstale":"2024-09-14T10:59:30.460209+0000","last_undegraded":"2024-09-14T10:59:30.460209+0000","last_fullsized":"2024-09-14T10:59:30.460209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'31","last_scrub_stamp":"2024-09-14T10:59:30.460078+0000","last_deep_scrub":"37'31","last_deep_scrub_stamp":"2024-09-14T10:59:30.460078+0000","last_clean_scrub_stamp":"2024-09-14T10:59:30.460078+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:54.136403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:39.460002+0000","last_change":"2024-09-14T10:59:39.460002+0000","last_active":"2024-09-14T10:59:39.460002+0000","last_peered":"2024-09-14T10:59:39.460002+0000","last_clean":"2024-09-14T10:59:39.460002+0000","last_became_active":"2024-09-14T10:55:12.720364+0000","last_became_peered":"2024-09-14T10:55:12.720364+0000","last_unstale":"2024-09-14T10:59:39.460002+0000","last_undegraded":"2024-09-14T10:59:39.460002+0000","last_fullsized":"2024-09-14T10:59:39.460002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:39.459917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:39.459917+0000","last_clean_scrub_stamp":"2024-09-14T10:59:39.459917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.040726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:46.436033+0000","last_change":"2024-09-14T10:59:46.436033+0000","last_active":"2024-09-14T10:59:46.436033+0000","last_peered":"2024-09-14T10:59:46.436033+0000","last_clean":"2024-09-14T10:59:46.436033+0000","last_became_active":"2024-09-14T10:55:14.729858+0000","last_became_peered":"2024-09-14T10:55:14.729858+0000","last_unstale":"2024-09-14T10:59:46.436033+0000","last_undegraded":"2024-09-14T10:59:46.436033+0000","last_fullsized":"2024-09-14T10:59:46.436033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:59:46.435941+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:59:46.435941+0000","last_clean_scrub_stamp":"2024-09-14T10:59:46.435941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:49.932301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.678312+0000","last_change":"2024-09-14T10:58:47.678256+0000","last_active":"2024-09-14T10:58:47.678312+0000","last_peered":"2024-09-14T10:58:47.678312+0000","last_clean":"2024-09-14T10:58:47.678312+0000","last_became_active":"2024-09-14T10:55:06.684766+0000","last_became_peered":"2024-09-14T10:55:06.684766+0000","last_unstale":"2024-09-14T10:58:47.678312+0000","last_undegraded":"2024-09-14T10:58:47.678312+0000","last_fullsized":"2024-09-14T10:58:47.678312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:58:47.678157+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.678157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:56.701033+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'5","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.188047+0000","last_change":"2024-09-14T10:58:31.187976+0000","last_active":"2024-09-14T10:58:31.188047+0000","last_peered":"2024-09-14T10:58:31.188047+0000","last_clean":"2024-09-14T10:58:31.188047+0000","last_became_active":"2024-09-14T10:55:04.699016+0000","last_became_peered":"2024-09-14T10:55:04.699016+0000","last_unstale":"2024-09-14T10:58:31.188047+0000","last_undegraded":"2024-09-14T10:58:31.188047+0000","last_fullsized":"2024-09-14T10:58:31.188047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:58:31.187893+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.187893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:06.988528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10,"num_write":14,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'5","reported_seq":234,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:01.025673+0000","last_change":"2024-09-14T10:59:01.025603+0000","last_active":"2024-09-14T10:59:01.025673+0000","last_peered":"2024-09-14T10:59:01.025673+0000","last_clean":"2024-09-14T10:59:01.025673+0000","last_became_active":"2024-09-14T10:55:08.704329+0000","last_became_peered":"2024-09-14T10:55:08.704329+0000","last_unstale":"2024-09-14T10:59:01.025673+0000","last_undegraded":"2024-09-14T10:59:01.025673+0000","last_fullsized":"2024-09-14T10:59:01.025673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-14T10:59:01.025515+0000","last_clean_scrub_stamp":"2024-09-14T10:59:01.025515+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:21.372068+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:29.413544+0000","last_change":"2024-09-14T10:59:29.413544+0000","last_active":"2024-09-14T10:59:29.413544+0000","last_peered":"2024-09-14T10:59:29.413544+0000","last_clean":"2024-09-14T10:59:29.413544+0000","last_became_active":"2024-09-14T10:55:10.713551+0000","last_became_peered":"2024-09-14T10:55:10.713551+0000","last_unstale":"2024-09-14T10:59:29.413544+0000","last_undegraded":"2024-09-14T10:59:29.413544+0000","last_fullsized":"2024-09-14T10:59:29.413544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-14T10:59:29.413425+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-14T10:59:29.413425+0000","last_clean_scrub_stamp":"2024-09-14T10:59:29.413425+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:27.581992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:19.531591+0000","last_change":"2024-09-14T10:59:19.531591+0000","last_active":"2024-09-14T10:59:19.531591+0000","last_peered":"2024-09-14T10:59:19.531591+0000","last_clean":"2024-09-14T10:59:19.531591+0000","last_became_active":"2024-09-14T10:55:12.713977+0000","last_became_peered":"2024-09-14T10:55:12.713977+0000","last_unstale":"2024-09-14T10:59:19.531591+0000","last_undegraded":"2024-09-14T10:59:19.531591+0000","last_fullsized":"2024-09-14T10:59:19.531591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:19.531495+0000","last_clean_scrub_stamp":"2024-09-14T10:59:19.531495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:07.999761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:49.476361+0000","last_change":"2024-09-14T10:59:49.476257+0000","last_active":"2024-09-14T10:59:49.476361+0000","last_peered":"2024-09-14T10:59:49.476361+0000","last_clean":"2024-09-14T10:59:49.476361+0000","last_became_active":"2024-09-14T10:55:14.731541+0000","last_became_peered":"2024-09-14T10:55:14.731541+0000","last_unstale":"2024-09-14T10:59:49.476361+0000","last_undegraded":"2024-09-14T10:59:49.476361+0000","last_fullsized":"2024-09-14T10:59:49.476361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:59:49.476138+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:59:49.476138+0000","last_clean_scrub_stamp":"2024-09-14T10:59:49.476138+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:38.714215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'16","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.049340+0000","last_change":"2024-09-14T10:58:44.049274+0000","last_active":"2024-09-14T10:58:44.049340+0000","last_peered":"2024-09-14T10:58:44.049340+0000","last_clean":"2024-09-14T10:58:44.049340+0000","last_became_active":"2024-09-14T10:55:06.705932+0000","last_became_peered":"2024-09-14T10:55:06.705932+0000","last_unstale":"2024-09-14T10:58:44.049340+0000","last_undegraded":"2024-09-14T10:58:44.049340+0000","last_fullsized":"2024-09-14T10:58:44.049340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-14T10:58:44.049194+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.049194+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:59.063252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":72,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.769190+0000","last_change":"2024-09-14T10:58:32.769098+0000","last_active":"2024-09-14T10:58:32.769190+0000","last_peered":"2024-09-14T10:58:32.769190+0000","last_clean":"2024-09-14T10:58:32.769190+0000","last_became_active":"2024-09-14T10:55:04.691712+0000","last_became_peered":"2024-09-14T10:55:04.691712+0000","last_unstale":"2024-09-14T10:58:32.769190+0000","last_undegraded":"2024-09-14T10:58:32.769190+0000","last_fullsized":"2024-09-14T10:58:32.769190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.768987+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.768987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:20.659652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'14","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.498532+0000","last_change":"2024-09-14T10:58:48.498479+0000","last_active":"2024-09-14T10:58:48.498532+0000","last_peered":"2024-09-14T10:58:48.498532+0000","last_clean":"2024-09-14T10:58:48.498532+0000","last_became_active":"2024-09-14T10:55:06.687225+0000","last_became_peered":"2024-09-14T10:55:06.687225+0000","last_unstale":"2024-09-14T10:58:48.498532+0000","last_undegraded":"2024-09-14T10:58:48.498532+0000","last_fullsized":"2024-09-14T10:58:48.498532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:48.498391+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.498391+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:01.696592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:30.646736+0000","last_change":"2024-09-14T10:58:30.646671+0000","last_active":"2024-09-14T10:58:30.646736+0000","last_peered":"2024-09-14T10:58:30.646736+0000","last_clean":"2024-09-14T10:58:30.646736+0000","last_became_active":"2024-09-14T10:55:04.687683+0000","last_became_peered":"2024-09-14T10:55:04.687683+0000","last_unstale":"2024-09-14T10:58:30.646736+0000","last_undegraded":"2024-09-14T10:58:30.646736+0000","last_fullsized":"2024-09-14T10:58:30.646736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:30.646582+0000","last_clean_scrub_stamp":"2024-09-14T10:58:30.646582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:28.625565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'10","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:07.230732+0000","last_change":"2024-09-14T10:59:07.230667+0000","last_active":"2024-09-14T10:59:07.230732+0000","last_peered":"2024-09-14T10:59:07.230732+0000","last_clean":"2024-09-14T10:59:07.230732+0000","last_became_active":"2024-09-14T10:55:06.691692+0000","last_became_peered":"2024-09-14T10:55:06.691692+0000","last_unstale":"2024-09-14T10:59:07.230732+0000","last_undegraded":"2024-09-14T10:59:07.230732+0000","last_fullsized":"2024-09-14T10:59:07.230732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:59:07.230577+0000","last_clean_scrub_stamp":"2024-09-14T10:59:07.230577+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.596269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:42.225399+0000","last_change":"2024-09-14T10:58:42.225339+0000","last_active":"2024-09-14T10:58:42.225399+0000","last_peered":"2024-09-14T10:58:42.225399+0000","last_clean":"2024-09-14T10:58:42.225399+0000","last_became_active":"2024-09-14T10:55:04.707313+0000","last_became_peered":"2024-09-14T10:55:04.707313+0000","last_unstale":"2024-09-14T10:58:42.225399+0000","last_undegraded":"2024-09-14T10:58:42.225399+0000","last_fullsized":"2024-09-14T10:58:42.225399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:42.225249+0000","last_clean_scrub_stamp":"2024-09-14T10:58:42.225249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:35.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'12","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.540201+0000","last_change":"2024-09-14T10:58:47.540121+0000","last_active":"2024-09-14T10:58:47.540201+0000","last_peered":"2024-09-14T10:58:47.540201+0000","last_clean":"2024-09-14T10:58:47.540201+0000","last_became_active":"2024-09-14T10:55:06.696067+0000","last_became_peered":"2024-09-14T10:55:06.696067+0000","last_unstale":"2024-09-14T10:58:47.540201+0000","last_undegraded":"2024-09-14T10:58:47.540201+0000","last_fullsized":"2024-09-14T10:58:47.540201+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:47.540036+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.540036+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:13.554682+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.620604+0000","last_change":"2024-09-14T10:58:31.620545+0000","last_active":"2024-09-14T10:58:31.620604+0000","last_peered":"2024-09-14T10:58:31.620604+0000","last_clean":"2024-09-14T10:58:31.620604+0000","last_became_active":"2024-09-14T10:55:04.692134+0000","last_became_peered":"2024-09-14T10:55:04.692134+0000","last_unstale":"2024-09-14T10:58:31.620604+0000","last_undegraded":"2024-09-14T10:58:31.620604+0000","last_fullsized":"2024-09-14T10:58:31.620604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:31.620459+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.620459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.184499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.510605+0000","last_change":"2024-09-14T10:58:45.510519+0000","last_active":"2024-09-14T10:58:45.510605+0000","last_peered":"2024-09-14T10:58:45.510605+0000","last_clean":"2024-09-14T10:58:45.510605+0000","last_became_active":"2024-09-14T10:55:06.703806+0000","last_became_peered":"2024-09-14T10:55:06.703806+0000","last_unstale":"2024-09-14T10:58:45.510605+0000","last_undegraded":"2024-09-14T10:58:45.510605+0000","last_fullsized":"2024-09-14T10:58:45.510605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.510404+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.510404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:33.821601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.632421+0000","last_change":"2024-09-14T10:58:32.632337+0000","last_active":"2024-09-14T10:58:32.632421+0000","last_peered":"2024-09-14T10:58:32.632421+0000","last_clean":"2024-09-14T10:58:32.632421+0000","last_became_active":"2024-09-14T10:55:04.687809+0000","last_became_peered":"2024-09-14T10:55:04.687809+0000","last_unstale":"2024-09-14T10:58:32.632421+0000","last_undegraded":"2024-09-14T10:58:32.632421+0000","last_fullsized":"2024-09-14T10:58:32.632421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:32.632202+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.632202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:15.428814+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.056890+0000","last_change":"2024-09-14T10:58:46.056837+0000","last_active":"2024-09-14T10:58:46.056890+0000","last_peered":"2024-09-14T10:58:46.056890+0000","last_clean":"2024-09-14T10:58:46.056890+0000","last_became_active":"2024-09-14T10:55:06.706174+0000","last_became_peered":"2024-09-14T10:55:06.706174+0000","last_unstale":"2024-09-14T10:58:46.056890+0000","last_undegraded":"2024-09-14T10:58:46.056890+0000","last_fullsized":"2024-09-14T10:58:46.056890+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.056739+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.056739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:40.528005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.181570+0000","last_change":"2024-09-14T10:58:33.181486+0000","last_active":"2024-09-14T10:58:33.181570+0000","last_peered":"2024-09-14T10:58:33.181570+0000","last_clean":"2024-09-14T10:58:33.181570+0000","last_became_active":"2024-09-14T10:55:04.712727+0000","last_became_peered":"2024-09-14T10:55:04.712727+0000","last_unstale":"2024-09-14T10:58:33.181570+0000","last_undegraded":"2024-09-14T10:58:33.181570+0000","last_fullsized":"2024-09-14T10:58:33.181570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.181378+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.181378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:00.642621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.491356+0000","last_change":"2024-09-14T10:58:46.491300+0000","last_active":"2024-09-14T10:58:46.491356+0000","last_peered":"2024-09-14T10:58:46.491356+0000","last_clean":"2024-09-14T10:58:46.491356+0000","last_became_active":"2024-09-14T10:55:06.693209+0000","last_became_peered":"2024-09-14T10:55:06.693209+0000","last_unstale":"2024-09-14T10:58:46.491356+0000","last_undegraded":"2024-09-14T10:58:46.491356+0000","last_fullsized":"2024-09-14T10:58:46.491356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-14T10:58:46.491200+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.491200+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:00.231388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:31.729549+0000","last_change":"2024-09-14T10:58:31.729483+0000","last_active":"2024-09-14T10:58:31.729549+0000","last_peered":"2024-09-14T10:58:31.729549+0000","last_clean":"2024-09-14T10:58:31.729549+0000","last_became_active":"2024-09-14T10:55:04.703112+0000","last_became_peered":"2024-09-14T10:55:04.703112+0000","last_unstale":"2024-09-14T10:58:31.729549+0000","last_undegraded":"2024-09-14T10:58:31.729549+0000","last_fullsized":"2024-09-14T10:58:31.729549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:31.729382+0000","last_clean_scrub_stamp":"2024-09-14T10:58:31.729382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:17.181102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.085731+0000","last_change":"2024-09-14T10:58:45.085631+0000","last_active":"2024-09-14T10:58:45.085731+0000","last_peered":"2024-09-14T10:58:45.085731+0000","last_clean":"2024-09-14T10:58:45.085731+0000","last_became_active":"2024-09-14T10:55:06.694827+0000","last_became_peered":"2024-09-14T10:55:06.694827+0000","last_unstale":"2024-09-14T10:58:45.085731+0000","last_undegraded":"2024-09-14T10:58:45.085731+0000","last_fullsized":"2024-09-14T10:58:45.085731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:45.085504+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.085504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:36.257221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.607296+0000","last_change":"2024-09-14T10:58:33.607227+0000","last_active":"2024-09-14T10:58:33.607296+0000","last_peered":"2024-09-14T10:58:33.607296+0000","last_clean":"2024-09-14T10:58:33.607296+0000","last_became_active":"2024-09-14T10:55:04.692057+0000","last_became_peered":"2024-09-14T10:55:04.692057+0000","last_unstale":"2024-09-14T10:58:33.607296+0000","last_undegraded":"2024-09-14T10:58:33.607296+0000","last_fullsized":"2024-09-14T10:58:33.607296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:33.607100+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.607100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:52.664954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.160190+0000","last_change":"2024-09-14T10:58:51.160075+0000","last_active":"2024-09-14T10:58:51.160190+0000","last_peered":"2024-09-14T10:58:51.160190+0000","last_clean":"2024-09-14T10:58:51.160190+0000","last_became_active":"2024-09-14T10:55:06.700594+0000","last_became_peered":"2024-09-14T10:55:06.700594+0000","last_unstale":"2024-09-14T10:58:51.160190+0000","last_undegraded":"2024-09-14T10:58:51.160190+0000","last_fullsized":"2024-09-14T10:58:51.160190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:51.159979+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.159979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:22.667198+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.212771+0000","last_change":"2024-09-14T10:58:48.212687+0000","last_active":"2024-09-14T10:58:48.212771+0000","last_peered":"2024-09-14T10:58:48.212771+0000","last_clean":"2024-09-14T10:58:48.212771+0000","last_became_active":"2024-09-14T10:55:04.709327+0000","last_became_peered":"2024-09-14T10:55:04.709327+0000","last_unstale":"2024-09-14T10:58:48.212771+0000","last_undegraded":"2024-09-14T10:58:48.212771+0000","last_fullsized":"2024-09-14T10:58:48.212771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:48.212580+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.212580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:27.361696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:06.257060+0000","last_change":"2024-09-14T10:59:06.257000+0000","last_active":"2024-09-14T10:59:06.257060+0000","last_peered":"2024-09-14T10:59:06.257060+0000","last_clean":"2024-09-14T10:59:06.257060+0000","last_became_active":"2024-09-14T10:55:06.702068+0000","last_became_peered":"2024-09-14T10:55:06.702068+0000","last_unstale":"2024-09-14T10:59:06.257060+0000","last_undegraded":"2024-09-14T10:59:06.257060+0000","last_fullsized":"2024-09-14T10:59:06.257060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-14T10:59:06.256919+0000","last_clean_scrub_stamp":"2024-09-14T10:59:06.256919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:16.287230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:34.649980+0000","last_change":"2024-09-14T10:58:34.649901+0000","last_active":"2024-09-14T10:58:34.649980+0000","last_peered":"2024-09-14T10:58:34.649980+0000","last_clean":"2024-09-14T10:58:34.649980+0000","last_became_active":"2024-09-14T10:55:04.708162+0000","last_became_peered":"2024-09-14T10:55:04.708162+0000","last_unstale":"2024-09-14T10:58:34.649980+0000","last_undegraded":"2024-09-14T10:58:34.649980+0000","last_fullsized":"2024-09-14T10:58:34.649980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:34.649810+0000","last_clean_scrub_stamp":"2024-09-14T10:58:34.649810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:05.982892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.483165+0000","last_change":"2024-09-14T10:58:49.483078+0000","last_active":"2024-09-14T10:58:49.483165+0000","last_peered":"2024-09-14T10:58:49.483165+0000","last_clean":"2024-09-14T10:58:49.483165+0000","last_became_active":"2024-09-14T10:55:41.752641+0000","last_became_peered":"2024-09-14T10:55:41.752641+0000","last_unstale":"2024-09-14T10:58:49.483165+0000","last_undegraded":"2024-09-14T10:58:49.483165+0000","last_fullsized":"2024-09-14T10:58:49.483165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:49.482969+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.482969+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:26.100489+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:32.215944+0000","last_change":"2024-09-14T10:58:32.215888+0000","last_active":"2024-09-14T10:58:32.215944+0000","last_peered":"2024-09-14T10:58:32.215944+0000","last_clean":"2024-09-14T10:58:32.215944+0000","last_became_active":"2024-09-14T10:55:04.711167+0000","last_became_peered":"2024-09-14T10:55:04.711167+0000","last_unstale":"2024-09-14T10:58:32.215944+0000","last_undegraded":"2024-09-14T10:58:32.215944+0000","last_fullsized":"2024-09-14T10:58:32.215944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-14T10:58:32.215791+0000","last_clean_scrub_stamp":"2024-09-14T10:58:32.215791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.519433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'14","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:50.184095+0000","last_change":"2024-09-14T10:58:50.184022+0000","last_active":"2024-09-14T10:58:50.184095+0000","last_peered":"2024-09-14T10:58:50.184095+0000","last_clean":"2024-09-14T10:58:50.184095+0000","last_became_active":"2024-09-14T10:55:06.693448+0000","last_became_peered":"2024-09-14T10:55:06.693448+0000","last_unstale":"2024-09-14T10:58:50.184095+0000","last_undegraded":"2024-09-14T10:58:50.184095+0000","last_fullsized":"2024-09-14T10:58:50.184095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:50.183944+0000","last_clean_scrub_stamp":"2024-09-14T10:58:50.183944+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:41.356134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":54,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.123508+0000","last_change":"2024-09-14T10:58:35.123439+0000","last_active":"2024-09-14T10:58:35.123508+0000","last_peered":"2024-09-14T10:58:35.123508+0000","last_clean":"2024-09-14T10:58:35.123508+0000","last_became_active":"2024-09-14T10:55:04.709376+0000","last_became_peered":"2024-09-14T10:55:04.709376+0000","last_unstale":"2024-09-14T10:58:35.123508+0000","last_undegraded":"2024-09-14T10:58:35.123508+0000","last_fullsized":"2024-09-14T10:58:35.123508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:35.123338+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.123338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:26.005173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'10","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:49.179871+0000","last_change":"2024-09-14T10:58:49.179766+0000","last_active":"2024-09-14T10:58:49.179871+0000","last_peered":"2024-09-14T10:58:49.179871+0000","last_clean":"2024-09-14T10:58:49.179871+0000","last_became_active":"2024-09-14T10:55:06.706313+0000","last_became_peered":"2024-09-14T10:55:06.706313+0000","last_unstale":"2024-09-14T10:58:49.179871+0000","last_undegraded":"2024-09-14T10:58:49.179871+0000","last_fullsized":"2024-09-14T10:58:49.179871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-14T10:58:49.179681+0000","last_clean_scrub_stamp":"2024-09-14T10:58:49.179681+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:09.816048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:45.266058+0000","last_change":"2024-09-14T10:58:45.266002+0000","last_active":"2024-09-14T10:58:45.266058+0000","last_peered":"2024-09-14T10:58:45.266058+0000","last_clean":"2024-09-14T10:58:45.266058+0000","last_became_active":"2024-09-14T10:55:04.699066+0000","last_became_peered":"2024-09-14T10:55:04.699066+0000","last_unstale":"2024-09-14T10:58:45.266058+0000","last_undegraded":"2024-09-14T10:58:45.266058+0000","last_fullsized":"2024-09-14T10:58:45.266058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:45.265914+0000","last_clean_scrub_stamp":"2024-09-14T10:58:45.265914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.079568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:48.131630+0000","last_change":"2024-09-14T10:58:48.131536+0000","last_active":"2024-09-14T10:58:48.131630+0000","last_peered":"2024-09-14T10:58:48.131630+0000","last_clean":"2024-09-14T10:58:48.131630+0000","last_became_active":"2024-09-14T10:55:06.699479+0000","last_became_peered":"2024-09-14T10:55:06.699479+0000","last_unstale":"2024-09-14T10:58:48.131630+0000","last_undegraded":"2024-09-14T10:58:48.131630+0000","last_fullsized":"2024-09-14T10:58:48.131630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:48.131427+0000","last_clean_scrub_stamp":"2024-09-14T10:58:48.131427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:07.192316+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:44.286607+0000","last_change":"2024-09-14T10:58:44.286543+0000","last_active":"2024-09-14T10:58:44.286607+0000","last_peered":"2024-09-14T10:58:44.286607+0000","last_clean":"2024-09-14T10:58:44.286607+0000","last_became_active":"2024-09-14T10:55:04.705839+0000","last_became_peered":"2024-09-14T10:55:04.705839+0000","last_unstale":"2024-09-14T10:58:44.286607+0000","last_undegraded":"2024-09-14T10:58:44.286607+0000","last_fullsized":"2024-09-14T10:58:44.286607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:44.286454+0000","last_clean_scrub_stamp":"2024-09-14T10:58:44.286454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:44.534792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:59:05.301595+0000","last_change":"2024-09-14T10:59:05.301521+0000","last_active":"2024-09-14T10:59:05.301595+0000","last_peered":"2024-09-14T10:59:05.301595+0000","last_clean":"2024-09-14T10:59:05.301595+0000","last_became_active":"2024-09-14T10:55:06.695032+0000","last_became_peered":"2024-09-14T10:55:06.695032+0000","last_unstale":"2024-09-14T10:59:05.301595+0000","last_undegraded":"2024-09-14T10:59:05.301595+0000","last_fullsized":"2024-09-14T10:59:05.301595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:59:05.301439+0000","last_clean_scrub_stamp":"2024-09-14T10:59:05.301439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:07.827525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:33.750205+0000","last_change":"2024-09-14T10:58:33.750129+0000","last_active":"2024-09-14T10:58:33.750205+0000","last_peered":"2024-09-14T10:58:33.750205+0000","last_clean":"2024-09-14T10:58:33.750205+0000","last_became_active":"2024-09-14T10:55:04.694992+0000","last_became_peered":"2024-09-14T10:55:04.694992+0000","last_unstale":"2024-09-14T10:58:33.750205+0000","last_undegraded":"2024-09-14T10:58:33.750205+0000","last_fullsized":"2024-09-14T10:58:33.750205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-14T10:58:33.750046+0000","last_clean_scrub_stamp":"2024-09-14T10:58:33.750046+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:41.673497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'14","reported_seq":78,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.083573+0000","last_change":"2024-09-14T10:58:47.083486+0000","last_active":"2024-09-14T10:58:47.083573+0000","last_peered":"2024-09-14T10:58:47.083573+0000","last_clean":"2024-09-14T10:58:47.083573+0000","last_became_active":"2024-09-14T10:55:06.695596+0000","last_became_peered":"2024-09-14T10:55:06.695596+0000","last_unstale":"2024-09-14T10:58:47.083573+0000","last_undegraded":"2024-09-14T10:58:47.083573+0000","last_fullsized":"2024-09-14T10:58:47.083573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-14T10:58:47.083386+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.083386+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:48.862348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:46.225610+0000","last_change":"2024-09-14T10:58:46.225553+0000","last_active":"2024-09-14T10:58:46.225610+0000","last_peered":"2024-09-14T10:58:46.225610+0000","last_clean":"2024-09-14T10:58:46.225610+0000","last_became_active":"2024-09-14T10:55:04.705466+0000","last_became_peered":"2024-09-14T10:55:04.705466+0000","last_unstale":"2024-09-14T10:58:46.225610+0000","last_undegraded":"2024-09-14T10:58:46.225610+0000","last_fullsized":"2024-09-14T10:58:46.225610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:46.225471+0000","last_clean_scrub_stamp":"2024-09-14T10:58:46.225471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.589934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:47.182450+0000","last_change":"2024-09-14T10:58:47.182383+0000","last_active":"2024-09-14T10:58:47.182450+0000","last_peered":"2024-09-14T10:58:47.182450+0000","last_clean":"2024-09-14T10:58:47.182450+0000","last_became_active":"2024-09-14T10:55:04.707929+0000","last_became_peered":"2024-09-14T10:55:04.707929+0000","last_unstale":"2024-09-14T10:58:47.182450+0000","last_undegraded":"2024-09-14T10:58:47.182450+0000","last_fullsized":"2024-09-14T10:58:47.182450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:58:47.182295+0000","last_clean_scrub_stamp":"2024-09-14T10:58:47.182295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:12.861086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'12","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:51.410230+0000","last_change":"2024-09-14T10:58:51.410163+0000","last_active":"2024-09-14T10:58:51.410230+0000","last_peered":"2024-09-14T10:58:51.410230+0000","last_clean":"2024-09-14T10:58:51.410230+0000","last_became_active":"2024-09-14T10:55:06.697039+0000","last_became_peered":"2024-09-14T10:55:06.697039+0000","last_unstale":"2024-09-14T10:58:51.410230+0000","last_undegraded":"2024-09-14T10:58:51.410230+0000","last_fullsized":"2024-09-14T10:58:51.410230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:51.410073+0000","last_clean_scrub_stamp":"2024-09-14T10:58:51.410073+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:45.911716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'6","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:35.602004+0000","last_change":"2024-09-14T10:58:35.601919+0000","last_active":"2024-09-14T10:58:35.602004+0000","last_peered":"2024-09-14T10:58:35.602004+0000","last_clean":"2024-09-14T10:58:35.602004+0000","last_became_active":"2024-09-14T10:55:04.708323+0000","last_became_peered":"2024-09-14T10:55:04.708323+0000","last_unstale":"2024-09-14T10:58:35.602004+0000","last_undegraded":"2024-09-14T10:58:35.602004+0000","last_fullsized":"2024-09-14T10:58:35.602004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-14T10:58:35.601827+0000","last_clean_scrub_stamp":"2024-09-14T10:58:35.601827+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:44.673365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'12","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-14T10:58:57.139164+0000","last_change":"2024-09-14T10:58:57.139091+0000","last_active":"2024-09-14T10:58:57.139164+0000","last_peered":"2024-09-14T10:58:57.139164+0000","last_clean":"2024-09-14T10:58:57.139164+0000","last_became_active":"2024-09-14T10:55:41.753464+0000","last_became_peered":"2024-09-14T10:55:41.753464+0000","last_unstale":"2024-09-14T10:58:57.139164+0000","last_undegraded":"2024-09-14T10:58:57.139164+0000","last_fullsized":"2024-09-14T10:58:57.139164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-14T10:58:57.139001+0000","last_clean_scrub_stamp":"2024-09-14T10:58:57.139001+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:20.477286+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1665,"num_read_kb":1555,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40008,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331832,"statfs":{"total":96636764160,"available":96595795968,"internally_reserved":0,"allocated":516096,"data_stored":161996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":140,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1028096,"data_stored":748224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640323,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36380,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335460,"statfs":{"total":96636764160,"available":96599511040,"internally_reserved":0,"allocated":1060864,"data_stored":749425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":475136,"data_stored":160135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:00:06.183 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:00:06.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.307+0000 7fcdefc7f640 1 Processor -- start 2024-09-14T11:00:06.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdefc7f640 1 -- start start 2024-09-14T11:00:06.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdefc7f640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcde806efc0 0x7fcde8130e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdefc7f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde806fd90 con 0x7fcde812be50 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdefc7f640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 -- 0x7fcde8070c50 con 0x7fcde806efc0 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcded21a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fcde806efc0 0x7fcde8130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdeda1b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fcde812be50 0x7fcde812c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:59742/0 (socket says 172.21.15.116:59742) 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdeda1b640 1 -- 172.21.15.116:0/983076777 learned_addr learned my addr 172.21.15.116:0/983076777 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcded21a640 1 -- 172.21.15.116:0/983076777 >> v1:172.21.15.116:6789/0 conn(0x7fcde812be50 legacy=0x7fcde812c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcded21a640 1 -- 172.21.15.116:0/983076777 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde8070e70 con 0x7fcde806efc0 2024-09-14T11:00:06.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.308+0000 7fcdeca19640 1 -- 172.21.15.116:0/983076777 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691035103 0 0) 0x7fcde806fd90 con 0x7fcde812be50 2024-09-14T11:00:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.309+0000 7fcded21a640 1 --2- 172.21.15.116:0/983076777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde8130e20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00a8c0 tx=0x7fcddc02b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8aeda437c6ffb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.309+0000 7fcdeca19640 1 -- 172.21.15.116:0/983076777 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcddc00b040 con 0x7fcde806efc0 2024-09-14T11:00:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.309+0000 7fcdeca19640 1 -- 172.21.15.116:0/983076777 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcddc030640 con 0x7fcde806efc0 2024-09-14T11:00:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.309+0000 7fcdeca19640 1 -- 172.21.15.116:0/983076777 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcddc030940 con 0x7fcde806efc0 2024-09-14T11:00:06.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 -- 172.21.15.116:0/983076777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 msgr2=0x7fcde8130e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/983076777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde8130e20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00a8c0 tx=0x7fcddc02b560 comp rx=0 tx=0).stop 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 -- 172.21.15.116:0/983076777 shutdown_connections 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/983076777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde8130e20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 -- 172.21.15.116:0/983076777 >> 172.21.15.116:0/983076777 conn(0x7fcde809abc0 msgr2=0x7fcde8098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 -- 172.21.15.116:0/983076777 shutdown_connections 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.310+0000 7fcdefc7f640 1 -- 172.21.15.116:0/983076777 wait complete. 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdefc7f640 1 Processor -- start 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdefc7f640 1 -- start start 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdefc7f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdefc7f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8070470 con 0x7fcde806efc0 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdeda1b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdeda1b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:40400/0 (socket says 172.21.15.116:40400) 2024-09-14T11:00:06.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdeda1b640 1 -- 172.21.15.116:0/3255330276 learned_addr learned my addr 172.21.15.116:0/3255330276 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdeda1b640 1 -- 172.21.15.116:0/3255330276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde812aba0 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdeda1b640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c3d0 tx=0x7fcde400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.311+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde40074d0 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde40047e0 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde4007670 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde8073680 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde808faa0 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde80728a0 con 0x7fcde806efc0 2024-09-14T11:00:06.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.312+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) ==== 50954+0+0 (secure 0 0 0) 0x7fcde4011070 con 0x7fcde806efc0 2024-09-14T11:00:06.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.313+0000 7fcdda7fc640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 0x7fcdcc040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-14T11:00:06.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.313+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6313+0+0 (secure 0 0 0) 0x7fcde4053220 con 0x7fcde806efc0 2024-09-14T11:00:06.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.313+0000 7fcded21a640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 0x7fcdcc040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-14T11:00:06.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.314+0000 7fcded21a640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 0x7fcdcc040a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcddc035000 tx=0x7fcddc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-14T11:00:06.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.317+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195863 (secure 0 0 0) 0x7fcde80728a0 con 0x7fcde806efc0 2024-09-14T11:00:06.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.491+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fcde8099e00 con 0x7fcde806efc0 2024-09-14T11:00:06.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.493+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fcde4012dd0 con 0x7fcde806efc0 2024-09-14T11:00:06.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.493+0000 7fcdda7fc640 1 -- 172.21.15.116:0/3255330276 <== mon.0 v2:172.21.15.116:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcde401bdd0 con 0x7fcde806efc0 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 msgr2=0x7fcdcc040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 0x7fcdcc040a30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcddc035000 tx=0x7fcddc030000 comp rx=0 tx=0).stop 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 msgr2=0x7fcde81c1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcde400c3d0 tx=0x7fcde400c890 comp rx=0 tx=0).stop 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 shutdown_connections 2024-09-14T11:00:06.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.164:6824/1645614220,v1:172.21.15.164:6825/1645614220] conn(0x7fcdcc03e570 0x7fcdcc040a30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 --2- 172.21.15.116:0/3255330276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcde806efc0 0x7fcde81c1cf0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-14T11:00:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 >> 172.21.15.116:0/3255330276 conn(0x7fcde809abc0 msgr2=0x7fcde8071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-14T11:00:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 shutdown_connections 2024-09-14T11:00:06.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-09-14T11:00:06.496+0000 7fcdefc7f640 1 -- 172.21.15.116:0/3255330276 wait complete. 2024-09-14T11:00:06.504 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:00:06.504 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:00:06.504 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:00:06.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.534 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:00:06.535 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:00:06.535 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.568 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:00:06.568 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:00:06.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.632 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:00:06.632 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:00:06.632 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.702 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:00:06.702 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:00:06.702 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:00:06.702 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.781 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:00:06.781 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:00:06.781 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:00:06.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:00:06.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-14T11:00:06.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-14T11:00:06.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-14T11:00:06.793 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:00:06.793 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:00:06.793 DEBUG:teuthology.orchestra.run.smithi116:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-14T11:00:06.864 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:00:06.865 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:00:07.021 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:00:07.021 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:00:07.153 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:00:07.153 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:00:07.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:00:07.236 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:00:07.300 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:00:07.302 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/data/mon.a.tgz 2024-09-14T11:00:07.302 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-09-14T11:00:07.319 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.VtFHekK5Lm 2024-09-14T11:00:07.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VtFHekK5Lm 2024-09-14T11:00:07.456 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.VtFHekK5Lm 2024-09-14T11:00:07.539 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.VtFHekK5Lm is 284KB 2024-09-14T11:00:07.605 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.VtFHekK5Lm 2024-09-14T11:00:07.620 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:00:07.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:00:07.662 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:00:07.740 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:00:07.755 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:00:07.755 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:00:07.757 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi116/crash 2024-09-14T11:00:07.758 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:00:07.805 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi164/crash 2024-09-14T11:00:07.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:00:07.890 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:00:07.890 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:00:07.892 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:00:07.914 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:00:07.915 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2024-09-14T11:00:07.915 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32167.log 2024-09-14T11:00:07.915 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.32377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32167.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27227.log 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32167.log.gz 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31332.log 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31915.log: /var/log/ceph/ceph.tmp-client.admin.27227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31330.log 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz -- replaced with /var/log/ceph/ceph.tmp-client.admin.27227.log.gz 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31957.log 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31332.log.gz 2024-09-14T11:00:07.942 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31330.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30748.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32335.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31957.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32083.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31609.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30748.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31609.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32083.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31163.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31609.log.gz 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-14T11:00:07.943 INFO:teuthology.orchestra.run.smithi116.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31501.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31163.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31999.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28935.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29053.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31999.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.28935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-09-14T11:00:07.944 INFO:teuthology.orchestra.run.smithi116.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28935.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.29053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30979.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29053.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31021.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31164.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30979.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30853.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31021.log: gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz -5 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32125.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31021.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32125.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30853.log.gz 2024-09-14T11:00:07.945 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32125.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32419.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31331.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32419.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31777.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31331.log: /var/log/ceph/ceph-client.admin.32545.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31331.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-09-14T11:00:07.946 INFO:teuthology.orchestra.run.smithi116.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31777.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31063.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31861.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31063.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32503.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31063.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32631.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31861.log: /var/log/ceph/ceph-client.admin.32503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30793.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31861.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32631.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32503.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32631.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31671.log 2024-09-14T11:00:07.947 INFO:teuthology.orchestra.run.smithi116.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30793.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31499.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31629.log: /var/log/ceph/ceph-client.admin.31671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29091.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31499.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31671.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31162.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31499.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30886.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.29091.log: /var/log/ceph/ceph-client.admin.31162.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29091.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32251.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31162.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31819.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30886.log.gz 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32673.log 2024-09-14T11:00:07.948 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30937.log 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31819.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32251.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.32673.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31819.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32587.log 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32673.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.30937.log: /var/log/ceph/ceph-client.admin.32587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31670.log 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30937.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31500.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32587.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.31670.log: /var/log/ceph/ceph-client.admin.32293.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31670.log.gz 2024-09-14T11:00:07.949 INFO:teuthology.orchestra.run.smithi116.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-09-14T11:00:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37589.log 2024-09-14T11:00:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42423.log 2024-09-14T11:00:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.37589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2024-09-14T11:00:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.42423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31581.log 2024-09-14T11:00:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66018.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40009.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31581.log: /var/log/ceph/ceph-client.0.66018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56338.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.42423.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31581.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.40009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41818.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37589.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.56338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.40009.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.41818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96238.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76303.log 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-09-14T11:00:07.985 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66018.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79933.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.96238.log: /var/log/ceph/ceph-client.0.76303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61178.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56338.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41818.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.79933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96895.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.61178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78118.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.96238.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.96895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55733.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76303.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.78118.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.55733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65413.log 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79933.log.gz 2024-09-14T11:00:07.986 INFO:teuthology.orchestra.run.smithi164.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61178.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.65413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46658.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.78118.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63598.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.55733.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.46658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53918.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.0.63598.log: --verbose -- /var/log/ceph/ceph-client.0.49078.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.53918.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.96895.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65413.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.49078.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.46658.log.gz 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36190.log 2024-09-14T11:00:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38194.log 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53918.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36190.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.49078.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.63598.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.52708.log 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36190.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.38194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36030.log 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.52708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64203.log 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82958.log 85.8% 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36030.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.64203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89583.log 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.82958.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38194.log.gz 2024-09-14T11:00:07.988 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52708.log.gz 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87774.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82353.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.89583.log: /var/log/ceph/ceph-client.0.87774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71463.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.82353.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64203.log.gz 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87774.log.gz 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67228.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82958.log.gz 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.71463.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89583.log.gz 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.67228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66623.log 2024-09-14T11:00:07.989 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.31501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85977.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz/var/log/ceph/ceph-client.0.66623.log: 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50893.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.71463.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.85977.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82353.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55128.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.67228.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91398.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.50893.log: /var/log/ceph/ceph-client.0.55128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48473.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.85977.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.66623.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.91398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95028.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.48473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62388.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.95028.log: gzip -5 91.4% -- replaced with /var/log/ceph/ceph-client.0.50893.log.gz 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.95633.log 2024-09-14T11:00:07.990 INFO:teuthology.orchestra.run.smithi164.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.55128.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.62388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36984.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.91398.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.95633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84773.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.48473.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.0.36984.log: --verbose -- /var/log/ceph/ceph-client.0.59363.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95028.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.84773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88978.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.59363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87175.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62388.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2%/var/log/ceph/ceph-client.0.88978.log: -- replaced with /var/log/ceph/ceph-client.0.95633.log.gz 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85378.log 2024-09-14T11:00:07.991 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% 92.1% -- replaced with /var/log/ceph/ceph-client.0.36984.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.84773.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.87175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77513.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92608.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.85378.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.59363.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.87175.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.77513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75698.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88978.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.85378.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.92608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44843.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86576.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.75698.log: /var/log/ceph/ceph-client.0.44843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90793.log 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.86576.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77513.log.gz 2024-09-14T11:00:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.92608.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.93213.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.90793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47263.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86576.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.93213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56943.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.75698.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44843.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.47263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93818.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.56943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75093.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.93818.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90793.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.93213.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45448.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.47263.log.gz 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67833.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.75093.log: /var/log/ceph/ceph-client.0.45448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50288.log 2024-09-14T11:00:07.993 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.67833.log: gzip 91.6% -- replaced with /var/log/ceph/ceph-client.0.56943.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.93818.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.60573.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.50288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80538.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45448.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5/var/log/ceph/ceph-client.0.60573.log: --verbose -- /var/log/ceph/ceph-client.0.69043.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75093.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:gzip/var/log/ceph/ceph-client.0.80538.log: -5 --verbose -- /var/log/ceph/ceph-client.0.46053.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.69043.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44238.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.67833.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.50288.log.gz 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.46053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79328.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.44238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53313.log 2024-09-14T11:00:07.994 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.79328.log: 91.2% 91.5% -- replaced with /var/log/ceph/ceph-client.0.60573.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.80538.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.53313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94423.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46053.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.2.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44238.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92003.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.69043.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.94423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49683.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79328.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.92003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43633.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53313.log.gz 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.49683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83563.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.43633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72068.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.83563.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78723.log 2024-09-14T11:00:07.995 INFO:teuthology.orchestra.run.smithi164.stderr: -- replaced with /var/log/ceph/ceph-client.0.94423.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92003.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49683.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.72068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47868.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43633.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.78723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73278.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83563.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.47868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73883.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.73278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61783.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72068.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.73883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69648.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78723.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.62993.log 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.61783.log: /var/log/ceph/ceph-client.0.69648.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47868.log.gz 2024-09-14T11:00:07.996 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.73278.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.73883.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40608.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.62993.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.61783.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.59968.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.40608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72673.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.59968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39404.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62993.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.72673.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69648.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52103.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8%/var/log/ceph/ceph-client.0.39404.log: -- replaced with /var/log/ceph/ceph-client.0.40608.log.gz 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76908.log 2024-09-14T11:00:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.52103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58758.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.59968.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.76908.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39404.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52103.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76908.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81143.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.58758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64808.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72673.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.81143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58153.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.64808.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.58153.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58758.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.74488.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 91.2% -- replaced with /var/log/ceph/ceph-client.0.81143.log.gz 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: --verbose -- /var/log/ceph/ceph-client.0.81748.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.74488.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41213.log 2024-09-14T11:00:07.998 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.64808.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.81748.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58153.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.74488.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43028.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.41213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70253.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.43028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51498.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.81748.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.70253.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41213.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43028.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68438.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.51498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88373.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.68438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31621.log 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.88373.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51498.log.gz 92.7% -- replaced with /var/log/ceph/ceph-client.0.70253.log.gz 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-14T11:00:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57548.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.68438.log.gz 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36070.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88373.log.gz/var/log/ceph/ceph-client.admin.31621.log: 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.57548.log: gzip -5 --verbose -- 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gz 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr: /var/log/ceph/ceph-client.0.54523.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.admin.36070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84168.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36070.log.gz 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.54523.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.84168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38799.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57548.log.gz 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-osd.3.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54523.log.gz 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70858.log 2024-09-14T11:00:08.000 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.38799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90188.log 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.70858.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.84168.log.gz 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38799.log.gz 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70858.log.gz 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.90188.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90188.log.gz 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:00:08.001 INFO:teuthology.orchestra.run.smithi164.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:00:08.095 INFO:teuthology.orchestra.run.smithi116.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:00:08.741 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:00:08.821 INFO:teuthology.orchestra.run.smithi116.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:00:08.823 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-09-14T11:00:08.823 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m0.919s 2024-09-14T11:00:08.824 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m1.072s 2024-09-14T11:00:08.824 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m0.074s 2024-09-14T11:00:08.895 INFO:teuthology.orchestra.run.smithi164.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:00:08.926 INFO:teuthology.orchestra.run.smithi164.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:00:08.927 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-09-14T11:00:08.928 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m1.021s 2024-09-14T11:00:08.928 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m2.865s 2024-09-14T11:00:08.928 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m0.195s 2024-09-14T11:00:08.928 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:00:08.929 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi116/log 2024-09-14T11:00:08.930 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:00:09.149 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi164/log 2024-09-14T11:00:09.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:00:09.687 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:00:09.699 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:00:09.699 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:00:09.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:00:09.773 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:00:09.785 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:00:09.785 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:00:09.788 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:00:09.801 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:00:09.802 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +3151us[+3171us] +/- 36ms 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +1237us[+1257us] +/- 72ms 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -9391us[-9371us] +/- 89ms 2024-09-14T11:00:09.805 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:00:09.806 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:00:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-09-14T11:00:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +3162us[+3171us] +/- 36ms 2024-09-14T11:00:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +1267us[+1267us] +/- 72ms 2024-09-14T11:00:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -9367us[-9367us] +/- 89ms 2024-09-14T11:00:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:00:09.807 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:00:09.818 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:00:09.818 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:00:09.833 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:00:09.908 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:00:09.969 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:00:09.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:09.997 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:00:10.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:10.025 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:00:10.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:00:10.235 INFO:teuthology.task.internal:Duration was 724.795033 seconds 2024-09-14T11:00:10.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:00:10.267 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:00:10.267 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:00:10.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:00:10.305 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:00:10.310 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:00:10.687 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:00:10.687 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-09-14T11:00:10.687 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:00:10.747 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-09-14T11:00:10.748 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:00:10.773 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:00:10.773 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:00:10.791 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:00:10.839 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:00:10.839 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:00:10.857 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:00:10.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:00:10.992 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:00:10.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:00:11.017 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:00:11.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:00:11.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:00:11.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:00:11.081 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-09-14T11:00:11.105 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-09-14T11:00:11.127 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:00:11.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:11.151 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:00:11.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:11.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:00:11.192 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:00:11.193 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi116 2024-09-14T11:00:11.193 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:00:11.226 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904140/remote/smithi164 2024-09-14T11:00:11.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:00:11.259 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:00:11.259 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:00:11.263 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:00:11.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:00:11.320 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:00:11.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:00:11.334 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:00:11.335 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:00:11.337 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:00:11.349 INFO:teuthology.orchestra.run.smithi116.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:00 /home/ubuntu/cephtest 2024-09-14T11:00:11.366 INFO:teuthology.orchestra.run.smithi164.stdout: 265329 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:00 /home/ubuntu/cephtest 2024-09-14T11:00:11.367 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:00:11.385 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:00:11.466 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 724.795033454895 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:00:11.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:00:11.564 INFO:teuthology.run:pass